Prepare monitoring for device model predictions
Create the monitoring definition for a deployment so a team can track batch prediction performance and data drift.
Trigger
Recurring schedule
Notis starts this workflow on a schedule, such as daily, weekly, or during business hours.
Action
Create Batch Monitoring Job Definition
Create a batch monitoring job definition for scheduled or manual deployment tracking.
Why this helps
Monitoring can be forgotten when the setup is not part of a repeatable operating routine.
- Create a reusable monitoring job definition for a deployment.
- Make drift and performance monitoring easier to establish.
- Keep monitoring setup in a regular operational routine.
Setup
Build it in a few focused steps.
- 1Connect Adafruit IO and DataRobot once in the Notis portal.
- 2Create an automation in Automations, New Automation, and name it.
- 3Tell Notis to create a batch monitoring job definition for the specified DataRobot deployment.
- 4Pick the recurring schedule and choose where run reports go.
- 5Test with one real deployment and review the monitoring definition.
Questions about this workflow
Does this calculate monitoring results?
No. It creates a job definition. A monitoring job must be created or run separately to track performance and drift.
What is required to identify what to monitor?
The instruction must identify a DataRobot deployment. The deployment must exist in DataRobot.
When this happens · Trigger
Do this · Action
Supported Triggers and Actions
Notis builds workflows that link Adafruit IO to Datarobot. A trigger fires from one place; an action lands in another.
Adafruit IO triggers
Datarobot actions
Recurring trigger
Notis starts this workflow on a schedule, such as daily, weekly, or during business hours.
Add Users to Group
Add one or more existing users to a user group.
Webhook trigger
Notis starts this workflow when an external tool or custom backend sends an HTTP request.
Add User to Organization
Add a user to an existing organization.
Analyze Dataset Definition
Start an analysis job to retrieve a dataset’s metadata, schema and statistics.
Archive Model Package
Archive a model package that is no longer in active use.
Build Java Scoring Code Package
Start an asynchronous build of a Java JAR scoring package for a deployment.
Cancel Notebook Job
Immediately cancel a running or queued notebook job; this cannot be undone.
Cancel Project Job
Cancel a pending project job.
Check Project Status
Check a project’s status and progress.
Connect any two apps with Notis in the middle.
Adafruit IO and Datarobot, or any other combination from 1,000+ integrations.
When this happens · Trigger
Do this · Action
Save your first hour today.
7-day trial of any paid plan, with 20$ of usage included.
No card. Works with personal or business Datarobot.