Run batch monitoring on a schedule
Give DataRobot a regular nudge to monitor batch predictions, with the deployment and data context spelled out once.
Trigger
Recurring schedule
Notis starts this workflow on a schedule, such as daily, weekly, or during business hours.
Action
Create Batch Monitoring Job
Create an asynchronous batch monitoring job to track model performance and data drift.
Why this helps
When batch monitoring relies on manual follow-up, performance checks can be missed during a packed schedule.
- Start a batch monitoring job on a recurring schedule
- Reduce repeated setup and context switching
- Send the asynchronous job reference to your selected report channel
Setup
Build it in a few focused steps.
- 1Connect Abyssale and DataRobot once in Notis.
- 2Create an automation and describe the batch monitoring outcome in one instruction.
- 3Specify the DataRobot deployment and batch data details required to create the monitoring job.
- 4Pick a Notis recurring schedule and choose where run reports should go.
- 5Test with one real monitoring run and verify the returned job reference.
Questions about this workflow
Does this action create the monitoring definition?
No. It creates a batch monitoring job. Use a separately configured job definition if your workflow should launch monitoring from an existing definition.
Is the monitoring result available immediately?
The job is created asynchronously and returns a job ID. The action description does not promise that monitoring results are ready in the same run.
When this happens · Trigger
Do this · Action
Supported Triggers and Actions
Notis builds workflows that link Abyssale to Datarobot. A trigger fires from one place; an action lands in another.
Abyssale triggers
Datarobot actions
Recurring trigger
Notis starts this workflow on a schedule, such as daily, weekly, or during business hours.
Add Users to Group
Add one or more existing users to a user group.
Webhook trigger
Notis starts this workflow when an external tool or custom backend sends an HTTP request.
Add User to Organization
Add a user to an existing organization.
Analyze Dataset Definition
Start an analysis job to retrieve a dataset’s metadata, schema and statistics.
Archive Model Package
Archive a model package that is no longer in active use.
Build Java Scoring Code Package
Start an asynchronous build of a Java JAR scoring package for a deployment.
Cancel Notebook Job
Immediately cancel a running or queued notebook job; this cannot be undone.
Cancel Project Job
Cancel a pending project job.
Check Project Status
Check a project’s status and progress.
Connect any two apps with Notis in the middle.
Abyssale and Datarobot, or any other combination from 1,000+ integrations.
When this happens · Trigger
Do this · Action
Save your first hour today.
7-day trial of any paid plan, with 20$ of usage included.
No card. Works with personal or business Datarobot.