Run batch monitoring for a DataRobot deployment
Start a monitoring job on a schedule to track performance and data drift for the deployment you specify.
Trigger
Recurring schedule
Notis starts this workflow on a schedule, such as daily, weekly, or during business hours.
Action
Create Batch Monitoring Job
Tool to create a DataRobot Batch Monitoring job for tracking model performance and data drift on batch predictions. Use when you need to monitor predictions at scale. The job is created asynchronously and returns immediately with a job ID.
Why this helps
A monitoring definition does not help if no one remembers to launch the monitoring job.
- Launch monitoring jobs on a recurring schedule.
- Track performance and data drift at batch scale.
- Keep job run reports visible in your chosen channel.
Setup
Build it in a few focused steps.
- 1Connect DataRobot once in the Notis portal.
- 2Create an automation and give it a clear name.
- 3In one instruction, provide the deployment identifier and ask Notis to create a batch monitoring job on the desired recurring schedule.
- 4Pick a recurring schedule as the trigger and choose where run reports go.
- 5Test with one real deployment and review the returned job ID in the run report.
Questions about this workflow
What does this action monitor?
It creates a DataRobot Batch Monitoring job for tracking model performance and data drift on batch predictions.
Does the job finish during the automation run?
The job is created asynchronously and returns a job ID; completion may occur later.
When this happens · Trigger
Do this · Action
Supported Triggers and Actions
Notis builds workflows that link Gmail to Datarobot. A trigger fires from one place; an action lands in another.
Gmail triggers
Datarobot actions
Recurring trigger
Notis starts this workflow on a schedule, such as daily, weekly, or during business hours.
Add Users to Group
Tool to add one or more users to a DataRobot user group by groupId. Use when you have a valid groupId and want to add existing usernames. Limit 100 users per request.
Webhook trigger
Notis starts this workflow when an external tool or custom backend sends an HTTP request.
Add User to Organization
Tool to add a user to an existing organization. Use when you have an organizationId and wish to add or create a user within it.
Email Sent
Triggers when a Gmail message is sent by the authenticated user. It polls the 'SENT' label and emits metadata including sender, recipients, subject, timestamp, and thread ID.
Analyze Dataset Definition
Tool to analyze a dataset definition by ID. Use when you need to trigger an analysis job that retrieves dataset metadata, schema, and statistics.
New Gmail Message Received Trigger
Triggers when a new message is received in Gmail.
Archive Model Package
Tool to archive a DataRobot model package. Use when you need to archive a model package that is no longer actively used.
Build Java Scoring Code Package
Initiates an asynchronous build of a Java JAR package containing DataRobot Scoring Code for a deployment. The JAR can be executed locally for predictions or used as a library in Java applications. Use after confirming the deployment is active and supports scoring code. Poll the returned statusId or location URL to track build progress.
Cancel Notebook Job
Tool to cancel a running or pending notebook job execution. Use when you need to stop a notebook job that is currently executing or queued. The cancellation is immediate and cannot be undone.
Cancel Project Job
Tool to cancel a pending job for a project. Use when you need to stop a queued or running job after confirming its ID.
Check Project Status
Tool to check the status of a DataRobot project. Use after creating or loading a project to monitor its stage and Autopilot completion.
Connect any two apps with Notis in the middle.
Gmail and Datarobot, or any other combination from 1,000+ integrations.
When this happens · Trigger
Do this · Action
Save your first hour today.
7-day trial of any paid plan, with 20$ of usage included.
No card. Works with personal or business Datarobot.