Run batch monitoring jobs on a schedule
Have Notis start a monitoring job at your chosen cadence for a specified DataRobot deployment.
Trigger
Recurring schedule
Notis starts this workflow on a schedule, such as daily, weekly, or during business hours.
Action
Create Batch Monitoring Job
Tool to create a DataRobot Batch Monitoring job for tracking model performance and data drift on batch predictions. Use when you need to monitor predictions at scale. The job is created asynchronously and returns immediately with a job ID.
Why this helps
Monitoring jobs are easy to forget when a team relies on manual reminders to run them.
- Reduce manual monitoring reminders
- Keep monitoring runs regular
- See a report for each job start
Setup
Build it in a few focused steps.
- 1Connect DataRobot once in the Notis portal.
- 2Create an automation in Automations, New Automation, and name it.
- 3Describe the monitoring job to create and provide a valid deployment and required inputs.
- 4Pick a recurring schedule trigger and choose a report channel.
- 5Test with one real deployment and review the created job in DataRobot.
Questions about this workflow
Does this define a monitoring schedule inside DataRobot?
This action creates a batch monitoring job. A job definition is a separate action for reusable setup.
Can the job monitor any deployment automatically?
Specify the deployment and required inputs; the action needs a valid target.
When this happens · Trigger
Do this · Action
Supported Triggers and Actions
Notis builds workflows that link Agent mail to Datarobot. A trigger fires from one place; an action lands in another.
Agent mail triggers
Datarobot actions
Recurring trigger
Notis starts this workflow on a schedule, such as daily, weekly, or during business hours.
Add Users to Group
Tool to add one or more users to a DataRobot user group by groupId. Use when you have a valid groupId and want to add existing usernames. Limit 100 users per request.
Webhook trigger
Notis starts this workflow when an external tool or custom backend sends an HTTP request.
Add User to Organization
Tool to add a user to an existing organization. Use when you have an organizationId and wish to add or create a user within it.
New Email Received
Trigger for new emails in an AgentMail inbox
Analyze Dataset Definition
Tool to analyze a dataset definition by ID. Use when you need to trigger an analysis job that retrieves dataset metadata, schema, and statistics.
Archive Model Package
Tool to archive a DataRobot model package. Use when you need to archive a model package that is no longer actively used.
Build Java Scoring Code Package
Initiates an asynchronous build of a Java JAR package containing DataRobot Scoring Code for a deployment. The JAR can be executed locally for predictions or used as a library in Java applications. Use after confirming the deployment is active and supports scoring code. Poll the returned statusId or location URL to track build progress.
Cancel Notebook Job
Tool to cancel a running or pending notebook job execution. Use when you need to stop a notebook job that is currently executing or queued. The cancellation is immediate and cannot be undone.
Cancel Project Job
Tool to cancel a pending job for a project. Use when you need to stop a queued or running job after confirming its ID.
Check Project Status
Tool to check the status of a DataRobot project. Use after creating or loading a project to monitor its stage and Autopilot completion.
Connect any two apps with Notis in the middle.
Agent mail and Datarobot, or any other combination from 1,000+ integrations.
When this happens · Trigger
Do this · Action
Save your first hour today.
7-day trial of any paid plan, with 20$ of usage included.
No card. Works with personal or business Datarobot.