Set up repeatable batch monitoring
Turn a monitoring plan into a DataRobot job definition on a Notis schedule, with the deployment supplied.
Trigger
Recurring schedule
Notis starts this workflow on a schedule, such as daily, weekly, or during business hours.
Action
Create Batch Monitoring Job Definition
Tool to create a Batch Monitoring job definition for tracking deployment performance and data drift. Use when you need to set up scheduled or manual monitoring jobs for a DataRobot deployment.
Why this helps
Monitoring setup gets postponed when each deployment requires a manual job definition step.
- Reduce manual monitoring setup
- Create a reusable monitoring definition
- Keep a record of the setup run
Setup
Build it in a few focused steps.
- 1Connect DataRobot once in the Notis portal.
- 2Create an automation in Automations, New Automation, and name it.
- 3Describe the monitoring definition to create and provide a valid deployment reference.
- 4Pick a recurring schedule trigger and choose a report channel.
- 5Test with one real deployment and review the created definition in DataRobot.
Questions about this workflow
Does creating a definition run monitoring predictions?
No. This action creates a monitoring job definition; a separate action starts a monitoring job.
Can it infer which deployment to monitor?
Provide a valid deployment reference in the instruction or available data.
When this happens · Trigger
Do this · Action
Supported Triggers and Actions
Notis builds workflows that link Agent mail to Datarobot. A trigger fires from one place; an action lands in another.
Agent mail triggers
Datarobot actions
Recurring trigger
Notis starts this workflow on a schedule, such as daily, weekly, or during business hours.
Add Users to Group
Tool to add one or more users to a DataRobot user group by groupId. Use when you have a valid groupId and want to add existing usernames. Limit 100 users per request.
Webhook trigger
Notis starts this workflow when an external tool or custom backend sends an HTTP request.
Add User to Organization
Tool to add a user to an existing organization. Use when you have an organizationId and wish to add or create a user within it.
New Email Received
Trigger for new emails in an AgentMail inbox
Analyze Dataset Definition
Tool to analyze a dataset definition by ID. Use when you need to trigger an analysis job that retrieves dataset metadata, schema, and statistics.
Archive Model Package
Tool to archive a DataRobot model package. Use when you need to archive a model package that is no longer actively used.
Build Java Scoring Code Package
Initiates an asynchronous build of a Java JAR package containing DataRobot Scoring Code for a deployment. The JAR can be executed locally for predictions or used as a library in Java applications. Use after confirming the deployment is active and supports scoring code. Poll the returned statusId or location URL to track build progress.
Cancel Notebook Job
Tool to cancel a running or pending notebook job execution. Use when you need to stop a notebook job that is currently executing or queued. The cancellation is immediate and cannot be undone.
Cancel Project Job
Tool to cancel a pending job for a project. Use when you need to stop a queued or running job after confirming its ID.
Check Project Status
Tool to check the status of a DataRobot project. Use after creating or loading a project to monitor its stage and Autopilot completion.
Connect any two apps with Notis in the middle.
Agent mail and Datarobot, or any other combination from 1,000+ integrations.
When this happens · Trigger
Do this · Action
Save your first hour today.
7-day trial of any paid plan, with 20$ of usage included.
No card. Works with personal or business Datarobot.