Run batch monitoring on a recurring schedule
Make batch monitoring a repeatable scheduled task, with reports delivered where you already work.
Trigger
Recurring schedule
Notis starts this workflow on a schedule, such as daily, weekly, or during business hours.
Action
Create Batch Monitoring Job
Tool to create a DataRobot Batch Monitoring job for tracking model performance and data drift on batch predictions. Use when you need to monitor predictions at scale. The job is created asynchronously and returns immediately with a job ID.
Why this helps
Batch monitoring can slip when each run requires someone to remember to start it by hand.
- Reduce manual steps for recurring monitoring runs
- Use DataRobot to track batch prediction performance and drift
- Keep outcomes visible through Notis run reports
Setup
Build it in a few focused steps.
- 1Connect DataRobot once in the Notis portal.
- 2Create an automation in Automations, or tell Notis in plain language from any channel.
- 3In one instruction, ask Notis to create a batch monitoring job for the specified deployment and monitoring inputs.
- 4Choose the recurring schedule trigger and where run reports should go.
- 5Test with one real example and review the returned job information.
Questions about this workflow
Is this the same as creating a monitoring job definition?
No. This action creates a batch monitoring job to track performance and drift. A separate action creates a reusable job definition.
Does the job complete during the automation run?
The job is created asynchronously and returns a job ID. The run report can include the returned job information.
When this happens · Trigger
Do this · Action
Supported Triggers and Actions
Notis builds workflows that link Ably to Datarobot. A trigger fires from one place; an action lands in another.
Ably triggers
Datarobot actions
Recurring trigger
Notis starts this workflow on a schedule, such as daily, weekly, or during business hours.
Add Users to Group
Tool to add one or more users to a DataRobot user group by groupId. Use when you have a valid groupId and want to add existing usernames. Limit 100 users per request.
Webhook trigger
Notis starts this workflow when an external tool or custom backend sends an HTTP request.
Add User to Organization
Tool to add a user to an existing organization. Use when you have an organizationId and wish to add or create a user within it.
Analyze Dataset Definition
Tool to analyze a dataset definition by ID. Use when you need to trigger an analysis job that retrieves dataset metadata, schema, and statistics.
Archive Model Package
Tool to archive a DataRobot model package. Use when you need to archive a model package that is no longer actively used.
Build Java Scoring Code Package
Initiates an asynchronous build of a Java JAR package containing DataRobot Scoring Code for a deployment. The JAR can be executed locally for predictions or used as a library in Java applications. Use after confirming the deployment is active and supports scoring code. Poll the returned statusId or location URL to track build progress.
Cancel Notebook Job
Tool to cancel a running or pending notebook job execution. Use when you need to stop a notebook job that is currently executing or queued. The cancellation is immediate and cannot be undone.
Cancel Project Job
Tool to cancel a pending job for a project. Use when you need to stop a queued or running job after confirming its ID.
Check Project Status
Tool to check the status of a DataRobot project. Use after creating or loading a project to monitor its stage and Autopilot completion.
Connect any two apps with Notis in the middle.
Ably and Datarobot, or any other combination from 1,000+ integrations.
When this happens · Trigger
Do this · Action
Save your first hour today.
7-day trial of any paid plan, with 20$ of usage included.
No card. Works with personal or business Datarobot.