Keep batch model monitoring on a schedule
Set a steady monitoring rhythm for a deployment without relying on someone to remember the next run.
Trigger
Recurring schedule
Notis starts this workflow on a schedule, such as daily, weekly, or during business hours.
Action
Create Batch Monitoring Job
Tool to create a DataRobot Batch Monitoring job for tracking model performance and data drift on batch predictions. Use when you need to monitor predictions at scale. The job is created asynchronously and returns immediately with a job ID.
Why this helps
Batch monitoring gets delayed when it depends on a busy person remembering to start each job.
- Create a predictable monitoring cadence.
- Reduce manual reminders to start monitoring jobs.
- Keep monitoring runs visible through Notis reports.
Setup
Build it in a few focused steps.
- 1Connect DataRobot in the Notis portal.
- 2Create an automation in Automations, New Automation, and give it a clear name.
- 3Tell Notis to create a batch monitoring job for the specified deployment and report the job ID and result.
- 4Pick a recurring schedule and choose where run reports should go.
- 5Test with one real monitoring job and confirm its status in DataRobot.
Questions about this workflow
What needs to be specified?
Identify the DataRobot deployment and the monitoring job details needed for your use case in the instruction.
Does creating the job finish monitoring immediately?
The job is created asynchronously and returns a job ID. Check DataRobot for its status and results.
When this happens · Trigger
Do this · Action
Supported Triggers and Actions
Notis builds workflows that link Google Drive to Datarobot. A trigger fires from one place; an action lands in another.
Google Drive triggers
Datarobot actions
Recurring trigger
Notis starts this workflow on a schedule, such as daily, weekly, or during business hours.
Add Users to Group
Tool to add one or more users to a DataRobot user group by groupId. Use when you have a valid groupId and want to add existing usernames. Limit 100 users per request.
Webhook trigger
Notis starts this workflow when an external tool or custom backend sends an HTTP request.
Add User to Organization
Tool to add a user to an existing organization. Use when you have an organizationId and wish to add or create a user within it.
Comment Added (Docs/Sheets/Slides)
Triggers when a new comment is added to Google Docs, Sheets, or Slides.
Analyze Dataset Definition
Tool to analyze a dataset definition by ID. Use when you need to trigger an analysis job that retrieves dataset metadata, schema, and statistics.
File Created
Triggers when a new file is created in Google Drive.
Archive Model Package
Tool to archive a DataRobot model package. Use when you need to archive a model package that is no longer actively used.
File Deleted or Trashed
Triggers when a file is moved to trash or permanently deleted in Drive.
Build Java Scoring Code Package
Initiates an asynchronous build of a Java JAR package containing DataRobot Scoring Code for a deployment. The JAR can be executed locally for predictions or used as a library in Java applications. Use after confirming the deployment is active and supports scoring code. Poll the returned statusId or location URL to track build progress.
File Shared (Permissions Added)
Triggers when new sharing permissions are granted to a file or folder. Uses Drive's `changes.list` endpoint with inline `permissions` in the `fields` mask so each change carries the file's current permission set provider-atomically. We diff that against `seen_permission_keys` to identify newly added grants. Drive page tokens are the primary cursor; if Drive rejects a stored token, the trigger raises `PollingTriggerError` without clearing state rather than silently re-baselining and dropping events. Limitation: truly ephemeral permissions (added and revoked between two polls without any other file modification in between) are not detected. Drive Activity API would catch those but requires an additional OAuth scope and a different payload contract.
Cancel Notebook Job
Tool to cancel a running or pending notebook job execution. Use when you need to stop a notebook job that is currently executing or queued. The cancellation is immediate and cannot be undone.
File Updated
Triggers when a file's metadata or content changes in Google Drive.
Cancel Project Job
Tool to cancel a pending job for a project. Use when you need to stop a queued or running job after confirming its ID.
Google Drive Changes
Triggers when changes are detected in a Google Drive.
Check Project Status
Tool to check the status of a DataRobot project. Use after creating or loading a project to monitor its stage and Autopilot completion.
Connect any two apps with Notis in the middle.
Google Drive and Datarobot, or any other combination from 1,000+ integrations.
When this happens · Trigger
Do this · Action
Save your first hour today.
7-day trial of any paid plan, with 20$ of usage included.
No card. Works with personal or business Datarobot.