Set up recurring monitoring for batch predictions
Put a monitoring definition in place for a DataRobot deployment whose prediction data comes from your AnyDB workflow.
Trigger
Recurring schedule
Notis starts this workflow on a schedule, such as daily, weekly, or during business hours.
Action
Create Batch Monitoring Job Definition
Create a batch monitoring job definition for scheduled or manual deployment tracking.
Why this helps
Monitoring setup can fall behind when its configuration lives apart from the data preparation routine.
- Create a reusable monitoring job definition for a deployment.
- Keep setup details and the returned definition ID in a run report.
- Connect data preparation context with model monitoring operations.
Setup
Build it in a few focused steps.
- 1Connect AnyDB and DataRobot once in the Notis portal.
- 2Create an automation in Automations, New Automation, and name it for deployment monitoring setup.
- 3Tell Notis to create a DataRobot batch monitoring job definition using the supplied deployment and monitoring details, then report its ID.
- 4Pick a recurring schedule and choose where run reports go.
- 5Test with one real deployment and confirm the definition is created.
Questions about this workflow
Does this run monitoring every time the schedule fires?
This action creates a monitoring job definition. It does not launch a monitoring job; launching a job uses a separate DataRobot action.
Can Notis choose the deployment from AnyDB?
AnyDB trigger events are not listed here. Supply the deployment identifier and configuration details in the scheduled run context.
What does the job definition do?
It defines monitoring for a DataRobot deployment, including performance and data drift tracking. The exact monitoring options depend on the details available for the deployment.
When this happens · Trigger
Do this · Action
Supported Triggers and Actions
Notis builds workflows that link AnyDB to Datarobot. A trigger fires from one place; an action lands in another.
AnyDB triggers
Datarobot actions
Recurring trigger
Notis starts this workflow on a schedule, such as daily, weekly, or during business hours.
Add Users to Group
Add one or more existing users to a user group.
Webhook trigger
Notis starts this workflow when an external tool or custom backend sends an HTTP request.
Add User to Organization
Add a user to an existing organization.
Analyze Dataset Definition
Start an analysis job to retrieve a dataset’s metadata, schema and statistics.
Archive Model Package
Archive a model package that is no longer in active use.
Build Java Scoring Code Package
Start an asynchronous build of a Java JAR scoring package for a deployment.
Cancel Notebook Job
Immediately cancel a running or queued notebook job; this cannot be undone.
Cancel Project Job
Cancel a pending project job.
Check Project Status
Check a project’s status and progress.
Connect any two apps with Notis in the middle.
AnyDB and Datarobot, or any other combination from 1,000+ integrations.
When this happens · Trigger
Do this · Action
Save your first hour today.
7-day trial of any paid plan, with 20$ of usage included.
No card. Works with personal or business Datarobot.