Respond to a risk concern with DataRobot batch monitoring
When a risk concern calls for a closer look at batch predictions, start a DataRobot monitoring job from its context.
Trigger
Webhook received
Notis starts this workflow when an external tool or custom backend sends an HTTP request.
Action
Create Batch Monitoring Job
Tool to create a DataRobot Batch Monitoring job for tracking model performance and data drift on batch predictions. Use when you need to monitor predictions at scale. The job is created asynchronously and returns immediately with a job ID.
Why this helps
A concern about model behavior can sit unresolved while someone manually starts the monitoring work.
- Move from a risk concern to a monitoring job request quickly.
- Keep the deployment context attached to the monitoring action.
- Reduce manual steps during investigation.
Setup
Build it in a few focused steps.
- 1Connect 21risk and DataRobot once in the Notis portal.
- 2Create an automation in Automations, New Automation, and name it for risk concern monitoring.
- 3Tell Notis to create a DataRobot batch monitoring job for the deployment and context included in the 21risk concern.
- 4Choose a webhook trigger and choose where run reports should go.
- 5Test with one real concern and a valid deployment identifier.
Questions about this workflow
What does this action create?
It creates a DataRobot batch monitoring job for tracking performance and data drift on batch predictions. The job is created asynchronously.
What details are needed?
Provide the relevant deployment and any job details required by your DataRobot setup. Do not assume 21risk provides monitoring baselines unless they are included.
When this happens · Trigger
Do this · Action
Supported Triggers and Actions
Notis builds workflows that link 21risk to Datarobot. A trigger fires from one place; an action lands in another.
21risk triggers
Datarobot actions
Recurring trigger
Notis starts this workflow on a schedule, such as daily, weekly, or during business hours.
Add Users to Group
Tool to add one or more users to a DataRobot user group by groupId. Use when you have a valid groupId and want to add existing usernames. Limit 100 users per request.
Webhook trigger
Notis starts this workflow when an external tool or custom backend sends an HTTP request.
Add User to Organization
Tool to add a user to an existing organization. Use when you have an organizationId and wish to add or create a user within it.
Analyze Dataset Definition
Tool to analyze a dataset definition by ID. Use when you need to trigger an analysis job that retrieves dataset metadata, schema, and statistics.
Archive Model Package
Tool to archive a DataRobot model package. Use when you need to archive a model package that is no longer actively used.
Build Java Scoring Code Package
Initiates an asynchronous build of a Java JAR package containing DataRobot Scoring Code for a deployment. The JAR can be executed locally for predictions or used as a library in Java applications. Use after confirming the deployment is active and supports scoring code. Poll the returned statusId or location URL to track build progress.
Cancel Notebook Job
Tool to cancel a running or pending notebook job execution. Use when you need to stop a notebook job that is currently executing or queued. The cancellation is immediate and cannot be undone.
Cancel Project Job
Tool to cancel a pending job for a project. Use when you need to stop a queued or running job after confirming its ID.
Check Project Status
Tool to check the status of a DataRobot project. Use after creating or loading a project to monitor its stage and Autopilot completion.
Connect any two apps with Notis in the middle.
21risk and Datarobot, or any other combination from 1,000+ integrations.
When this happens · Trigger
Do this · Action
Save your first hour today.
7-day trial of any paid plan, with 20$ of usage included.
No card. Works with personal or business Datarobot.