Set up model monitoring at report time
Let a completed reporting cycle kick off the setup for monitoring an existing DataRobot deployment.
Trigger
Webhook received
Notis starts this workflow when an external tool or custom backend sends an HTTP request.
Action
Create Batch Monitoring Job Definition
Create a batch monitoring job definition for scheduled or manual deployment tracking.
Why this helps
Monitoring setup can get lost after a report is generated and before anyone returns to the deployment.
- Connect report-cycle handoffs to monitoring setup.
- Create a reusable monitoring job definition for an existing deployment.
- Reduce the chance that a monitoring task gets lost.
Setup
Build it in a few focused steps.
- 1Connect ActiveMerge and DataRobot once in Notis.
- 2Create an automation and describe the existing deployment and monitoring definition to create when the reporting cycle is ready.
- 3Pick the Notis webhook trigger and have the external workflow call it at the appropriate handoff.
- 4Choose where run reports should be delivered.
- 5Test with one real reporting-cycle signal and deployment.
Questions about this workflow
Does this run a monitoring job immediately?
No. It creates a batch monitoring job definition. A separate launch or schedule is needed to run monitoring.
What information is required?
The workflow needs a valid existing DataRobot deployment and the settings required for its monitoring definition.
When this happens · Trigger
Do this · Action
Supported Triggers and Actions
Notis builds workflows that link ActiveMerge to Datarobot. A trigger fires from one place; an action lands in another.
ActiveMerge triggers
Datarobot actions
Recurring trigger
Notis starts this workflow on a schedule, such as daily, weekly, or during business hours.
Add Users to Group
Add one or more existing users to a user group.
Webhook trigger
Notis starts this workflow when an external tool or custom backend sends an HTTP request.
Add User to Organization
Add a user to an existing organization.
Analyze Dataset Definition
Start an analysis job to retrieve a dataset’s metadata, schema and statistics.
Archive Model Package
Archive a model package that is no longer in active use.
Build Java Scoring Code Package
Start an asynchronous build of a Java JAR scoring package for a deployment.
Cancel Notebook Job
Immediately cancel a running or queued notebook job; this cannot be undone.
Cancel Project Job
Cancel a pending project job.
Check Project Status
Check a project’s status and progress.
Connect any two apps with Notis in the middle.
ActiveMerge and Datarobot, or any other combination from 1,000+ integrations.
When this happens · Trigger
Do this · Action
Save your first hour today.
7-day trial of any paid plan, with 20$ of usage included.
No card. Works with personal or business Datarobot.