Start monitoring when campaign predictions are ready
Turn a ready-to-review prediction batch into a DataRobot monitoring job with one webhook request.
Trigger
Webhook received
Notis starts this workflow when an external tool or custom backend sends an HTTP request.
Action
Create Batch Monitoring Job
Create an asynchronous batch monitoring job to track model performance and data drift.
Why this helps
Prediction batches can be scored and then forgotten while nobody remembers to start monitoring them.
- Start a monitoring job when prediction inputs are ready.
- Reduce the manual handoff between scoring and monitoring.
- Get a run report for the asynchronous monitoring job.
Setup
Build it in a few focused steps.
- 1Connect AimTell and DataRobot once in Notis.
- 2Create an automation in Notis and describe when to start the monitoring job in one instruction.
- 3Choose the webhook trigger for ready prediction data.
- 4Choose where Notis should send run reports.
- 5Test with one real deployment and prediction batch, then check the job status in DataRobot.
Questions about this workflow
Does this action create a recurring monitoring schedule?
No. It starts one asynchronous batch monitoring job. Use a job definition for a reusable scheduled or manual setup.
What should be ready before sending the webhook?
Have a valid DataRobot deployment and the prediction data or monitoring inputs required by your configuration.
Where can I see whether the job finished?
Check the returned job ID and status in DataRobot; the job is asynchronous.
When this happens · Trigger
Do this · Action
Supported Triggers and Actions
Notis builds workflows that link AimTell to Datarobot. A trigger fires from one place; an action lands in another.
AimTell triggers
Datarobot actions
Recurring trigger
Notis starts this workflow on a schedule, such as daily, weekly, or during business hours.
Add Users to Group
Add one or more existing users to a user group.
Webhook trigger
Notis starts this workflow when an external tool or custom backend sends an HTTP request.
Add User to Organization
Add a user to an existing organization.
Analyze Dataset Definition
Start an analysis job to retrieve a dataset’s metadata, schema and statistics.
Archive Model Package
Archive a model package that is no longer in active use.
Build Java Scoring Code Package
Start an asynchronous build of a Java JAR scoring package for a deployment.
Cancel Notebook Job
Immediately cancel a running or queued notebook job; this cannot be undone.
Cancel Project Job
Cancel a pending project job.
Check Project Status
Check a project’s status and progress.
Connect any two apps with Notis in the middle.
AimTell and Datarobot, or any other combination from 1,000+ integrations.
When this happens · Trigger
Do this · Action
Save your first hour today.
7-day trial of any paid plan, with 20$ of usage included.
No card. Works with personal or business Datarobot.