Start a deployment monitoring run
When a monitoring run is due, let a webhook start the job and put the result in your report channel. Supply the deployment and batch monitoring context in the prompt.
Trigger
Webhook received
Notis starts this workflow when an external tool or custom backend sends an HTTP request.
Action
Create Batch Monitoring Job
Create an asynchronous batch monitoring job to track model performance and data drift.
Why this helps
A monitoring request can slip when you have to switch tools and assemble the deployment context by hand.
- Start monitoring for performance and data drift at scale.
- Keep deployment context close to the job request.
- Get a report for an asynchronous monitoring job.
Setup
Build it in a few focused steps.
- 1Connect AgentQL and DataRobot once in the Notis portal.
- 2Create an automation in Automations, New Automation, and supply its name and prompt.
- 3In one instruction, ask Notis to create a batch monitoring job for the deployment and monitoring inputs you provide.
- 4Pick the Notis webhook trigger and choose where run reports should go.
- 5Test with a real deployment and review the returned job ID in the report.
Questions about this workflow
Is the monitoring job created synchronously?
No. The action creates the job asynchronously and returns a job ID.
What can it monitor?
It tracks model performance and data drift on batch predictions at scale. Provide the correct deployment context.
Can the automation monitor any deployment without details?
No. Include a valid deployment and the inputs DataRobot needs to create the job.
When this happens · Trigger
Do this · Action
Supported Triggers and Actions
Notis builds workflows that link Agentql to Datarobot. A trigger fires from one place; an action lands in another.
Agentql triggers
Datarobot actions
Recurring trigger
Notis starts this workflow on a schedule, such as daily, weekly, or during business hours.
Add Users to Group
Add one or more existing users to a user group.
Webhook trigger
Notis starts this workflow when an external tool or custom backend sends an HTTP request.
Add User to Organization
Add a user to an existing organization.
Analyze Dataset Definition
Start an analysis job to retrieve a dataset’s metadata, schema and statistics.
Archive Model Package
Archive a model package that is no longer in active use.
Build Java Scoring Code Package
Start an asynchronous build of a Java JAR scoring package for a deployment.
Cancel Notebook Job
Immediately cancel a running or queued notebook job; this cannot be undone.
Cancel Project Job
Cancel a pending project job.
Check Project Status
Check a project’s status and progress.
Connect any two apps with Notis in the middle.
Agentql and Datarobot, or any other combination from 1,000+ integrations.
When this happens · Trigger
Do this · Action
Save your first hour today.
7-day trial of any paid plan, with 20$ of usage included.
No card. Works with personal or business Datarobot.