Keep batch scoring performance in view
When a deal scoring workflow needs monitoring, send the relevant DataRobot context and let Notis start a batch monitoring job.
Trigger
Webhook received
Notis starts this workflow when an external tool or custom backend sends an HTTP request.
Action
Create Batch Monitoring Job
Create an asynchronous batch monitoring job to track model performance and data drift.
Why this helps
Batch scoring can continue at scale without an easy reminder to check performance and data drift.
- Start monitoring for batch predictions at scale.
- Tie the monitoring request to its deal scoring use.
- Reduce the chance that monitoring setup gets postponed.
Setup
Build it in a few focused steps.
- 1Connect Affinity and DataRobot once in the Notis portal.
- 2Create an automation and describe the batch monitoring job to start for the supplied deployment.
- 3Choose notis_webhook as the trigger and include valid monitoring configuration details.
- 4Choose where run reports should go.
- 5Test with one supported deployment and monitoring setup.
Questions about this workflow
What does this monitor?
The action creates a DataRobot Batch Monitoring job for model performance and data drift on batch predictions.
Does this define a recurring schedule?
This action creates a monitoring job. A separate job definition action is available for setting up scheduled or manual monitoring.
What should the request include?
Include the valid deployment and monitoring configuration required by your DataRobot environment.
When this happens · Trigger
Do this · Action
Supported Triggers and Actions
Notis builds workflows that link Affinity to Datarobot. A trigger fires from one place; an action lands in another.
Affinity triggers
Datarobot actions
Recurring trigger
Notis starts this workflow on a schedule, such as daily, weekly, or during business hours.
Add Users to Group
Add one or more existing users to a user group.
Webhook trigger
Notis starts this workflow when an external tool or custom backend sends an HTTP request.
Add User to Organization
Add a user to an existing organization.
Analyze Dataset Definition
Start an analysis job to retrieve a dataset’s metadata, schema and statistics.
Archive Model Package
Archive a model package that is no longer in active use.
Build Java Scoring Code Package
Start an asynchronous build of a Java JAR scoring package for a deployment.
Cancel Notebook Job
Immediately cancel a running or queued notebook job; this cannot be undone.
Cancel Project Job
Cancel a pending project job.
Check Project Status
Check a project’s status and progress.
Connect any two apps with Notis in the middle.
Affinity and Datarobot, or any other combination from 1,000+ integrations.
When this happens · Trigger
Do this · Action
Save your first hour today.
7-day trial of any paid plan, with 20$ of usage included.
No card. Works with personal or business Datarobot.