Keep campaign prediction performance visible
Create recurring monitoring jobs for the DataRobot deployments behind your ActiveTrail audience scoring.
Trigger
Recurring schedule
Notis starts this workflow on a schedule, such as daily, weekly, or during business hours.
Action
Create Batch Monitoring Job
Create an asynchronous batch monitoring job to track model performance and data drift.
Why this helps
Model monitoring can slip when campaign data moves through a separate email workflow.
- Create batch monitoring jobs on a recurring schedule.
- Keep attention on performance and data drift for selected deployments.
- Receive run reports through the Notis channel you choose.
Setup
Build it in a few focused steps.
- 1Connect ActiveTrail and DataRobot once in the Notis portal.
- 2Create an automation and describe which configured deployments should receive monitoring jobs.
- 3Choose a recurring schedule and where Notis should send run reports.
- 4Provide the deployment and monitoring inputs required by your DataRobot setup.
- 5Test with one real deployment and review the created job details.
Questions about this workflow
Does this workflow monitor every ActiveTrail campaign automatically?
No. It creates DataRobot batch monitoring jobs for deployments you identify. The workflow needs the relevant DataRobot deployment details and monitoring inputs.
What schedule can I use?
Choose a recurring schedule in Notis, such as daily or weekly, that suits your monitoring routine.
When this happens · Trigger
Do this · Action
Supported Triggers and Actions
Notis builds workflows that link ActiveTrail to Datarobot. A trigger fires from one place; an action lands in another.
ActiveTrail triggers
Datarobot actions
Recurring trigger
Notis starts this workflow on a schedule, such as daily, weekly, or during business hours.
Add Users to Group
Add one or more existing users to a user group.
Webhook trigger
Notis starts this workflow when an external tool or custom backend sends an HTTP request.
Add User to Organization
Add a user to an existing organization.
Analyze Dataset Definition
Start an analysis job to retrieve a dataset’s metadata, schema and statistics.
Archive Model Package
Archive a model package that is no longer in active use.
Build Java Scoring Code Package
Start an asynchronous build of a Java JAR scoring package for a deployment.
Cancel Notebook Job
Immediately cancel a running or queued notebook job; this cannot be undone.
Cancel Project Job
Cancel a pending project job.
Check Project Status
Check a project’s status and progress.
Connect any two apps with Notis in the middle.
ActiveTrail and Datarobot, or any other combination from 1,000+ integrations.
When this happens · Trigger
Do this · Action
Save your first hour today.
7-day trial of any paid plan, with 20$ of usage included.
No card. Works with personal or business Datarobot.