Skip to content
Notis

Set up a recurring deployment monitoring job

Define the monitoring run once so deployment checks have a consistent place in your routine.

Trigger

Recurring schedule

Notis starts this workflow on a schedule, such as daily, weekly, or during business hours.

Action

Create Batch Monitoring Job Definition

Tool to create a Batch Monitoring job definition for tracking deployment performance and data drift. Use when you need to set up scheduled or manual monitoring jobs for a DataRobot deployment.

Why this helps

Monitoring setup can be postponed when it lives as a separate administrative task after deployment.

  • Create a reusable monitoring job definition
  • Make deployment monitoring part of a recurring routine
  • Reduce the chance that setup gets lost after deployment

Setup

Build it in a few focused steps.

  • 1Connect DataRobot once in the Notis portal.
  • 2Create an automation in Automations, or tell Notis in plain language from any channel.
  • 3In one instruction, ask Notis to create a batch monitoring job definition for the specified deployment and monitoring needs.
  • 4Choose the recurring schedule trigger and where run reports should go.
  • 5Test with one real deployment and confirm the definition was created.

Questions about this workflow

Does this calculate monitoring results immediately?

This action creates a job definition for monitoring. Use the appropriate DataRobot job workflow to run monitoring when needed.

What if I do not know the deployment identifier?

Provide a valid deployment reference in your instruction or the information available to the automation. The action needs a deployment to create its definition.

When this happens · Trigger

Do this · Action

Supported Triggers and Actions

Notis builds workflows that link Ably to Datarobot. A trigger fires from one place; an action lands in another.

Ably triggers

Datarobot actions

Recurring trigger

Notis starts this workflow on a schedule, such as daily, weekly, or during business hours.

TriggerScheduled

Add Users to Group

Tool to add one or more users to a DataRobot user group by groupId. Use when you have a valid groupId and want to add existing usernames. Limit 100 users per request.

ActionInstant

Webhook trigger

Notis starts this workflow when an external tool or custom backend sends an HTTP request.

TriggerInstant

Add User to Organization

Tool to add a user to an existing organization. Use when you have an organizationId and wish to add or create a user within it.

ActionInstant

Analyze Dataset Definition

Tool to analyze a dataset definition by ID. Use when you need to trigger an analysis job that retrieves dataset metadata, schema, and statistics.

ActionInstant

Archive Model Package

Tool to archive a DataRobot model package. Use when you need to archive a model package that is no longer actively used.

ActionInstant

Build Java Scoring Code Package

Initiates an asynchronous build of a Java JAR package containing DataRobot Scoring Code for a deployment. The JAR can be executed locally for predictions or used as a library in Java applications. Use after confirming the deployment is active and supports scoring code. Poll the returned statusId or location URL to track build progress.

ActionInstant

Cancel Notebook Job

Tool to cancel a running or pending notebook job execution. Use when you need to stop a notebook job that is currently executing or queued. The cancellation is immediate and cannot be undone.

ActionInstant

Cancel Project Job

Tool to cancel a pending job for a project. Use when you need to stop a queued or running job after confirming its ID.

ActionInstant

Check Project Status

Tool to check the status of a DataRobot project. Use after creating or loading a project to monitor its stage and Autopilot completion.

ActionInstant

Connect any two apps with Notis in the middle.

Ably and Datarobot, or any other combination from 1,000+ integrations.

When this happens · Trigger

Do this · Action

Save your first hour today.

7-day trial of any paid plan, with 20$ of usage included.
No card. Works with personal or business Datarobot.