Investigate data disparity for a model feature
Start a disparity insight calculation from a project review request and keep its asynchronous status visible.
Trigger
Webhook received
Notis starts this workflow when an external tool or custom backend sends an HTTP request.
Action
Create Data Disparity Insights
Start an asynchronous calculation of data disparities between two classes for a feature.
Why this helps
A requested model review can be delayed when analysis setup is separated from the project follow-up that prompted it.
- Initiate a specified disparity insight calculation.
- Keep model review work connected to its project request.
- Track the asynchronous analysis through its returned status.
Setup
Build it in a few focused steps.
- 1Connect Agiled and DataRobot once in the Notis portal.
- 2Create an automation in Automations, New Automation, or tell Notis the outcome in plain language.
- 3Ask Notis to calculate data disparity insights for the specified model, feature, and class comparison.
- 4Choose the webhook trigger and where run reports should go.
- 5Test with a real model and feature.
Questions about this workflow
Does this provide a full model fairness assessment?
It starts data disparity insight calculations for a specified feature and class comparison. Interpret results in the context of your review.
What details are needed?
Provide the model, feature, and class comparison required by the analysis.
When this happens · Trigger
Do this · Action
Supported Triggers and Actions
Notis builds workflows that link Agiled to Datarobot. A trigger fires from one place; an action lands in another.
Agiled triggers
Datarobot actions
Recurring trigger
Notis starts this workflow on a schedule, such as daily, weekly, or during business hours.
Add Users to Group
Add one or more existing users to a user group.
Webhook trigger
Notis starts this workflow when an external tool or custom backend sends an HTTP request.
Add User to Organization
Add a user to an existing organization.
Analyze Dataset Definition
Start an analysis job to retrieve a dataset’s metadata, schema and statistics.
Archive Model Package
Archive a model package that is no longer in active use.
Build Java Scoring Code Package
Start an asynchronous build of a Java JAR scoring package for a deployment.
Cancel Notebook Job
Immediately cancel a running or queued notebook job; this cannot be undone.
Cancel Project Job
Cancel a pending project job.
Check Project Status
Check a project’s status and progress.
Connect any two apps with Notis in the middle.
Agiled and Datarobot, or any other combination from 1,000+ integrations.
When this happens · Trigger
Do this · Action
Save your first hour today.
7-day trial of any paid plan, with 20$ of usage included.
No card. Works with personal or business Datarobot.