Turn Arize AX experiment regressions into Jira work
Make a repeatable review of experiment results and give meaningful regressions an ownerable home.
Trigger
Recurring schedule
Notis starts this workflow on a schedule, such as daily, weekly, or during business hours.
Action
Create Issue
Creates a new jira issue (e.g., bug, task, story) in a specified project.
Why this helps
Experiment comparisons can surface regressions that are easy to overlook when results are reviewed inconsistently.
- Create follow-up issues for regressions that meet your criteria.
- Use one consistent review instruction on each run.
- Keep regression work visible in Jira.
Setup
Build it in a few focused steps.
- 1Connect Arize AX and Jira once in the Notis portal.
- 2Create an automation in Automations, New Automation, and give it a name.
- 3Tell Notis which experiment results to review, what baseline and regression threshold to use, and to create Jira issues for qualifying results.
- 4Pick a recurring schedule and choose where run reports should go.
- 5Test with one real experiment comparison and confirm the baseline is supplied.
Questions about this workflow
Can Notis determine a regression without a baseline?
No. Supply the baseline and the criteria for a regression in your instruction or available data.
What if no experiment results are available at run time?
Notis can report that no qualifying results were available. It should not create an issue based on missing data.
When this happens · Trigger
Do this · Action
Supported Triggers and Actions
Notis builds workflows that link Arize AX to Jira. A trigger fires from one place; an action lands in another.
Arize AX triggers
Jira actions
Recurring trigger
Notis starts this workflow on a schedule, such as daily, weekly, or during business hours.
Add Attachment
Uploads and attaches a file to a jira issue.
Webhook trigger
Notis starts this workflow when an external tool or custom backend sends an HTTP request.
Add Comment
Adds a comment using atlassian document format (adf) for rich text to an existing jira issue.
Add Watcher to Issue
Adds a user to an issue's watcher list by account id.
Assign Issue
Assigns a jira issue to a user, default assignee, or unassigns; supports email/name lookup.
Bulk Create Issues
Creates multiple jira issues (up to 50 per call) with full feature support including markdown, assignee resolution, and priority handling.
Create Issue
Creates a new jira issue (e.g., bug, task, story) in a specified project.
Link Issues
Links two jira issues using a specified link type with optional comment.
Create Project
Creates a new jira project with required lead, template, and type configuration.
Connect any two apps with Notis in the middle.
Arize AX and Jira, or any other combination from 1,000+ integrations.
When this happens · Trigger
Do this · Action
Save your first hour today.
7-day trial of any paid plan, with 20$ of usage included.
No card. Works with personal or business Jira.