Catch AI benchmark regressions before they become surprises
Send a benchmark update to Notis and get a clear Linear issue when a model or provider you depend on slips.
Trigger
Webhook received
Notis starts this workflow when an external tool or custom backend sends an HTTP request.
Action
Create linear issue
Creates a new issue in a specified linear project and team, requiring a title and description, and allowing for optional properties like assignee, state, priority, cycle, and due date.
Why this helps
Benchmark changes can be easy to miss until they affect a product decision or launch.
- Turn a reported regression into an actionable issue.
- Include the affected model, benchmark, and supplied comparison data in the issue.
- Keep investigation work in Linear instead of scattered notes.
Setup
Build it in a few focused steps.
- 1Connect Artificial Analysis and Linear once in Notis.
- 2Create an automation in the portal or tell Notis to create one in plain language.
- 3In one instruction, say which models or providers to watch and what counts as a meaningful regression.
- 4Choose the webhook trigger and where run reports should go.
- 5Test with one real benchmark update and review the resulting issue.
Questions about this workflow
What starts this workflow?
A webhook request starts it. Send a real Artificial Analysis update or relevant benchmark data to the automation.
Can Notis decide what counts as a regression?
Yes. State the benchmark, model or provider, and comparison threshold in your instruction. If the update lacks a prior value or baseline, supply that comparison data.
When this happens · Trigger
Do this · Action
Supported Triggers and Actions
Notis builds workflows that link Artificial Analysis to Linear. A trigger fires from one place; an action lands in another.
Artificial Analysis triggers
Linear actions
Recurring trigger
Notis starts this workflow on a schedule, such as daily, weekly, or during business hours.
Create linear attachment
Creates a new attachment and associates it with a specific, existing linear issue.
Webhook trigger
Notis starts this workflow when an external tool or custom backend sends an HTTP request.
Create a comment
Creates a new comment on a specified linear issue.
Create linear issue
Creates a new issue in a specified linear project and team, requiring a title and description, and allowing for optional properties like assignee, state, priority, cycle, and due date.
Get create issue default params
Fetches a linear team's default issue estimate and state, useful for pre-filling new issue forms.
Create a label
Creates a new label in linear for a specified team, used to categorize and organize issues.
Delete issue
Archives an existing linear issue by its id, which is linear's standard way of deleting issues; the operation is idempotent.
Get all teams
Retrieves all teams from the linear workspace without requiring any parameters.
Download issue attachments
Downloads a specific attachment from a linear issue; the `file name` must include the correct file extension.
Connect any two apps with Notis in the middle.
Artificial Analysis and Linear, or any other combination from 1,000+ integrations.
When this happens · Trigger
Do this · Action
Save your first hour today.
7-day trial of any paid plan, with 20$ of usage included.
No card. Works with personal or business Linear.