Create Linear issues from Braintrust evaluation failures
Route a failed evaluation into Linear with enough context to investigate, without manually copying the result.
Trigger
Webhook received
Notis starts this workflow when an external tool or custom backend sends an HTTP request.
Action
Create linear issue
Creates a new issue in a specified linear project and team, requiring a title and description, and allowing for optional properties like assignee, state, priority, cycle, and due date.
Why this helps
Evaluation failures can disappear into dashboards while the team is busy shipping other work.
- Capture actionable evaluation failures in the team backlog.
- Keep the supplied evaluation details with the issue.
- Skip manual copying between Braintrust and Linear.
Setup
Build it in a few focused steps.
- 1Connect Braintrust and Linear once in Notis.
- 2Create an automation in Notis and describe the issue you want created for actionable failed evaluations.
- 3Choose the Notis webhook trigger and send it the Braintrust evaluation result.
- 4Choose where Notis should send run reports.
- 5Test with one real failed evaluation.
Questions about this workflow
Does this workflow run from a built-in Braintrust trigger?
No. Braintrust has no trigger events listed here. The automation starts when a request reaches its Notis webhook.
What should the webhook request include?
Send the evaluation result and the relevant context you want Notis to use, such as the failure details and the intended Linear team and project.
Will every failed evaluation create an issue?
Describe the criteria in the automation prompt. Notis can use only information included in the request or otherwise available to it.
When this happens · Trigger
Do this · Action
Supported Triggers and Actions
Notis builds workflows that link Braintrust to Linear. A trigger fires from one place; an action lands in another.
Braintrust triggers
Linear actions
Recurring trigger
Notis starts this workflow on a schedule, such as daily, weekly, or during business hours.
Create linear attachment
Creates a new attachment and associates it with a specific, existing linear issue.
Webhook trigger
Notis starts this workflow when an external tool or custom backend sends an HTTP request.
Create a comment
Creates a new comment on a specified linear issue.
Create linear issue
Creates a new issue in a specified linear project and team, requiring a title and description, and allowing for optional properties like assignee, state, priority, cycle, and due date.
Get create issue default params
Fetches a linear team's default issue estimate and state, useful for pre-filling new issue forms.
Create a label
Creates a new label in linear for a specified team, used to categorize and organize issues.
Delete issue
Archives an existing linear issue by its id, which is linear's standard way of deleting issues; the operation is idempotent.
Get all teams
Retrieves all teams from the linear workspace without requiring any parameters.
Download issue attachments
Downloads a specific attachment from a linear issue; the `file name` must include the correct file extension.
Connect any two apps with Notis in the middle.
Braintrust and Linear, or any other combination from 1,000+ integrations.
When this happens · Trigger
Do this · Action
Save your first hour today.
7-day trial of any paid plan, with 20$ of usage included.
No card. Works with personal or business Linear.