Create a voice reviewer for Braintrust evaluation failures
Catch evaluation regressions while the context is still fresh. Start a dedicated voice assistant for the review your team needs.
Trigger
Webhook received
Notis starts this workflow when an external tool or custom backend sends an HTTP request.
Action
Create Assistant
Tool to create a new assistant. use when you need to initialize a custom voice assistant with specific prompt, llm, language, and voice settings.
Why this helps
Evaluation failures can disappear into dashboards while founders move between product, customers, and incident follow-up.
- Creates a dedicated voice assistant when a backend sends an evaluation failure alert.
- Helps the team start a consistent review without manually preparing the first call.
- Keeps failure follow-up distinct from routine customer conversations.
Setup
Build it in a few focused steps.
- 1Connect Braintrust and Synthflow ai to Notis once in the portal.
- 2Create an automation in the portal, or ask Notis to create it conversationally.
- 3In one plain-language instruction, tell Notis to create a Synthflow assistant for each evaluation failure webhook, using a focused review prompt and the failure context.
- 4Choose an incoming webhook trigger and a channel for run reports.
- 5Send one real failure example to the webhook and review the created assistant.
Questions about this workflow
Does Braintrust start this workflow directly?
No. Braintrust has no available integration trigger events here. A connected backend must send an HTTP request to the Notis webhook when it detects an evaluation failure.
What does the assistant do?
The workflow creates an assistant with the review prompt and settings described in your instruction. It does not itself run an evaluation or place a call.
When this happens · Trigger
Do this · Action
Supported Triggers and Actions
Notis builds workflows that link Braintrust to Synthflow ai. A trigger fires from one place; an action lands in another.
Braintrust triggers
Synthflow ai actions
Recurring trigger
Notis starts this workflow on a schedule, such as daily, weekly, or during business hours.
Create Assistant
Tool to create a new assistant. use when you need to initialize a custom voice assistant with specific prompt, llm, language, and voice settings.
Webhook trigger
Notis starts this workflow when an external tool or custom backend sends an HTTP request.
Delete an assistant
Tool to delete an existing ai assistant. use after confirming the assistant id. example: delete assistant with id 'assistant 123'.
Get AI assistant details
Tool to retrieve details of a specific ai assistant. use after confirming the assistant's id to fetch its configuration and metadata.
Get knowledge base
Tool to retrieve details of a specific knowledge base by its id. use after confirming the knowledge base id to fetch its metadata.
Get phone numbers
Tool to retrieve a list of phone numbers associated with a workspace. use when you need to fetch numbers assigned to your account for a given workspace.
Get team details
Tool to retrieve details of a specific team by its id. use after confirming the team exists to inspect its configuration.
List AI assistants
Tool to list all ai assistants associated with the account. use when you need to retrieve a paginated list of assistants.
Create a new team
Tool to create a new team. use when you need to programmatically set up a synthflow ai assistant group with routing rules.
Connect any two apps with Notis in the middle.
Braintrust and Synthflow ai, or any other combination from 1,000+ integrations.
When this happens · Trigger
Do this · Action
Save your first hour today.
7-day trial of any paid plan, with 20$ of usage included.
No card. Works with personal or business Synthflow ai.