Send Braintrust evaluation failures to WhatsApp
Get critical evaluation failures in the chat you already monitor.
Trigger
Webhook received
Notis starts this workflow when an external tool or custom backend sends an HTTP request.
Action
Send message
Send a text message to a whatsapp number. note: the message will reflect on the recipient's phone number only if they have texted first.
Why this helps
Evaluation regressions can sit unnoticed while teams wait for someone to check Braintrust.
- Reduce time to detect model regressions
- Keep incident context in one chat
- Prompt a fast owner response
Setup
Build it in a few focused steps.
- 1Connect Braintrust and Whatsapp in Notis once.
- 2Create a new automation and name it for evaluation failure alerts.
- 3Tell Notis to summarize each failed Braintrust evaluation and send the key details to the specified WhatsApp number.
- 4Choose the notis_webhook trigger and provide the Braintrust result payload endpoint.
- 5Choose a report channel, then test with one real failed evaluation payload.
Questions about this workflow
What should the webhook contain?
Include the evaluation name, status, score or threshold result, and any error summary available from Braintrust.
Can this send outside the WhatsApp 24-hour window?
Use a template message action when the recipient has not recently started a conversation.
When this happens · Trigger
Do this · Action
Supported Triggers and Actions
Notis builds workflows that link Braintrust to Whatsapp. A trigger fires from one place; an action lands in another.
Braintrust triggers
Whatsapp actions
Recurring trigger
Notis starts this workflow on a schedule, such as daily, weekly, or during business hours.
Create message template
Create a new message template for the whatsapp business account. templates must be approved by whatsapp before they can be used. templates are required for marketing messages and messages sent outside the 24-hour window.
Webhook trigger
Notis starts this workflow when an external tool or custom backend sends an HTTP request.
Delete message template
Delete a message template from the whatsapp business account. this permanently removes the template and it cannot be recovered. only delete templates that are no longer needed.
Get business profile
Get the business profile information for a whatsapp business phone number. this includes business details like description, address, website, and contact info.
Get media
Get information about uploaded media including a temporary download url. the download url is valid for 5 minutes and can be used to retrieve the actual media file. this is useful for downloading media that was sent to your whatsapp number.
Get media info
Get metadata about uploaded media without generating a download url. this is useful for checking file size, type, and hash without downloading the file. use get media if you need the actual download url.
Get message templates
Get all message templates for the whatsapp business account. templates are required for sending messages outside the 24-hour window and for marketing/utility messages.
Get phone number
Get details of a specific phone number associated with a whatsapp business account.
Get phone numbers
Get all phone numbers associated with a whatsapp business account (waba).
Connect any two apps with Notis in the middle.
Braintrust and Whatsapp, or any other combination from 1,000+ integrations.
When this happens · Trigger
Do this · Action
Save your first hour today.
7-day trial of any paid plan, with 20$ of usage included.
No card. Works with personal or business Whatsapp.