Send Braintrust evaluation failures to Telegram
Get a Telegram heads-up when a Braintrust evaluation fails, with the details your webhook provides and a clear next step for review.
Trigger
Webhook received
Notis starts this workflow when an external tool or custom backend sends an HTTP request.
Action
Send Message
Send a text message to a telegram chat using the bot api.
Why this helps
Evaluation failures can sit unnoticed in a dashboard while the team is busy elsewhere.
- See failed evaluations in a chat you already check.
- Include only run details supplied with the webhook.
- Reduce manual dashboard checks after a failure.
Setup
Build it in a few focused steps.
- 1Connect Braintrust and Telegram to Notis once.
- 2Create an automation in Notis and give it a clear name.
- 3Tell Notis to send a concise Telegram alert when the webhook reports a failed Braintrust evaluation, using only details in the request.
- 4Choose the webhook trigger and select where run reports should go.
- 5Test with one real failed evaluation request.
Questions about this workflow
Does Braintrust provide the trigger for this workflow?
No Braintrust trigger event is listed here. A Notis webhook starts the automation when an HTTP request is sent to it.
What evaluation details will appear in Telegram?
Notis can include details present in the webhook request. Supply any run name, score, or link you want included.
Can the automation identify failures on its own?
It can act on failure information included in the request. The workflow cannot infer missing evaluation data.
When this happens · Trigger
Do this · Action
Supported Triggers and Actions
Notis builds workflows that link Braintrust to Telegram. A trigger fires from one place; an action lands in another.
Braintrust triggers
Telegram actions
Recurring trigger
Notis starts this workflow on a schedule, such as daily, weekly, or during business hours.
Answer Callback Query
Use this method to send answers to callback queries sent from inline keyboards. the answer will be displayed to the user as a notification at the top of the chat screen or as an alert.
Webhook trigger
Notis starts this workflow when an external tool or custom backend sends an HTTP request.
Delete Message
Delete a message, including service messages, with certain limitations.
Edit Message
Edit text messages sent by the bot.
Export Chat Invite Link
Generate a new primary invite link for a chat; any previously generated primary link is revoked. the bot must be an administrator in the chat for this to work and must have the appropriate administrator rights.
Forward Message
Forward messages of any kind. service messages can't be forwarded.
Get Chat Info
Get up to date information about the chat (current name of the user for one-on-one conversations, current username of a user, group or channel, etc.).
Get Chat Administrators
Get a list of administrators in a chat. on success, returns an array of chatmember objects that contains information about all chat administrators except other bots.
Get Chat History
Get chat history messages. note: this uses the getupdates method with specific parameters to retrieve historical messages.
Connect any two apps with Notis in the middle.
Braintrust and Telegram, or any other combination from 1,000+ integrations.
When this happens · Trigger
Do this · Action
Save your first hour today.
7-day trial of any paid plan, with 20$ of usage included.
No card. Works with personal or business Telegram.