Bring channel feedback into evaluation
Keep user reports and observations from your Telegram channel available for focused model evaluation.
Trigger
New Channel Post
Triggered when a new post is published to a channel where your bot is an administrator.
Action
Add datapoints to dataset
Tool to add datapoints to a dataset. Use when you need to append multiple entries with specified input, ground truth, and history mappings.
Why this helps
Channel posts can contain valuable real-world examples, but they quickly become difficult to revisit.
- Preserve channel examples for evaluation instead of relying on chat search.
- Build a dataset from real reports and observations.
- Keep recurring feedback available to the people improving the experience.
Setup
Build it in a few focused steps.
- 1Connect Telegram and HoneyHive to Notis once in the portal.
- 2Create an automation in the portal or ask Notis to add relevant channel examples to a HoneyHive dataset.
- 3Use one plain-language instruction to explain which channel posts are worth keeping.
- 4Select Telegram New Channel Post and choose a channel for run reports.
- 5Publish one real example post and verify the dataset entry in HoneyHive.
Questions about this workflow
Does the bot need channel access?
The bot must be an administrator in the Telegram channel where the post trigger should run.
Can I focus on a specific type of post?
Yes. Describe the relevant posts in the plain-language prompt so Notis can interpret the context.
When this happens · Trigger
Do this · Action
Supported Triggers and Actions
Notis builds workflows that link Telegram to Honeyhive. A trigger fires from one place; an action lands in another.
Telegram triggers
Honeyhive actions
Recurring trigger
Notis starts this workflow on a schedule, such as daily, weekly, or during business hours.
Add datapoints to dataset
Tool to add datapoints to a dataset. Use when you need to append multiple entries with specified input, ground truth, and history mappings.
Webhook trigger
Notis starts this workflow when an external tool or custom backend sends an HTTP request.
Create Batch Model Events
Tool to create multiple model events in a single request. Use when you need to log a batch of event interactions to HoneyHive.
New Message Received
Triggered when your bot receives a new message in a private chat, group, or supergroup. To receive every message in a group, Privacy Mode must be disabled for the bot in BotFather.
Create Batch Tool Events
Tool to log a batch of external API calls as tool events. Use when you need to record multiple tool events in one request—use after gathering all event data.
New Channel Post
Triggered when a new post is published to a channel where your bot is an administrator.
Create Dataset
Tool to create a dataset. Use when you need to initialize a new dataset within a project.
Callback Query Received
Triggered when a user taps an inline keyboard button attached to one of your bot's messages.
Create Tool
Tool to create a new tool. Use when you need to register a new function or plugin for invocation.
Message Edited
Triggered when a message in a chat your bot can see is edited by its sender.
Delete Datapoint
Tool to delete a specific datapoint by its ID. Use when you need to remove a datapoint from HoneyHive after confirming its identifier.
New Chat Member
Triggered when a new member joins a group or supergroup the bot belongs to, including when the bot itself is added.
Delete Dataset
Tool to delete a dataset by ID. Use when you need to remove a dataset after confirming its ID.
End Evaluation Run
Tool to mark an evaluation run as completed. Use after finishing manual evaluations to update the run status to completed.
Connect any two apps with Notis in the middle.
Telegram and Honeyhive, or any other combination from 1,000+ integrations.
When this happens · Trigger
Do this · Action
Save your first hour today.
7-day trial of any paid plan, with 20$ of usage included.
No card. Works with personal or business Honeyhive.