Give a new evaluation collection a home
Create a HoneyHive dataset when a Telegram channel post kicks off a clearly scoped collection of examples.
Trigger
New Channel Post
Triggered when a new post is published to a channel where your bot is an administrator.
Action
Create Dataset
Tool to create a dataset. Use when you need to initialize a new dataset within a project.
Why this helps
A new evaluation effort can start collecting examples before anyone creates a place to keep them organized.
- Make the collection destination part of the kickoff.
- Reduce the chance that early examples scatter across chats.
- Give a focused review effort a clear starting point.
Setup
Build it in a few focused steps.
- 1Connect Telegram and HoneyHive to Notis once in the portal.
- 2Create an automation in the portal or ask Notis to create a HoneyHive dataset when a Telegram channel announces a new evaluation collection.
- 3Describe the qualifying announcement and intended dataset in one plain-language instruction.
- 4Select Telegram New Channel Post and choose a channel for run reports.
- 5Publish one test kickoff announcement and check that the dataset is created in HoneyHive.
Questions about this workflow
Does every channel post create a dataset?
The prompt should identify the specific kind of kickoff announcement that should create one.
What does this action create?
It initializes a new dataset within a HoneyHive project.
When this happens · Trigger
Do this · Action
Supported Triggers and Actions
Notis builds workflows that link Telegram to Honeyhive. A trigger fires from one place; an action lands in another.
Telegram triggers
Honeyhive actions
Recurring trigger
Notis starts this workflow on a schedule, such as daily, weekly, or during business hours.
Add datapoints to dataset
Tool to add datapoints to a dataset. Use when you need to append multiple entries with specified input, ground truth, and history mappings.
Webhook trigger
Notis starts this workflow when an external tool or custom backend sends an HTTP request.
Create Batch Model Events
Tool to create multiple model events in a single request. Use when you need to log a batch of event interactions to HoneyHive.
New Message Received
Triggered when your bot receives a new message in a private chat, group, or supergroup. To receive every message in a group, Privacy Mode must be disabled for the bot in BotFather.
Create Batch Tool Events
Tool to log a batch of external API calls as tool events. Use when you need to record multiple tool events in one request—use after gathering all event data.
New Channel Post
Triggered when a new post is published to a channel where your bot is an administrator.
Create Dataset
Tool to create a dataset. Use when you need to initialize a new dataset within a project.
Callback Query Received
Triggered when a user taps an inline keyboard button attached to one of your bot's messages.
Create Tool
Tool to create a new tool. Use when you need to register a new function or plugin for invocation.
Message Edited
Triggered when a message in a chat your bot can see is edited by its sender.
Delete Datapoint
Tool to delete a specific datapoint by its ID. Use when you need to remove a datapoint from HoneyHive after confirming its identifier.
New Chat Member
Triggered when a new member joins a group or supergroup the bot belongs to, including when the bot itself is added.
Delete Dataset
Tool to delete a dataset by ID. Use when you need to remove a dataset after confirming its ID.
End Evaluation Run
Tool to mark an evaluation run as completed. Use after finishing manual evaluations to update the run status to completed.
Connect any two apps with Notis in the middle.
Telegram and Honeyhive, or any other combination from 1,000+ integrations.
When this happens · Trigger
Do this · Action
Save your first hour today.
7-day trial of any paid plan, with 20$ of usage included.
No card. Works with personal or business Honeyhive.