Skip to content
Notis

Keep agent replies ready for evaluation

Save a Telegram agent response as a HoneyHive model event while the example is still easy to find.

Trigger

New Message Received

Triggered when your bot receives a new message in a private chat, group, or supergroup. To receive every message in a group, Privacy Mode must be disabled for the bot in BotFather.

Action

Create Batch Model Events

Tool to create multiple model events in a single request. Use when you need to log a batch of event interactions to HoneyHive.

Why this helps

Good and bad agent replies disappear into busy chat history before anyone can evaluate them.

  • Capture real outputs without copying them into a separate tracker.
  • Keep evaluation examples close to where your team already discusses them.
  • Make it easier to spot patterns across agent responses.

Setup

Build it in a few focused steps.

  • 1Connect Telegram and HoneyHive to Notis once in the portal.
  • 2Create an automation in the portal or ask Notis conversationally to log relevant Telegram agent replies in HoneyHive.
  • 3Use one plain-language instruction to describe which reply context should become a model event.
  • 4Select Telegram New Message Received as the trigger and choose a channel for run reports.
  • 5Send one real agent reply in Telegram and check that HoneyHive records the example.

Questions about this workflow

Does this capture every Telegram message?

The automation follows the plain-language instruction you give Notis and the selected Telegram trigger. Specify the kinds of agent replies that are useful to record.

What does HoneyHive store?

The workflow asks HoneyHive to create model events from the relevant message context. Notis interprets the instruction rather than asking you to map fields.

When this happens · Trigger

Do this · Action

Supported Triggers and Actions

Notis builds workflows that link Telegram to Honeyhive. A trigger fires from one place; an action lands in another.

Telegram triggers

Honeyhive actions

Recurring trigger

Notis starts this workflow on a schedule, such as daily, weekly, or during business hours.

TriggerScheduled

Add datapoints to dataset

Tool to add datapoints to a dataset. Use when you need to append multiple entries with specified input, ground truth, and history mappings.

ActionInstant

Webhook trigger

Notis starts this workflow when an external tool or custom backend sends an HTTP request.

TriggerInstant

Create Batch Model Events

Tool to create multiple model events in a single request. Use when you need to log a batch of event interactions to HoneyHive.

ActionInstant

New Message Received

Triggered when your bot receives a new message in a private chat, group, or supergroup. To receive every message in a group, Privacy Mode must be disabled for the bot in BotFather.

TriggerInstant

Create Batch Tool Events

Tool to log a batch of external API calls as tool events. Use when you need to record multiple tool events in one request—use after gathering all event data.

ActionInstant

New Channel Post

Triggered when a new post is published to a channel where your bot is an administrator.

TriggerInstant

Create Dataset

Tool to create a dataset. Use when you need to initialize a new dataset within a project.

ActionInstant

Callback Query Received

Triggered when a user taps an inline keyboard button attached to one of your bot's messages.

TriggerInstant

Create Tool

Tool to create a new tool. Use when you need to register a new function or plugin for invocation.

ActionInstant

Message Edited

Triggered when a message in a chat your bot can see is edited by its sender.

TriggerInstant

Delete Datapoint

Tool to delete a specific datapoint by its ID. Use when you need to remove a datapoint from HoneyHive after confirming its identifier.

ActionInstant

New Chat Member

Triggered when a new member joins a group or supergroup the bot belongs to, including when the bot itself is added.

TriggerInstant

Delete Dataset

Tool to delete a dataset by ID. Use when you need to remove a dataset after confirming its ID.

ActionInstant

End Evaluation Run

Tool to mark an evaluation run as completed. Use after finishing manual evaluations to update the run status to completed.

ActionInstant

Connect any two apps with Notis in the middle.

Telegram and Honeyhive, or any other combination from 1,000+ integrations.

When this happens · Trigger

Do this · Action

Save your first hour today.

7-day trial of any paid plan, with 20$ of usage included.
No card. Works with personal or business Honeyhive.