Keep agent tool failures traceable
When a teammate reports a failed integration or tool call, preserve the incident in HoneyHive so it does not disappear in chat.
Trigger
Channel Message Received
Triggered when a message is posted in a Slack channel (public, private, or multi-party IM). Does NOT match direct messages.
Action
Create Batch Tool Events
Tool to log a batch of external API calls as tool events. Use when you need to record multiple tool events in one request—use after gathering all event data.
Why this helps
Tool failures get discussed in Slack but lack a consistent record for debugging patterns.
- Create a durable record of reported tool issues.
- Make recurring integration problems easier to investigate.
- Reduce the mental overhead of maintaining a separate log.
Setup
Build it in a few focused steps.
- 1Connect Slack and HoneyHive to Notis once.
- 2Ask Notis to create an automation, or open Automations and start a new one.
- 3Give one plain-language instruction for which reported tool failures to log as HoneyHive tool events.
- 4Select the Slack channel message trigger and a channel for run reports.
- 5Test with a real, non-sensitive failure report and inspect the resulting event.
Questions about this workflow
Will it diagnose the failure automatically?
This workflow records the reported tool call as an event; diagnosis depends on the details available and the prompt.
Can it handle more than one report at a time?
The HoneyHive action supports creating multiple tool events in one request.
When this happens · Trigger
Do this · Action
Supported Triggers and Actions
Notis builds workflows that link Slack to Honeyhive. A trigger fires from one place; an action lands in another.
Slack triggers
Honeyhive actions
Recurring trigger
Notis starts this workflow on a schedule, such as daily, weekly, or during business hours.
Add datapoints to dataset
Tool to add datapoints to a dataset. Use when you need to append multiple entries with specified input, ground truth, and history mappings.
Webhook trigger
Notis starts this workflow when an external tool or custom backend sends an HTTP request.
Create Batch Model Events
Tool to create multiple model events in a single request. Use when you need to log a batch of event interactions to HoneyHive.
New Channel Created Trigger
Triggered when a new channel is created in Slack.
Create Batch Tool Events
Tool to log a batch of external API calls as tool events. Use when you need to record multiple tool events in one request—use after gathering all event data.
Channel Message Received
Triggered when a message is posted in a Slack channel (public, private, or multi-party IM). Does NOT match direct messages.
Create Dataset
Tool to create a dataset. Use when you need to initialize a new dataset within a project.
Direct Message Received
Triggered when a new direct message (DM) is sent to a user in Slack. Catches all DMs across all DM channels.
Create Tool
Tool to create a new tool. Use when you need to register a new function or plugin for invocation.
Message Reaction Added
Triggered when a reaction is added to a message in Slack. Supports optional filtering by channel and emoji name.
Delete Datapoint
Tool to delete a specific datapoint by its ID. Use when you need to remove a datapoint from HoneyHive after confirming its identifier.
Message Reaction Removed
Triggered when a reaction is removed from a message in Slack. Supports optional filtering by channel and emoji name.
Delete Dataset
Tool to delete a dataset by ID. Use when you need to remove a dataset after confirming its ID.
Reaction Added Trigger
DEPRECATED: use `SLACK_MESSAGE_REACTION_ADDED` instead. Triggered when a reaction is added to a message in Slack.
End Evaluation Run
Tool to mark an evaluation run as completed. Use after finishing manual evaluations to update the run status to completed.
Connect any two apps with Notis in the middle.
Slack and Honeyhive, or any other combination from 1,000+ integrations.
When this happens · Trigger
Do this · Action
Save your first hour today.
7-day trial of any paid plan, with 20$ of usage included.
No card. Works with personal or business Honeyhive.