Turn evaluation proposals into a clear next step
A useful evaluation idea deserves somewhere to go. When a Slack message explicitly asks to start it, Notis can create its Humanloop project.
Trigger
Channel Message Received
Triggered when a message is posted in a Slack channel (public, private, or multi-party IM). Does NOT match direct messages.
Action
Create Project
This tool creates a new project in humanloop. it is an independent action that generates a project by accepting a project's name (required), an optional description, and an optional organization id. upon execution, it returns details of the created project, including the project's id, name, description, created at timestamp, and organization id.
Why this helps
Promising ideas get lost when nobody owns the small task of creating a project after discussion.
- Give a clearly actionable evaluation proposal a home.
- Retain the idea's stated purpose in the project.
- Reduce follow-up work after a decision is made.
Setup
Build it in a few focused steps.
- 1Connect Slack and Humanloop to Notis once in the portal.
- 2Create an automation in the portal, or ask Notis conversationally for one.
- 3Use one plain-language instruction that creates a project only for an explicit request to start a named evaluation proposal.
- 4Choose the Slack channel message trigger and a destination for run reports.
- 5Test with one real proposal that has a clear name and purpose.
Questions about this workflow
Will an idea alone create a project?
The instruction should require an explicit request to start the project, not just an idea being mentioned.
What if the proposal is still being discussed?
Wait until the message clearly says to start it, or have Notis ask for confirmation in the conversation.
When this happens · Trigger
Do this · Action
Supported Triggers and Actions
Notis builds workflows that link Slack to Humanloop. A trigger fires from one place; an action lands in another.
Slack triggers
Humanloop actions
Recurring trigger
Notis starts this workflow on a schedule, such as daily, weekly, or during business hours.
Create Project
This tool creates a new project in humanloop. it is an independent action that generates a project by accepting a project's name (required), an optional description, and an optional organization id. upon execution, it returns details of the created project, including the project's id, name, description, created at timestamp, and organization id.
Webhook trigger
Notis starts this workflow when an external tool or custom backend sends an HTTP request.
Delete Project
This tool allows you to delete a specific project from your humanloop organization. the deletion is permanent and cannot be undone. all associated data, including sessions, datapoints, and evaluations linked to the project, will be permanently removed.
New Channel Created Trigger
Triggered when a new channel is created in Slack.
List Experiments
This tool retrieves an array of experiments associated with a specific project in humanloop. it requires a project id (starting with 'pr ') and returns details including experiment id, name, description, creation timestamp, status, configuration details, and metrics/results. it is useful for monitoring experiments, analyzing results, tracking model configurations, and comparing experimental setups.
Channel Message Received
Triggered when a message is posted in a Slack channel (public, private, or multi-party IM). Does NOT match direct messages.
List Sessions
This tool retrieves a paginated list of sessions for a specific project in humanloop. it requires a project id (and optionally, page and size for pagination) and returns session details such as id, reference id, project information, datapoints count, first inputs, last output, created at, and updated at. this enables users to monitor and analyze historical project interactions.
Direct Message Received
Triggered when a new direct message (DM) is sent to a user in Slack. Catches all DMs across all DM channels.
Message Reaction Added
Triggered when a reaction is added to a message in Slack. Supports optional filtering by channel and emoji name.
Message Reaction Removed
Triggered when a reaction is removed from a message in Slack. Supports optional filtering by channel and emoji name.
Reaction Added Trigger
DEPRECATED: use `SLACK_MESSAGE_REACTION_ADDED` instead. Triggered when a reaction is added to a message in Slack.
Connect any two apps with Notis in the middle.
Slack and Humanloop, or any other combination from 1,000+ integrations.
When this happens · Trigger
Do this · Action
Save your first hour today.
7-day trial of any paid plan, with 20$ of usage included.
No card. Works with personal or business Humanloop.