Skip to content
Notis

Check experiment results when release plans shift

A status change can be the moment to review model evidence. Have Notis list the experiments for the relevant Humanloop project when release readiness changes.

Trigger

Issue Updated Trigger

Triggered when an issue is updated. For example labels are changed, issue status is changed, etc.

Action

List Experiments

This tool retrieves an array of experiments associated with a specific project in humanloop. it requires a project id (starting with 'pr ') and returns details including experiment id, name, description, creation timestamp, status, configuration details, and metrics/results. it is useful for monitoring experiments, analyzing results, tracking model configurations, and comparing experimental setups.

Why this helps

Evaluation results are easy to overlook when a release decision happens in a project tracker separate from model experiments.

  • Bring experiment results into the release decision moment.
  • Reduce the chance of shipping without a fresh evaluation review.
  • Keep the team focused on the changed issue and its AI feature.

Setup

Build it in a few focused steps.

  • 1Connect Linear and Humanloop to Notis once in the portal.
  • 2Create an automation in the portal, or ask Notis to set it up conversationally.
  • 3Write one instruction asking Notis to list experiments for the Humanloop project relevant to an AI release readiness update.
  • 4Choose the Linear Issue Updated trigger and a run-report channel.
  • 5Test with one real issue update and check the experiment list for the intended project.

Questions about this workflow

Can this decide whether a feature is safe to release?

No. It retrieves experiments for review; your team interprets the results and makes the release decision.

What does Humanloop need to list experiments?

The action requires a Humanloop project ID. Include how Notis should identify the relevant project in the instruction or connected context.

When this happens · Trigger

Do this · Action

Supported Triggers and Actions

Notis builds workflows that link Linear to Humanloop. A trigger fires from one place; an action lands in another.

Linear triggers

Humanloop actions

Recurring trigger

Notis starts this workflow on a schedule, such as daily, weekly, or during business hours.

TriggerScheduled

Create Project

This tool creates a new project in humanloop. it is an independent action that generates a project by accepting a project's name (required), an optional description, and an optional organization id. upon execution, it returns details of the created project, including the project's id, name, description, created at timestamp, and organization id.

ActionInstant

Webhook trigger

Notis starts this workflow when an external tool or custom backend sends an HTTP request.

TriggerInstant

Delete Project

This tool allows you to delete a specific project from your humanloop organization. the deletion is permanent and cannot be undone. all associated data, including sessions, datapoints, and evaluations linked to the project, will be permanently removed.

ActionInstant

Comment Received Trigger

Triggered when a comment is received.

TriggerInstant

List Experiments

This tool retrieves an array of experiments associated with a specific project in humanloop. it requires a project id (starting with 'pr ') and returns details including experiment id, name, description, creation timestamp, status, configuration details, and metrics/results. it is useful for monitoring experiments, analyzing results, tracking model configurations, and comparing experimental setups.

ActionInstant

Issue Created Trigger

Triggered when a new issue is created.

TriggerInstant

List Sessions

This tool retrieves a paginated list of sessions for a specific project in humanloop. it requires a project id (and optionally, page and size for pagination) and returns session details such as id, reference id, project information, datapoints count, first inputs, last output, created at, and updated at. this enables users to monitor and analyze historical project interactions.

ActionInstant

Issue Updated Trigger

Triggered when an issue is updated. For example labels are changed, issue status is changed, etc.

TriggerInstant

Private Team Comment Created

Fires when a new comment is posted on an issue in a private Linear team (polled with the connected user's token).

TriggerPolling

Private Team Issue Created

Fires when a new issue appears in a private Linear team (polled with the connected user's token).

TriggerPolling

Private Team Issue Properties Updated

Fires when properties on an issue change in a private Linear team (polled with the connected user's token).

TriggerPolling

Connect any two apps with Notis in the middle.

Linear and Humanloop, or any other combination from 1,000+ integrations.

When this happens · Trigger

Do this · Action

Save your first hour today.

7-day trial of any paid plan, with 20$ of usage included.
No card. Works with personal or business Humanloop.