Skip to content
Notis

Keep dataset purpose in step with project scope

When a project's evaluation scope changes, update the dataset description that explains what it covers.

Trigger

Project Properties Updated

Fires when properties on a Linear project change (status, lead, target date, priority, etc.). Covers projects in both public and private teams — polls with the connected user's token.

Action

Update Dataset

Tool to update an existing dataset. Use when you need to modify a dataset's details (name, description, datapoints, linked evaluations, or metadata) after confirming its ID.

Why this helps

A changed project scope can leave a dataset description outdated, making it hard to tell whether its examples still fit.

  • Keeps dataset purpose understandable as project scope evolves.
  • Helps teammates choose evaluation data that still fits the work.
  • Reduces manual housekeeping after scope decisions.

Setup

Build it in a few focused steps.

  • 1Connect Linear and Honeyhive to Notis once in the portal.
  • 2Create an automation that updates the matching Honeyhive dataset details when a Linear project property update explicitly changes evaluation scope.
  • 3Select the Linear Project Properties Updated trigger and choose a run-report channel.
  • 4Test with one documented scope change and verify the correct dataset description is updated.

Questions about this workflow

Will every project property change alter the dataset?

The prompt should require an explicit evaluation scope change and identify the matching dataset.

Can it replace dataset contents?

This workflow is for updating dataset details that explain its scope; direct changes to datapoints should be handled separately.

When this happens · Trigger

Do this · Action

Supported Triggers and Actions

Notis builds workflows that link Linear to Honeyhive. A trigger fires from one place; an action lands in another.

Linear triggers

Honeyhive actions

Recurring trigger

Notis starts this workflow on a schedule, such as daily, weekly, or during business hours.

TriggerScheduled

Add datapoints to dataset

Tool to add datapoints to a dataset. Use when you need to append multiple entries with specified input, ground truth, and history mappings.

ActionInstant

Webhook trigger

Notis starts this workflow when an external tool or custom backend sends an HTTP request.

TriggerInstant

Create Batch Model Events

Tool to create multiple model events in a single request. Use when you need to log a batch of event interactions to HoneyHive.

ActionInstant

Comment Received Trigger

Triggered when a comment is received.

TriggerInstant

Create Batch Tool Events

Tool to log a batch of external API calls as tool events. Use when you need to record multiple tool events in one request—use after gathering all event data.

ActionInstant

Issue Created Trigger

Triggered when a new issue is created.

TriggerInstant

Create Dataset

Tool to create a dataset. Use when you need to initialize a new dataset within a project.

ActionInstant

Issue Updated Trigger

Triggered when an issue is updated. For example labels are changed, issue status is changed, etc.

TriggerInstant

Create Tool

Tool to create a new tool. Use when you need to register a new function or plugin for invocation.

ActionInstant

Private Team Comment Created

Fires when a new comment is posted on an issue in a private Linear team (polled with the connected user's token).

TriggerPolling

Delete Datapoint

Tool to delete a specific datapoint by its ID. Use when you need to remove a datapoint from HoneyHive after confirming its identifier.

ActionInstant

Private Team Issue Created

Fires when a new issue appears in a private Linear team (polled with the connected user's token).

TriggerPolling

Delete Dataset

Tool to delete a dataset by ID. Use when you need to remove a dataset after confirming its ID.

ActionInstant

Private Team Issue Properties Updated

Fires when properties on an issue change in a private Linear team (polled with the connected user's token).

TriggerPolling

End Evaluation Run

Tool to mark an evaluation run as completed. Use after finishing manual evaluations to update the run status to completed.

ActionInstant

Connect any two apps with Notis in the middle.

Linear and Honeyhive, or any other combination from 1,000+ integrations.

When this happens · Trigger

Do this · Action

Save your first hour today.

7-day trial of any paid plan, with 20$ of usage included.
No card. Works with personal or business Honeyhive.