Check evaluation data before model testing
Give an evaluation task a clearer start by retrieving dataset features and repository context from Hugging Face.
Trigger
Issue Created Trigger
Triggered when a new issue is created.
Action
Get Dataset Info
Tool to get general information about a dataset including description, citation, homepage, license, and features (column schemas). Use when you need to understand dataset structure, available splits, and metadata before working with the data.
Why this helps
Evaluation work gets delayed when the person running it has to rediscover dataset structure before testing can begin.
- Surface dataset features early in the evaluation process.
- Help the evaluator spot schema assumptions before running experiments.
- Reduce repeated repository research.
Setup
Build it in a few focused steps.
- 1Connect Linear and Hugging Face to Notis once in the portal.
- 2Create the automation in the portal or describe it to Notis in conversation.
- 3Write one plain-language instruction asking for dataset information relevant to each new model evaluation issue.
- 4Select Linear Issue Created, choose a run-report channel, and test with a real evaluation issue.
Questions about this workflow
Can this tell whether a dataset is appropriate for the model?
It returns dataset information and features; a person still needs to assess suitability.
Does it run an evaluation?
No. It prepares dataset context for an evaluation task.
When this happens · Trigger
Do this · Action
Supported Triggers and Actions
Notis builds workflows that link Linear to Hugging Face. A trigger fires from one place; an action lands in another.
Linear triggers
Hugging Face actions
Recurring trigger
Notis starts this workflow on a schedule, such as daily, weekly, or during business hours.
Change Discussion Status
Tool to change the status of a Hugging Face repository discussion. Use when you need to open or close discussions on models, datasets, or spaces.
Webhook trigger
Notis starts this workflow when an external tool or custom backend sends an HTTP request.
Check Dataset Validity
Tool to check whether a specific dataset is valid on Hugging Face Hub. Use when you need to determine what features (preview, viewer, search, filter, statistics) are available for a dataset.
Comment Received Trigger
Triggered when a comment is received.
Check Models Upload Method
Tool to check if files should be uploaded through the Large File mechanism or directly. Use when preparing to upload files to a Hugging Face model repository to determine the appropriate upload method for each file.
Issue Created Trigger
Triggered when a new issue is created.
Check Spaces Upload Method
Tool to check if files should be uploaded through the Large File mechanism or directly to Hugging Face Spaces. Use when preparing to upload files to a Hugging Face Space repository to determine the appropriate upload method for each file.
Issue Updated Trigger
Triggered when an issue is updated. For example labels are changed, issue status is changed, etc.
Claim Paper Authorship
Tool to claim authorship of a paper on Hugging Face. Use when you need to associate yourself or another user with an ArXiv paper.
Private Team Comment Created
Fires when a new comment is posted on an issue in a private Linear team (polled with the connected user's token).
Request Repository Access
Tool to request access to a gated repository on Hugging Face Hub. Use when you need to submit an access request for models, datasets, or Spaces that require approval. The fields required vary by repository.
Private Team Issue Created
Fires when a new issue appears in a private Linear team (polled with the connected user's token).
Create Collection
Tool to create a new collection on Hugging Face. Use when you need to organize and curate models, datasets, spaces, papers, or other collections into a named collection.
Private Team Issue Properties Updated
Fires when properties on an issue change in a private Linear team (polled with the connected user's token).
Create Datasets Branch
Tool to create a new branch in a Hugging Face dataset repository. Use when you need to create a branch for versioning or experimentation with dataset changes.
Connect any two apps with Notis in the middle.
Linear and Hugging Face, or any other combination from 1,000+ integrations.
When this happens · Trigger
Do this · Action
Save your first hour today.
7-day trial of any paid plan, with 20$ of usage included.
No card. Works with personal or business Hugging Face.