Make an evaluation thread easier to recognize
Give an existing thread a useful review label when a benchmark cycle begins, so it is easier to pick the right conversation back up.
Trigger
Webhook received
Notis starts this workflow when an external tool or custom backend sends an HTTP request.
Action
Modify thread
Tool to modify an existing thread's metadata. use after obtaining the thread id when you need to update metadata.
Why this helps
Multiple model investigations can blur together when active threads have little identifying context.
- Update metadata on the intended existing thread.
- Make an active benchmark cycle easier to identify.
- Reduce effort spent locating the right evaluation conversation.
Setup
Build it in a few focused steps.
- 1Connect Artificial Analysis and OpenAI to Notis once through the portal.
- 2Create an automation using an incoming webhook trigger.
- 3Give Notis one instruction to update metadata on the confirmed OpenAI thread with the benchmark cycle context included in the request.
- 4Choose a run-report channel and test with one real request and thread identifier.
Questions about this workflow
What must the request identify?
It must identify the OpenAI thread whose metadata should be updated.
Does this change thread messages?
No. It updates thread metadata.
When this happens · Trigger
Do this · Action
Supported Triggers and Actions
Notis builds workflows that link Artificial Analysis to Openai. A trigger fires from one place; an action lands in another.
Artificial Analysis triggers
Openai actions
Recurring trigger
Notis starts this workflow on a schedule, such as daily, weekly, or during business hours.
Create Assistant
Tool to create a new assistant with specified parameters. use after finalizing model, tools, and instructions.
Webhook trigger
Notis starts this workflow when an external tool or custom backend sends an HTTP request.
Create Message
Tool to create a new message in a specific thread. use when adding messages to an existing conversation after confirming the thread id.
Create Thread
Tool to create a new thread. use when initializing a conversation with optional starter messages.
Delete assistant
Tool to delete a specific assistant by its id. use when you need to remove an assistant after confirming its id.
Delete file
Tool to delete a file. use when you need to remove an uploaded file by its id after confirming the target.
List files
Tool to retrieve a list of files. use when you need to view all files uploaded to your organization.
List fine-tunes
Tool to list your organization's fine-tuning jobs. use when you need to review all fine-tune runs.
List models
Tool to list available models. use when you need to discover which models you can call. use after confirming your api key is valid.
Connect any two apps with Notis in the middle.
Artificial Analysis and Openai, or any other combination from 1,000+ integrations.
When this happens · Trigger
Do this · Action
Save your first hour today.
7-day trial of any paid plan, with 20$ of usage included.
No card. Works with personal or business Openai.