Keep benchmark notes with the conversation
When a review process has fresh context to share, add it to the conversation already being used for that model evaluation.
Trigger
Webhook received
Notis starts this workflow when an external tool or custom backend sends an HTTP request.
Action
Create Message
Tool to create a new message in a specific thread. use when adding messages to an existing conversation after confirming the thread id.
Why this helps
Benchmark notes often end up detached from the discussion where decisions and follow-up happen.
- Add review context to an existing conversation.
- Keep benchmark follow-up near the discussion it informs.
- Avoid opening a new thread for every incremental update.
Setup
Build it in a few focused steps.
- 1Connect Artificial Analysis and OpenAI to Notis once through the portal.
- 2Create an automation with an incoming webhook trigger.
- 3Use one prompt telling Notis to add the incoming benchmark review note to the specified existing OpenAI thread; include the thread identifier in the request context.
- 4Choose a run-report channel and test with one real request and a confirmed thread identifier.
Questions about this workflow
What does this need to add a message?
It needs the identifier of the existing OpenAI thread.
Will it create a new thread?
No. This workflow adds a message to the specified existing thread.
When this happens · Trigger
Do this · Action
Supported Triggers and Actions
Notis builds workflows that link Artificial Analysis to Openai. A trigger fires from one place; an action lands in another.
Artificial Analysis triggers
Openai actions
Recurring trigger
Notis starts this workflow on a schedule, such as daily, weekly, or during business hours.
Create Assistant
Tool to create a new assistant with specified parameters. use after finalizing model, tools, and instructions.
Webhook trigger
Notis starts this workflow when an external tool or custom backend sends an HTTP request.
Create Message
Tool to create a new message in a specific thread. use when adding messages to an existing conversation after confirming the thread id.
Create Thread
Tool to create a new thread. use when initializing a conversation with optional starter messages.
Delete assistant
Tool to delete a specific assistant by its id. use when you need to remove an assistant after confirming its id.
Delete file
Tool to delete a file. use when you need to remove an uploaded file by its id after confirming the target.
List files
Tool to retrieve a list of files. use when you need to view all files uploaded to your organization.
List fine-tunes
Tool to list your organization's fine-tuning jobs. use when you need to review all fine-tune runs.
List models
Tool to list available models. use when you need to discover which models you can call. use after confirming your api key is valid.
Connect any two apps with Notis in the middle.
Artificial Analysis and Openai, or any other combination from 1,000+ integrations.
When this happens · Trigger
Do this · Action
Save your first hour today.
7-day trial of any paid plan, with 20$ of usage included.
No card. Works with personal or business Openai.