Give each benchmark review a clear starting point
Start a dedicated thread when your benchmark workflow is ready, so evaluation context has a home instead of becoming another loose note.
Trigger
Webhook received
Notis starts this workflow when an external tool or custom backend sends an HTTP request.
Action
Create Thread
Tool to create a new thread. use when initializing a conversation with optional starter messages.
Why this helps
A comparison can lose momentum when there is no obvious place to gather the questions and next steps.
- Create a fresh conversation space when an external review process is ready.
- Keep evaluation discussions distinct from unrelated assistant work.
- Reduce the friction of starting a focused model comparison.
Setup
Build it in a few focused steps.
- 1Connect Artificial Analysis and OpenAI to Notis once through the portal.
- 2Create an automation and select an incoming webhook trigger.
- 3Write one prompt asking Notis to create an OpenAI thread when the benchmark review backend sends a request, using the request context to frame the review.
- 4Choose a channel for run reports, configure your backend to send a request, and test with one real review request.
Questions about this workflow
What starts this workflow?
A request sent to the Notis incoming webhook by your external tool or custom backend.
Does this start the model evaluation itself?
It creates a thread to organize the review conversation.
When this happens · Trigger
Do this · Action
Supported Triggers and Actions
Notis builds workflows that link Artificial Analysis to Openai. A trigger fires from one place; an action lands in another.
Artificial Analysis triggers
Openai actions
Recurring trigger
Notis starts this workflow on a schedule, such as daily, weekly, or during business hours.
Create Assistant
Tool to create a new assistant with specified parameters. use after finalizing model, tools, and instructions.
Webhook trigger
Notis starts this workflow when an external tool or custom backend sends an HTTP request.
Create Message
Tool to create a new message in a specific thread. use when adding messages to an existing conversation after confirming the thread id.
Create Thread
Tool to create a new thread. use when initializing a conversation with optional starter messages.
Delete assistant
Tool to delete a specific assistant by its id. use when you need to remove an assistant after confirming its id.
Delete file
Tool to delete a file. use when you need to remove an uploaded file by its id after confirming the target.
List files
Tool to retrieve a list of files. use when you need to view all files uploaded to your organization.
List fine-tunes
Tool to list your organization's fine-tuning jobs. use when you need to review all fine-tune runs.
List models
Tool to list available models. use when you need to discover which models you can call. use after confirming your api key is valid.
Connect any two apps with Notis in the middle.
Artificial Analysis and Openai, or any other combination from 1,000+ integrations.
When this happens · Trigger
Do this · Action
Save your first hour today.
7-day trial of any paid plan, with 20$ of usage included.
No card. Works with personal or business Openai.