Track coding model benchmarks in Slack
Keep coding benchmark comparisons accessible to the people choosing models for development work.
Trigger
Recurring schedule
Notis starts this workflow on a schedule, such as daily, weekly, or during business hours.
Action
Post message to channel
Deprecated: posts a message to a slack channel, direct message, or private channel. use `send message` instead.
Why this helps
Coding performance comparisons can get buried among general model news and broad benchmark summaries.
- Focus on a benchmark relevant to coding work
- Make comparisons easy to revisit in Slack
- Reduce time spent scanning unrelated model metrics
Setup
Build it in a few focused steps.
- 1Connect Artificial Analysis and Slack once in Notis.
- 2Create an automation and describe the coding benchmark digest you need.
- 3Ask Notis to summarize available coding benchmark results for the selected models in Slack.
- 4Pick a recurring schedule and choose where run reports should go.
- 5Test with one real coding benchmark comparison.
Questions about this workflow
Can the digest cover only certain models?
Yes. Name the models or selection criteria in the instruction.
Does a higher benchmark score guarantee better results in our codebase?
No. Benchmark performance is one input; include your own testing context when relevant.
When this happens · Trigger
Do this · Action
Supported Triggers and Actions
Notis builds workflows that link Artificial Analysis to Slack. A trigger fires from one place; an action lands in another.
Artificial Analysis triggers
Slack actions
Recurring trigger
Notis starts this workflow on a schedule, such as daily, weekly, or during business hours.
Set snooze duration
Deprecated: turns on do not disturb mode for the current user, or changes its duration. use `set dnd duration` instead.
Webhook trigger
Notis starts this workflow when an external tool or custom backend sends an HTTP request.
Add a custom emoji to a Slack team
Deprecated: adds a custom emoji to a slack workspace given a unique name and an image url. use `add emoji` instead.
Add an emoji alias
Adds an alias for an existing custom emoji in a slack enterprise grid organization.
Add a remote file
Adds a reference to an external file (e.g., google drive, dropbox) to slack for discovery and sharing, requiring a unique `external id` and an `external url` accessible by slack.
Add a star to an item
Stars a channel, file, file comment, or a specific message in slack.
Add call participants
Registers new participants added to a slack call.
Add emoji
Adds a custom emoji to a slack workspace given a unique name and an image url; subject to workspace emoji limits.
Add reaction to message
Adds a specified emoji reaction to an existing message in a slack channel, identified by its timestamp; does not remove or retrieve reactions.
Connect any two apps with Notis in the middle.
Artificial Analysis and Slack, or any other combination from 1,000+ integrations.
When this happens · Trigger
Do this · Action
Save your first hour today.
7-day trial of any paid plan, with 20$ of usage included.
No card. Works with personal or business Slack.