Skip to content
Notis

Evaluate character performance from a reviewed session

Turn an interaction you captured with Airtop into a focused character evaluation using the criteria you provide.

Trigger

Webhook received

Notis starts this workflow when an external tool or custom backend sends an HTTP request.

Action

Evaluate Character Performance

Evaluates a character’s conversation performance and returns ratings and feedback.

Why this helps

Conversation reviews often produce observations but no consistent evaluation against the criteria that matter to you.

  • Use a captured interaction as evaluation context.
  • Apply criteria supplied in your prompt.
  • Make session review easier to start and repeat.

Setup

Build it in a few focused steps.

  • 1Connect Airtop and Convolo ai once in Notis.
  • 2Create an automation in Notis and name it.
  • 3In one instruction, identify the character, captured session, and evaluation prompt to use.
  • 4Choose the webhook trigger and select a channel for run reports.
  • 5Test with one real session and review the evaluation.

Questions about this workflow

What is needed for a useful evaluation?

Provide the relevant captured interaction and construct an evaluation prompt with the criteria you want considered.

Does the action fetch a conversation session?

The action is for evaluating performance based on an interaction and a constructed prompt. Make the session and prompt available to the automation.

When this happens · Trigger

Do this · Action

Supported Triggers and Actions

Notis builds workflows that link Airtop to Convolo ai. A trigger fires from one place; an action lands in another.

Airtop triggers

Convolo ai actions

Recurring trigger

Notis starts this workflow on a schedule, such as daily, weekly, or during business hours.

TriggerScheduled

Create Character

Creates a new character.

ActionInstant

Webhook trigger

Notis starts this workflow when an external tool or custom backend sends an HTTP request.

TriggerInstant

Evaluate Character Performance

Evaluates a character’s conversation performance and returns ratings and feedback.

ActionInstant

Generate Starter Conversation

Generates conversation starters or follow-up suggestions for a character.

ActionInstant

Get Character Response

Generates a text or voice response from a character in an ongoing session.

ActionInstant

List Voices

Lists the available voice types.

ActionInstant

Set Core AI Settings

Updates a character’s core AI settings.

ActionInstant

Upload Knowledge Bank File

Uploads a file to a knowledge bank.

ActionInstant

Connect any two apps with Notis in the middle.

Airtop and Convolo ai, or any other combination from 1,000+ integrations.

When this happens · Trigger

Do this · Action

Save your first hour today.

7-day trial of any paid plan, with 20$ of usage included.
No card. Works with personal or business Convolo ai.