Review your AI character when product feedback lands
Connect engineering feedback to a practical check on how your assistant performs.
Trigger
Pull Request Review Submitted
Triggers when a new review is submitted for a GitHub pull request. Emits an event for each newly submitted review on the monitored pull request, covering all review types: APPROVED, CHANGES_REQUESTED, COMMENTED, and DISMISSED.
Action
Evaluate Character Performance
Tool to evaluate a character's performance based on interactions. Use after fetching a conversation session and constructing your prompt.
Why this helps
AI quality reviews are easy to postpone when they compete with code review and shipping work.
- Create a recurring quality checkpoint.
- Use engineering feedback to improve AI behavior.
- Reduce the mental load of remembering performance reviews.
Setup
Build it in a few focused steps.
- 1Connect GitHub and Convolo AI to Notis once through the portal.
- 2Create an automation in the portal or ask Notis to evaluate the relevant character after a pull request review is submitted.
- 3Pick the pull request review trigger and choose a channel for run reports.
- 4Test with one submitted review and inspect the evaluation.
Questions about this workflow
What does the evaluation use?
Tell Notis to use the submitted review context and the relevant Convolo AI interaction history.
Is this a replacement for code review?
No. It adds an AI quality checkpoint alongside the existing engineering review.
When this happens · Trigger
Do this · Action
Supported Triggers and Actions
Notis builds workflows that link GitHub to Convolo ai. A trigger fires from one place; an action lands in another.
GitHub triggers
Convolo ai actions
New Workflow Artifact Created
Triggers when a new workflow artifact is created in a GitHub repository. Monitors for newly created GitHub Actions workflow artifacts. Optionally filters by artifact name to restrict monitoring to specific artifacts.
Create Character
Tool to create a new character. Use when you have name, voice type, backstory, and optional actions ready.
Branch Changed
Triggers when a GitHub branch changes. Monitors a specific branch for: - New commits pushed (head commit SHA changes) - Protection status toggled (branch becomes protected or unprotected) - Protection settings changed, including: required status checks and their enforcement level, admin enforcement, required pull request reviews (dismiss stale reviews, code owner reviews, approving review count, last push approval), required linear history, force push allowance, deletion allowance, conversation resolution, branch locking, and fork syncing.
Define or Update Character Actions
Tool to define or update the list of actions a character can perform. Use when you need to configure or adjust character capabilities before deployment.
New Branch Created
Triggers when a new branch is created in a GitHub repository. Detects newly created branches. Deleted branches do not fire events.
Evaluate Character Performance
Tool to evaluate a character's performance based on interactions. Use after fetching a conversation session and constructing your prompt.
Check Run Status / Conclusion Changed
Triggers when a specific GitHub check run changes its status or conclusion. Monitors a single check run for changes to: status (queued, in_progress, completed, etc.), conclusion (success, failure, neutral, cancelled, skipped, timed_out, action_required), started_at, and completed_at.
Generate Starter Conversation
Tool to generate starter conversation suggestions for a character. Use when you need opening or follow-up dialogue lines.
Check Suite Status / Conclusion Changed
Triggers when a GitHub check suite changes its status or conclusion for a given ref. Monitors all check suites associated with a git reference (branch, tag, or commit SHA) for changes to status (queued, in_progress, completed, etc.) and conclusion (success, failure, neutral, cancelled, skipped, timed_out, action_required, startup_failure, stale). Optionally filters by GitHub App ID.
Get Character Response
Tool to generate a response from a ConvAI character based on text or audio input. Use when needing a text or voice reply in an ongoing session.
New Code Scanning Alert Created
Triggers when a new code scanning alert is created in a repository. Fires an event for each newly created code scanning alert detected in the configured repository. Alerts can be filtered by Git reference, scanning tool, state, and severity. The payload includes the alert number, rule details, tool information, state, severity, and the location of the most recent instance.
List Voices
Tool to retrieve the list of available voice types. Use when selecting voices before generating speech.
New Repository Collaborator Added
Triggers when a new collaborator is added to a GitHub repository. Monitors the full list of collaborators on a repository and fires an event for each newly added collaborator. The payload includes the collaborator's GitHub username, account ID, profile URL, avatar URL, permission flags (pull, triage, push, maintain, admin), and assigned role name.
Set Core AI Settings
Tool to set core AI settings for a character. Use after confirming character existence.
Commit Event
Triggered when a new commit is pushed to a repository.
Update Character Backstory
Tool to update a character's backstory. Use when you need to modify the backstory of an existing character after confirming its ID. Only the provided fields will be updated.
Connect any two apps with Notis in the middle.
Not just GitHub and Convolo ai. Any combination from 1,000+ integrations.
When this happens · Trigger
Do this · Action
Save your first hour today.
7 days free trial with 20$ free usage included.
No card. Works with personal or business Convolo ai.