Spot unreliable tests before they disrupt agency work
Surface tests that behave inconsistently so your team can decide what to investigate next.
Trigger
Recurring schedule
Notis starts this workflow on a schedule, such as daily, weekly, or during business hours.
Action
Get Flaky Tests
Finds tests that passed and failed in the same commit, across branches.
Why this helps
Intermittent failures create noisy follow-up and make it harder to tell whether a build problem needs attention.
- Identify tests that passed and failed in the same commit.
- Get branch-agnostic reliability insights for a project.
- Turn scattered build noise into a scheduled review.
Setup
Build it in a few focused steps.
- 1Connect Agencyzoom and CircleCI once in Notis.
- 2Create an automation and describe which agency projects need a flaky test review.
- 3Choose a recurring Notis schedule as the trigger.
- 4Choose where Notis should send run reports.
- 5Test with one real CircleCI project and review the returned insights.
Questions about this workflow
Does this require a specific Agencyzoom event?
No. It uses a recurring Notis schedule because Agencyzoom trigger events are not available for this package.
What does CircleCI consider a flaky test here?
The action finds tests that passed and failed in the same commit, with branch-agnostic insights.
When this happens · Trigger
Do this · Action
Supported Triggers and Actions
Notis builds workflows that link Agencyzoom to Circleci. A trigger fires from one place; an action lands in another.
Agencyzoom triggers
Circleci actions
Recurring trigger
Notis starts this workflow on a schedule, such as daily, weekly, or during business hours.
Get Job Artifacts
Retrieves files produced by a job.
Webhook trigger
Notis starts this workflow when an external tool or custom backend sends an HTTP request.
Create Context
Creates a context for sharing environment variables securely across projects.
Get Job Details
Retrieves status, timing, and executor details for a job.
Create Context (GraphQL)
Creates a context for storing environment variables; returns an error if creation fails.
Get Pipeline Config
Retrieves the source or compiled configuration for a pipeline.
Create Context Restriction
Creates a context restriction to limit access by project, rules, or group.
Get Test Metadata
Retrieves test results, run times, and failure details for a job.
Create Organization Orb Allowlist
Allows URL-based orb references with matching prefixes in an organization’s pipelines.
Connect any two apps with Notis in the middle.
Agencyzoom and Circleci, or any other combination from 1,000+ integrations.
When this happens · Trigger
Do this · Action
Save your first hour today.
7-day trial of any paid plan, with 20$ of usage included.
No card. Works with personal or business Circleci.