Understand test results for a release job
Turn detailed job test metadata into a short explanation that helps your team decide what to inspect next.
Trigger
Webhook received
Notis starts this workflow when an external tool or custom backend sends an HTTP request.
Action
Get Test Metadata
Retrieves test results, run times, and failure details for a job.
Why this helps
Test timing and failure details can be buried in job output when a release needs a quick decision.
- Summarizes available test timings and failure messages
- Makes job-level test review faster
- Helps direct follow-up to the tests that need attention
Setup
Build it in a few focused steps.
- 1Connect Agility CMS and CircleCI once in the Notis portal.
- 2Create an automation in Automations, New Automation, or tell Notis to create it in plain language.
- 3In one instruction, ask Notis to retrieve test metadata for the CircleCI job number in the release request and explain the failures and timings.
- 4Pick the webhook trigger and choose where run reports should go.
- 5Test with one completed job that has test metadata.
Questions about this workflow
Does the job need to be complete?
Yes. Test metadata is useful after a job has completed.
Can it summarize tests if there is no job number?
No. Provide the CircleCI job number in the webhook context or instruction.
When this happens · Trigger
Do this · Action
Supported Triggers and Actions
Notis builds workflows that link Agility cms to Circleci. A trigger fires from one place; an action lands in another.
Agility cms triggers
Circleci actions
Recurring trigger
Notis starts this workflow on a schedule, such as daily, weekly, or during business hours.
Get Job Artifacts
Retrieves files produced by a job.
Webhook trigger
Notis starts this workflow when an external tool or custom backend sends an HTTP request.
Create Context
Creates a context for sharing environment variables securely across projects.
Get Job Details
Retrieves status, timing, and executor details for a job.
Create Context (GraphQL)
Creates a context for storing environment variables; returns an error if creation fails.
Get Pipeline Config
Retrieves the source or compiled configuration for a pipeline.
Create Context Restriction
Creates a context restriction to limit access by project, rules, or group.
Get Test Metadata
Retrieves test results, run times, and failure details for a job.
Create Organization Orb Allowlist
Allows URL-based orb references with matching prefixes in an organization’s pipelines.
Connect any two apps with Notis in the middle.
Agility cms and Circleci, or any other combination from 1,000+ integrations.
When this happens · Trigger
Do this · Action
Save your first hour today.
7-day trial of any paid plan, with 20$ of usage included.
No card. Works with personal or business Circleci.