Spot repeated Buildkite failures worth investigating
Find patterns across recent runs and turn them into a focused review request.
Trigger
Recurring schedule
Notis starts this workflow on a schedule, such as daily, weekly, or during business hours.
Action
Create email draft
Creates a gmail email draft, supporting to/cc/bcc, subject, plain/html body (ensure `is html=true` for html), attachments, and threading.
Why this helps
Repeated failures can look like isolated incidents when each build is checked on its own.
- Looks for repeated patterns within the selected period.
- Avoids calling a pipeline flaky without supporting evidence.
- Creates a draft with examples for follow-up.
Setup
Build it in a few focused steps.
- 1Connect Buildkite and Gmail once in Notis.
- 2Create an automation in Automations, New Automation, or tell Notis to create it from any channel.
- 3In one instruction, set the reporting period and ask Notis to draft a review of repeated failures with supporting build references.
- 4Choose a recurring schedule and select where run reports should go.
- 5Test against one real period and verify that each reported pattern has supporting examples.
Questions about this workflow
Does this diagnose flaky tests?
No. It can identify repeated failure patterns in available Buildkite results, but confirming flakiness may require test-level evidence.
Can it compare multiple weeks?
Only if the data returned covers those weeks. Specify a period and ensure Buildkite data includes it.
Can it make a ticket automatically?
This package creates a Gmail draft. Ticket actions are outside the provided Gmail action list.
When this happens · Trigger
Do this · Action
Supported Triggers and Actions
Notis builds workflows that link Buildkite to Gmail. A trigger fires from one place; an action lands in another.
Buildkite triggers
Gmail actions
Recurring trigger
Notis starts this workflow on a schedule, such as daily, weekly, or during business hours.
Modify email labels
Adds and/or removes specified gmail labels for a message; ensure `message id` and all `label ids` are valid (use 'listlabels' for custom label ids).
Webhook trigger
Notis starts this workflow when an external tool or custom backend sends an HTTP request.
Create email draft
Creates a gmail email draft, supporting to/cc/bcc, subject, plain/html body (ensure `is html=true` for html), attachments, and threading.
Create label
Creates a new label with a unique name in the specified user's gmail account.
Delete Draft
Permanently deletes a specific gmail draft using its id; ensure the draft exists and the user has necessary permissions for the given `user id`.
Delete message
Permanently deletes a specific email message by its id from a gmail mailbox; for `user id`, use 'me' for the authenticated user or an email address to which the authenticated user has delegated access.
Fetch emails
Fetches a list of email messages from a gmail account, supporting filtering, pagination, and optional full content retrieval.
Fetch message by message ID
Fetches a specific email message by its id, provided the `message id` exists and is accessible to the authenticated `user id`.
Fetch Message by Thread ID
Retrieves messages from a gmail thread using its `thread id`, where the thread must be accessible by the specified `user id`.
Connect any two apps with Notis in the middle.
Buildkite and Gmail, or any other combination from 1,000+ integrations.
When this happens · Trigger
Do this · Action
Save your first hour today.
7-day trial of any paid plan, with 20$ of usage included.
No card. Works with personal or business Gmail.