Skip to content
Notis

Review refunds when an AI evaluation regresses

Keep evaluation regressions and refund history together while your team decides what needs attention.

Trigger

Webhook received

Notis starts this workflow when an external tool or custom backend sends an HTTP request.

Action

List Refunds

Lists stripe refunds, sorted by creation date descending (newest first), with optional filtering by charge or payment intent and pagination support.

Why this helps

Refund follow-up can get missed when regression findings live in a separate engineering workflow.

  • Review refund history in the context of a regression
  • Spot records that may need a customer follow-up
  • Keep investigation reports in a chosen channel

Setup

Build it in a few focused steps.

  • 1Connect Arize AX and Stripe once in the Notis portal.
  • 2Create an automation in Automations, then choose New Automation.
  • 3Tell Notis to check Stripe refunds related to each regression alert and summarize records needing review.
  • 4Choose the Notis webhook trigger and where run reports should go.
  • 5Test with one real regression alert and confirm the refund results are relevant.

Questions about this workflow

Does this workflow decide whether a refund is appropriate?

No. It retrieves refund records for review and does not create or issue refunds.

What starts the automation?

A Notis webhook starts it when an HTTP request with a regression alert is sent.

When this happens · Trigger

Do this · Action

Supported Triggers and Actions

Notis builds workflows that link Arize AX to Stripe. A trigger fires from one place; an action lands in another.

Arize AX triggers

Stripe actions

Recurring trigger

Notis starts this workflow on a schedule, such as daily, weekly, or during business hours.

TriggerScheduled

Cancel subscription

Cancels a customer's active stripe subscription at the end of the current billing period, with options to invoice immediately for metered usage and prorate charges for unused time.

ActionInstant

Webhook trigger

Notis starts this workflow when an external tool or custom backend sends an HTTP request.

TriggerInstant

Confirm payment intent

Confirms a stripe paymentintent to finalize a payment; a `return url` is necessary if the payment method requires customer redirection.

ActionInstant

Create Customer

Creates a new customer in stripe, required for creating charges or subscriptions; an email is highly recommended for customer communications.

ActionInstant

Create an invoice

Creates a new draft stripe invoice for a customer; use to revise an existing invoice, bill for a specific subscription (which must belong to the customer), or apply detailed customizations.

ActionInstant

Create payment intent

Creates a stripe paymentintent to initiate and process a customer's payment; using `application fee amount` for a connected account requires the `stripe-account` header.

ActionInstant

Create a price

Creates a new stripe price for a product, defining its charges (one-time or recurring) and billing scheme; requires either an existing `product` id or `product data`.

ActionInstant

Create product

Creates a new product in stripe, encoding the request as `application/x-www-form-urlencoded` by flattening nested structures.

ActionInstant

Create Refund

Creates a full or partial refund in stripe, targeting either a specific charge id or a payment intent id.

ActionInstant

Connect any two apps with Notis in the middle.

Arize AX and Stripe, or any other combination from 1,000+ integrations.

When this happens · Trigger

Do this · Action

Save your first hour today.

7-day trial of any paid plan, with 20$ of usage included.
No card. Works with personal or business Stripe.