Make dataset coverage easier to assess
Get a focused review of the datasets used in your AI work, with coverage questions ready for the next evaluation planning session.
Trigger
Recurring schedule
Notis starts this workflow on a schedule, such as daily, weekly, or during business hours.
Action
Create a File from Text
Creates a new file in google drive from provided text content (up to 10mb), supporting various formats including automatic conversion to google workspace types.
Why this helps
Dataset assumptions can go unexamined when the information is spread across evaluation work and project history.
- Put dataset observations in a document that is easy to share.
- Surface questions about representation and missing cases.
- Give evaluation planning a useful starting point.
Setup
Build it in a few focused steps.
- 1Connect Arize AX and Google Drive once in the Notis portal.
- 2Create an automation in Automations, New Automation.
- 3Tell Notis to summarize the specified Arize AX dataset's available composition and coverage, note questions without guessing, and save the review in Drive.
- 4Choose a recurring schedule and report channel, then test with one dataset.
Questions about this workflow
Can it determine whether a dataset is representative?
It can summarize available dataset details and highlight questions. You must provide the intended user population or coverage criteria for a meaningful assessment.
Will it alter the dataset?
No. This workflow creates a review document in Drive; it does not change Arize AX datasets.
When this happens · Trigger
Do this · Action
Supported Triggers and Actions
Notis builds workflows that link Arize AX to Google Drive. A trigger fires from one place; an action lands in another.
Arize AX triggers
Google Drive actions
Recurring trigger
Notis starts this workflow on a schedule, such as daily, weekly, or during business hours.
Add file sharing preference
Modifies sharing permissions for an existing google drive file, granting a specified role to a user, group, domain, or 'anyone'.
Webhook trigger
Notis starts this workflow when an external tool or custom backend sends an HTTP request.
Copy file
Duplicates an existing file in google drive, identified by its `file id`.
Create Comment
Tool to create a comment on a file. use when you need to add a new comment to a specific file in google drive.
Create Shared Drive
Tool to create a new shared drive. use when you need to programmatically create a new shared drive for collaboration or storage.
Create File or Folder
Creates a new file or folder with metadata. use to create empty files or folders, or files with content by providing it in the request body (though this action primarily focuses on metadata creation).
Create a File from Text
Creates a new file in google drive from provided text content (up to 10mb), supporting various formats including automatic conversion to google workspace types.
Create a folder
Creates a new folder in google drive, optionally within a parent folder specified by its id or name; if a parent name is provided but not found, the action will fail.
Create Reply
Tool to create a reply to a comment in google drive. use when you need to respond to an existing comment on a file.
Connect any two apps with Notis in the middle.
Arize AX and Google Drive, or any other combination from 1,000+ integrations.
When this happens · Trigger
Do this · Action
Save your first hour today.
7-day trial of any paid plan, with 20$ of usage included.
No card. Works with personal or business Google Drive.