Check whether your crawl results are ready
Find out whether a research crawl is still running or ready for the next step.
Trigger
Webhook received
Notis starts this workflow when an external tool or custom backend sends an HTTP request.
Action
Check Crawl Status
Why this helps
Without a status check, teams may try to use crawl results before collection is complete.
- Checks the status of a crawl by snapshot ID
- Clarifies whether collection is still running
- Helps prevent premature result downloads
Setup
Build it in a few focused steps.
- 1Connect Agility CMS and Bright Data once in Notis.
- 2Create an automation for crawl status checks.
- 3Tell Notis to check the Bright Data crawl status for the snapshot ID in the request and report its state.
- 4Pick the webhook trigger and choose where run reports go.
- 5Test with one real snapshot ID.
Questions about this workflow
Where does the snapshot ID come from?
It comes from a Bright Data crawl or snapshot start action and must be included in the request.
Can this action download results?
No. It checks status. Use a download action after the snapshot is ready.
When this happens · Trigger
Do this · Action
Supported Triggers and Actions
Notis builds workflows that link Agility cms to Brightdata. A trigger fires from one place; an action lands in another.
Agility cms triggers
Brightdata actions
Recurring trigger
Notis starts this workflow on a schedule, such as daily, weekly, or during business hours.
Start Site Crawl
Starts an asynchronous dataset or site crawl for later status checks and result retrieval.
Webhook trigger
Notis starts this workflow when an external tool or custom backend sends an HTTP request.
Create Safe Zone
Filter Dataset
Creates a billable, filtered snapshot of a marketplace dataset.
List Marketplace Datasets
Lists prebuilt marketplace datasets for structured scraping.
Get Customer Balance
Retrieves current and pending account balances; the API key must have Admin permission.
Get Dataset Metadata
Retrieves the field definitions for a marketplace dataset.
Get Deep Lookup Results
List Unlocker Zones
Lists configured zones and their types for protected URL scraping.
Connect any two apps with Notis in the middle.
Agility cms and Brightdata, or any other combination from 1,000+ integrations.
When this happens · Trigger
Do this · Action
Save your first hour today.
7-day trial of any paid plan, with 20$ of usage included.
No card. Works with personal or business Brightdata.