Check crawl progress on a schedule
Set a recurring check for a crawl snapshot and get its latest status without repeated manual polling.
Trigger
Recurring schedule
Notis starts this workflow on a schedule, such as daily, weekly, or during business hours.
Action
Check Crawl Status
Tool to check the processing status of a crawl job using snapshot id. call before attempting to download results to ensure data collection is complete.
Why this helps
Waiting on a crawl often means remembering to check its status again and again.
- Check processing status on a recurring schedule.
- Get a run report with the latest snapshot state.
- Reduce repeated manual polling.
Setup
Build it in a few focused steps.
- 1Connect Bright Data in the Notis portal.
- 2Create an automation in Automations, New Automation, and name the snapshot check.
- 3Describe in one instruction how to check the supplied crawl snapshot ID and report its processing status.
- 4Pick a recurring schedule and choose where run reports should go.
- 5Test with one real snapshot ID and confirm the status appears in the report.
Questions about this workflow
Where does the snapshot ID come from?
Supply the snapshot ID in the automation instruction or webhook context available to your setup.
Does this download the crawl data?
No. It checks whether processing is complete. Downloading data is a separate Bright Data action.
When this happens · Trigger
Do this · Action
Supported Triggers and Actions
Notis builds workflows that link Google Drive to Brightdata. A trigger fires from one place; an action lands in another.
Google Drive triggers
Brightdata actions
Recurring trigger
Notis starts this workflow on a schedule, such as daily, weekly, or during business hours.
Trigger Site Crawl
Tool to trigger a site crawl job to extract content across multiple pages or entire domains. use when you need to start a crawl for a given dataset and list of urls.
Webhook trigger
Notis starts this workflow when an external tool or custom backend sends an HTTP request.
Browse Available Scrapers
Tool to list all available pre-made scrapers (datasets) from bright data's marketplace. use when you need to browse available data sources for structured scraping.
Comment Added (Docs/Sheets/Slides)
Triggers when a new comment is added to Google Docs, Sheets, or Slides.
Filter Dataset
Tool to apply custom filter criteria to a marketplace dataset (beta). use after selecting a dataset to generate a filtered snapshot.
File Created
Triggers when a new file is created in Google Drive.
Get Available Cities
Tool to get available static network cities for a given country. use when you need to configure static proxy endpoints after selecting a country.
File Deleted or Trashed
Triggers when a file is moved to trash or permanently deleted in Drive.
Get Available Countries
Tool to list available countries and their iso 3166-1 alpha-2 codes. use when you need to configure zones with valid country codes before provisioning proxies.
File Shared (Permissions Added)
Triggers when new sharing permissions are granted to a file or folder. Uses Drive's `changes.list` endpoint with inline `permissions` in the `fields` mask so each change carries the file's current permission set provider-atomically. We diff that against `seen_permission_keys` to identify newly added grants. Drive page tokens are the primary cursor; if Drive rejects a stored token, the trigger raises `PollingTriggerError` without clearing state rather than silently re-baselining and dropping events. Limitation: truly ephemeral permissions (added and revoked between two polls without any other file modification in between) are not detected. Drive Activity API would catch those but requires an additional OAuth scope and a different payload contract.
Download Scraped Data
Tool to retrieve the scraped data from a completed crawl job by snapshot id. use after triggering a crawl or filtering a dataset to download the collected data.
File Updated
Triggers when a file's metadata or content changes in Google Drive.
Check Crawl Status
Tool to check the processing status of a crawl job using snapshot id. call before attempting to download results to ensure data collection is complete.
Google Drive Changes
Triggers when changes are detected in a Google Drive.
List Unlocker Zones
Tool to list your configured web unlocker zones and proxy endpoints. use to view available zones for web scraping and bot protection bypass.
Connect any two apps with Notis in the middle.
Google Drive and Brightdata, or any other combination from 1,000+ integrations.
When this happens · Trigger
Do this · Action
Save your first hour today.
7-day trial of any paid plan, with 20$ of usage included.
No card. Works with personal or business Brightdata.