Skip to content
Notis

Watch crawl readiness on a schedule

Keep long-running collection jobs visible without repeatedly checking their status yourself.

Trigger

Recurring schedule

Notis starts this workflow on a schedule, such as daily, weekly, or during business hours.

Action

Check Crawl Status

Tool to check the processing status of a crawl job using snapshot id. call before attempting to download results to ensure data collection is complete.

Why this helps

Long crawls are easy to forget, delaying the analysis that depends on them.

  • Reduce waiting uncertainty
  • Surface completed jobs
  • Keep analysis queues moving

Setup

Build it in a few focused steps.

  • 1Connect 0CodeKit and Brightdata in Notis once.
  • 2Create an automation named Scheduled crawl readiness watch.
  • 3Tell Notis to check the supplied active snapshot ids and list any that are ready.
  • 4Choose notis_cron, set the cadence, and select a report channel.
  • 5Run one watch cycle with active snapshot ids.

Questions about this workflow

How does it know which jobs to check?

Supply the active snapshot ids in the automation context.

Can it alert only when complete?

Yes. Instruct Notis to report only completed or failed statuses.

When this happens · Trigger

Do this · Action

Supported Triggers and Actions

Notis builds workflows that link 0CodeKit to Brightdata. A trigger fires from one place; an action lands in another.

0CodeKit triggers

Brightdata actions

Recurring trigger

Notis starts this workflow on a schedule, such as daily, weekly, or during business hours.

TriggerScheduled

Trigger Site Crawl

Tool to trigger a site crawl job to extract content across multiple pages or entire domains. use when you need to start a crawl for a given dataset and list of urls.

ActionInstant

Webhook trigger

Notis starts this workflow when an external tool or custom backend sends an HTTP request.

TriggerInstant

Browse Available Scrapers

Tool to list all available pre-made scrapers (datasets) from bright data's marketplace. use when you need to browse available data sources for structured scraping.

ActionInstant

Filter Dataset

Tool to apply custom filter criteria to a marketplace dataset (beta). use after selecting a dataset to generate a filtered snapshot.

ActionInstant

Get Available Cities

Tool to get available static network cities for a given country. use when you need to configure static proxy endpoints after selecting a country.

ActionInstant

Get Available Countries

Tool to list available countries and their iso 3166-1 alpha-2 codes. use when you need to configure zones with valid country codes before provisioning proxies.

ActionInstant

Download Scraped Data

Tool to retrieve the scraped data from a completed crawl job by snapshot id. use after triggering a crawl or filtering a dataset to download the collected data.

ActionInstant

Check Crawl Status

Tool to check the processing status of a crawl job using snapshot id. call before attempting to download results to ensure data collection is complete.

ActionInstant

List Unlocker Zones

Tool to list your configured web unlocker zones and proxy endpoints. use to view available zones for web scraping and bot protection bypass.

ActionInstant

Connect any two apps with Notis in the middle.

0CodeKit and Brightdata, or any other combination from 1,000+ integrations.

When this happens · Trigger

Do this · Action

Save your first hour today.

7-day trial of any paid plan, with 20$ of usage included.
No card. Works with personal or business Brightdata.