Skip to content
Notis

Start recurring dataset crawls without manual setup each time

Put a repeatable crawl start on a schedule, then follow its snapshot through completion and download.

Trigger

Recurring schedule

Notis starts this workflow on a schedule, such as daily, weekly, or during business hours.

Action

Start Site Crawl

Starts an asynchronous dataset or site crawl for later status checks and result retrieval.

Why this helps

Recurring data collection can turn into a chain of manual starts, status checks, and missed follow-ups.

  • Start asynchronous dataset or site crawls on a schedule.
  • Use the returned snapshot ID for later status checks.
  • Keep the crawl start separate from later result retrieval.

Setup

Build it in a few focused steps.

  • 1Connect Agenty and Bright Data once in Notis.
  • 2Create an automation and describe the dataset or site crawl to start.
  • 3Choose the Notis cron trigger and set the recurring schedule.
  • 4Choose where Notis should send run reports.
  • 5Test with one real dataset or site crawl.

Questions about this workflow

What does this action return?

It starts an asynchronous dataset or site crawl and returns a snapshot ID.

How do I know when the crawl is complete?

Poll the snapshot ID with Bright Data's snapshot status action, then download the results when ready.

Can this action itself download results?

No. It starts the crawl. Status checking and downloading are separate actions.

When this happens · Trigger

Do this · Action

Supported Triggers and Actions

Notis builds workflows that link Agenty to Brightdata. A trigger fires from one place; an action lands in another.

Agenty triggers

Brightdata actions

Recurring trigger

Notis starts this workflow on a schedule, such as daily, weekly, or during business hours.

TriggerScheduled

Start Site Crawl

Starts an asynchronous dataset or site crawl for later status checks and result retrieval.

ActionInstant

Webhook trigger

Notis starts this workflow when an external tool or custom backend sends an HTTP request.

TriggerInstant

Create Safe Zone

ActionInstant

Filter Dataset

Creates a billable, filtered snapshot of a marketplace dataset.

ActionInstant

List Marketplace Datasets

Lists prebuilt marketplace datasets for structured scraping.

ActionInstant

Get Customer Balance

Retrieves current and pending account balances; the API key must have Admin permission.

ActionInstant

Get Dataset Metadata

Retrieves the field definitions for a marketplace dataset.

ActionInstant

Get Deep Lookup Results

ActionInstant

List Unlocker Zones

Lists configured zones and their types for protected URL scraping.

ActionInstant

Connect any two apps with Notis in the middle.

Agenty and Brightdata, or any other combination from 1,000+ integrations.

When this happens · Trigger

Do this · Action

Save your first hour today.

7-day trial of any paid plan, with 20$ of usage included.
No card. Works with personal or business Brightdata.