Skip to content
Notis

Start a website crawl from an incoming request

Kick off a multi-page crawl without turning the request into a manual setup task.

Trigger

Webhook received

Notis starts this workflow when an external tool or custom backend sends an HTTP request.

Action

Start Site Crawl

Starts an asynchronous dataset or site crawl for later status checks and result retrieval.

Why this helps

A large site review can stall when someone has to start the crawl and remember how to retrieve it later.

  • Start an asynchronous dataset or site crawl from submitted URLs.
  • Capture the returned snapshot ID in the run report.
  • Create a clear handoff for status checking and result download.

Setup

Build it in a few focused steps.

  • 1Connect Ai ml api and Brightdata once in the Notis portal.
  • 2Create an automation in Automations, New Automation, and name it.
  • 3Tell Notis to start a Brightdata crawl for the submitted dataset and URL list, then report the snapshot ID.
  • 4Pick the webhook trigger and choose where run reports should go.
  • 5Test with one real crawl request and confirm the snapshot ID is reported.

Questions about this workflow

Are crawl results included immediately?

No. This action starts an asynchronous crawl. Use the snapshot ID to check status, then download results when ready.

Which Brightdata action checks the snapshot?

Check Snapshot Status uses action 46883, and Download Snapshot Results uses action 46882.

When this happens · Trigger

Do this · Action

Supported Triggers and Actions

Notis builds workflows that link Ai ml api to Brightdata. A trigger fires from one place; an action lands in another.

Ai ml api triggers

Brightdata actions

Recurring trigger

Notis starts this workflow on a schedule, such as daily, weekly, or during business hours.

TriggerScheduled

Start Site Crawl

Starts an asynchronous dataset or site crawl for later status checks and result retrieval.

ActionInstant

Webhook trigger

Notis starts this workflow when an external tool or custom backend sends an HTTP request.

TriggerInstant

Create Safe Zone

ActionInstant

Filter Dataset

Creates a billable, filtered snapshot of a marketplace dataset.

ActionInstant

List Marketplace Datasets

Lists prebuilt marketplace datasets for structured scraping.

ActionInstant

Get Customer Balance

Retrieves current and pending account balances; the API key must have Admin permission.

ActionInstant

Get Dataset Metadata

Retrieves the field definitions for a marketplace dataset.

ActionInstant

Get Deep Lookup Results

ActionInstant

List Unlocker Zones

Lists configured zones and their types for protected URL scraping.

ActionInstant

Connect any two apps with Notis in the middle.

Ai ml api and Brightdata, or any other combination from 1,000+ integrations.

When this happens · Trigger

Do this · Action

Save your first hour today.

7-day trial of any paid plan, with 20$ of usage included.
No card. Works with personal or business Brightdata.