Start a website crawl from a WhatsApp request
Turn a request to review a site into a crawl job, without copying URLs between chat and research tools.
Trigger
Webhook received
Notis starts this workflow when an external tool or custom backend sends an HTTP request.
Action
Trigger Site Crawl
Tool to trigger a site crawl job to extract content across multiple pages or entire domains. use when you need to start a crawl for a given dataset and list of urls.
Why this helps
Collecting content across a company site means opening pages one by one and losing track of the original research request.
- Start a crawl using URLs included in the webhook request.
- Collect content across multiple pages or a domain with one automation.
- Keep the research request and its crawl run report tied to the same workflow.
Setup
Build it in a few focused steps.
- 1Connect 2chat and Brightdata once in the Notis portal.
- 2Create a new automation in Automations, or tell Notis in plain language from any channel.
- 3In one instruction, ask Notis to start a Brightdata crawl for the domain or URLs supplied in the webhook request.
- 4Pick the webhook trigger and choose where run reports should go.
- 5Test with one real domain or URL list sent through your 2chat webhook.
Questions about this workflow
Can this crawl any website?
A crawl can be started for the supplied URLs or domain, subject to Brightdata availability and the site's access conditions.
Does the workflow return completed crawl data immediately?
No. This action starts a crawl job. Use a separate workflow or follow-up process to check its status and retrieve data after it completes.
Do I need to provide URLs in the request?
Provide the domain or URLs you want crawled. Notis cannot infer a specific target site from a chat that is not included in the webhook request or instruction.
When this happens · Trigger
Do this · Action
Supported Triggers and Actions
Notis builds workflows that link 2chat to Brightdata. A trigger fires from one place; an action lands in another.
2chat triggers
Brightdata actions
Recurring trigger
Notis starts this workflow on a schedule, such as daily, weekly, or during business hours.
Trigger Site Crawl
Tool to trigger a site crawl job to extract content across multiple pages or entire domains. use when you need to start a crawl for a given dataset and list of urls.
Webhook trigger
Notis starts this workflow when an external tool or custom backend sends an HTTP request.
Browse Available Scrapers
Tool to list all available pre-made scrapers (datasets) from bright data's marketplace. use when you need to browse available data sources for structured scraping.
Filter Dataset
Tool to apply custom filter criteria to a marketplace dataset (beta). use after selecting a dataset to generate a filtered snapshot.
Get Available Cities
Tool to get available static network cities for a given country. use when you need to configure static proxy endpoints after selecting a country.
Get Available Countries
Tool to list available countries and their iso 3166-1 alpha-2 codes. use when you need to configure zones with valid country codes before provisioning proxies.
Download Scraped Data
Tool to retrieve the scraped data from a completed crawl job by snapshot id. use after triggering a crawl or filtering a dataset to download the collected data.
Check Crawl Status
Tool to check the processing status of a crawl job using snapshot id. call before attempting to download results to ensure data collection is complete.
List Unlocker Zones
Tool to list your configured web unlocker zones and proxy endpoints. use to view available zones for web scraping and bot protection bypass.
Connect any two apps with Notis in the middle.
2chat and Brightdata, or any other combination from 1,000+ integrations.
When this happens · Trigger
Do this · Action
Save your first hour today.
7-day trial of any paid plan, with 20$ of usage included.
No card. Works with personal or business Brightdata.