Keep website research moving with scheduled crawls
Set a recurring schedule to start a crawl across the pages or domains you care about.
Trigger
Recurring schedule
Notis starts this workflow on a schedule, such as daily, weekly, or during business hours.
Action
Trigger Site Crawl
Why this helps
Starting recurring website research manually adds another task to remember and repeat.
- Start a crawl on a recurring schedule.
- Collect content across multiple pages or a domain.
- Use a prompt to describe the crawl outcome.
Setup
Build it in a few focused steps.
- 1Connect Agenty and Bright Data once in Notis.
- 2Create an automation and describe which URLs or domains the crawl should cover.
- 3Choose the Notis cron trigger and set the recurring schedule.
- 4Choose where Notis should send run reports.
- 5Test the automation with one real crawl example.
Questions about this workflow
Does the workflow decide which URLs to crawl?
The URLs or domains to crawl should be specified in your instruction or supplied by your process. The action starts a crawl for a given dataset and list of URLs.
Does this workflow download the crawl results automatically?
The selected action starts the crawl. Bright Data provides separate status and download actions for retrieving completed results.
Can I use a webhook instead of a schedule?
Yes. Use a Notis webhook trigger if an HTTP request should start the crawl.
When this happens · Trigger
Do this · Action
Supported Triggers and Actions
Notis builds workflows that link Agenty to Brightdata. A trigger fires from one place; an action lands in another.
Agenty triggers
Brightdata actions
Recurring trigger
Notis starts this workflow on a schedule, such as daily, weekly, or during business hours.
Start Site Crawl
Starts an asynchronous dataset or site crawl for later status checks and result retrieval.
Webhook trigger
Notis starts this workflow when an external tool or custom backend sends an HTTP request.
Create Safe Zone
Filter Dataset
Creates a billable, filtered snapshot of a marketplace dataset.
List Marketplace Datasets
Lists prebuilt marketplace datasets for structured scraping.
Get Customer Balance
Retrieves current and pending account balances; the API key must have Admin permission.
Get Dataset Metadata
Retrieves the field definitions for a marketplace dataset.
Get Deep Lookup Results
List Unlocker Zones
Lists configured zones and their types for protected URL scraping.
Connect any two apps with Notis in the middle.
Agenty and Brightdata, or any other combination from 1,000+ integrations.
When this happens · Trigger
Do this · Action
Save your first hour today.
7-day trial of any paid plan, with 20$ of usage included.
No card. Works with personal or business Brightdata.