Keep a scheduled crawl of market websites
Let a recurring run gather pages from a defined set of market websites for later review.
Trigger
Recurring schedule
Notis starts this workflow on a schedule, such as daily, weekly, or during business hours.
Action
Start Site Crawl
Starts an asynchronous dataset or site crawl for later status checks and result retrieval.
Why this helps
Manually checking multiple market websites takes time and leaves important pages unchecked between reviews.
- Start a crawl on a predictable cadence
- Cover multiple pages or whole domains in one job
- Receive a run report with the crawl job reference
Setup
Build it in a few focused steps.
- 1Connect AgentQL and Bright Data once in the Notis portal.
- 2Create an automation in Automations, New Automation, and name it.
- 3In one instruction, describe which market websites AgentQL should identify and ask Bright Data to start a crawl for the resulting URLs.
- 4Pick the recurring schedule and choose where run reports should go.
- 5Test with one real set of market URLs.
Questions about this workflow
Does this workflow download the crawl results?
No. It starts an asynchronous crawl and reports the returned job reference. Checking status and downloading results are separate Bright Data actions.
What cadence should I use?
Choose a cadence that matches how often the sites meaningfully change and how frequently you want to review crawl jobs.
When this happens · Trigger
Do this · Action
Supported Triggers and Actions
Notis builds workflows that link Agentql to Brightdata. A trigger fires from one place; an action lands in another.
Agentql triggers
Brightdata actions
Recurring trigger
Notis starts this workflow on a schedule, such as daily, weekly, or during business hours.
Start Site Crawl
Starts an asynchronous dataset or site crawl for later status checks and result retrieval.
Webhook trigger
Notis starts this workflow when an external tool or custom backend sends an HTTP request.
Create Safe Zone
Filter Dataset
Creates a billable, filtered snapshot of a marketplace dataset.
List Marketplace Datasets
Lists prebuilt marketplace datasets for structured scraping.
Get Customer Balance
Retrieves current and pending account balances; the API key must have Admin permission.
Get Dataset Metadata
Retrieves the field definitions for a marketplace dataset.
Get Deep Lookup Results
List Unlocker Zones
Lists configured zones and their types for protected URL scraping.
Connect any two apps with Notis in the middle.
Agentql and Brightdata, or any other combination from 1,000+ integrations.
When this happens · Trigger
Do this · Action
Save your first hour today.
7-day trial of any paid plan, with 20$ of usage included.
No card. Works with personal or business Brightdata.