Turn submitted URLs into a site crawl
When a research request includes a list of URLs, send it to a Notis webhook to start a crawl and report the job details for follow-up.
Trigger
Webhook received
Notis starts this workflow when an external tool or custom backend sends an HTTP request.
Action
Trigger Site Crawl
Tool to trigger a site crawl job to extract content across multiple pages or entire domains. use when you need to start a crawl for a given dataset and list of urls.
Why this helps
URL lists sent for research can turn into untracked browsing chores with no clear collection job to resume.
- Start website collection from a submitted URL list.
- Use Bright Data to collect across pages or domains.
- Receive crawl job details in the run report.
Setup
Build it in a few focused steps.
- 1Connect Bright Data once in the Notis portal.
- 2Create an automation in Automations, New Automation, and give it a clear name.
- 3In one instruction, ask Notis to start a site crawl using URLs included in the webhook request and report the job details.
- 4Pick a webhook trigger and use its HTTP request entry point.
- 5Choose a report channel, then test by sending a request with one real URL list.
Questions about this workflow
Does the webhook request need URLs?
Yes. The instruction should ask Notis to skip the crawl and report that URLs are missing when none are supplied.
Does this download the collected pages?
No. This workflow starts a crawl. Status checks and data downloads use separate Bright Data actions.
What should I do with the reported job details?
Use them to track the crawl and follow up on the results through the relevant Bright Data actions.
When this happens · Trigger
Do this · Action
Supported Triggers and Actions
Notis builds workflows that link Jira to Brightdata. A trigger fires from one place; an action lands in another.
Jira triggers
Brightdata actions
Recurring trigger
Notis starts this workflow on a schedule, such as daily, weekly, or during business hours.
Trigger Site Crawl
Tool to trigger a site crawl job to extract content across multiple pages or entire domains. use when you need to start a crawl for a given dataset and list of urls.
Webhook trigger
Notis starts this workflow when an external tool or custom backend sends an HTTP request.
Browse Available Scrapers
Tool to list all available pre-made scrapers (datasets) from bright data's marketplace. use when you need to browse available data sources for structured scraping.
New Issue
Fires when a new issue is created in the Jira project you configure. Only issues created in that project produce an event.
Filter Dataset
Tool to apply custom filter criteria to a marketplace dataset (beta). use after selecting a dataset to generate a filtered snapshot.
New Project
Triggered when a new project is added in Jira
Get Available Cities
Tool to get available static network cities for a given country. use when you need to configure static proxy endpoints after selecting a country.
Updated Issue
Fires when an existing issue is changed in the Jira project you configure — for example its status, assignee, or any other field on the issue is updated. Only issues in that project produce an event. It does not fire on comment activity: adding, editing, or deleting a comment on an issue will not produce an event from this trigger.
Get Available Countries
Tool to list available countries and their iso 3166-1 alpha-2 codes. use when you need to configure zones with valid country codes before provisioning proxies.
Download Scraped Data
Tool to retrieve the scraped data from a completed crawl job by snapshot id. use after triggering a crawl or filtering a dataset to download the collected data.
Check Crawl Status
Tool to check the processing status of a crawl job using snapshot id. call before attempting to download results to ensure data collection is complete.
List Unlocker Zones
Tool to list your configured web unlocker zones and proxy endpoints. use to view available zones for web scraping and bot protection bypass.
Connect any two apps with Notis in the middle.
Jira and Brightdata, or any other combination from 1,000+ integrations.
When this happens · Trigger
Do this · Action
Save your first hour today.
7-day trial of any paid plan, with 20$ of usage included.
No card. Works with personal or business Brightdata.