Schedule crawls for competitor URLs in Drive
Keep your competitor URL list in Drive and let a recurring run start a crawl across those pages.
Trigger
Recurring schedule
Notis starts this workflow on a schedule, such as daily, weekly, or during business hours.
Action
Trigger Site Crawl
Tool to trigger a site crawl job to extract content across multiple pages or entire domains. use when you need to start a crawl for a given dataset and list of urls.
Why this helps
Repeatedly launching competitor crawls from a scattered URL list creates busywork and makes routine checks easy to miss.
- Use a Drive-maintained URL list as the crawl source.
- Start recurring crawl jobs on a chosen schedule.
- Keep job details available in run reports.
Setup
Build it in a few focused steps.
- 1Connect Google Drive and Bright Data once in the Notis portal.
- 2Create an automation in Automations, New Automation, and name the scheduled crawl.
- 3Describe in one instruction how to find competitor URLs in Drive, start a crawl, and report its job details.
- 4Pick a recurring schedule and choose where run reports should go.
- 5Test with one real URL list and confirm the crawl starts.
Questions about this workflow
Does this download crawl results automatically?
No. This workflow starts a site crawl and reports job details. Checking status and downloading data are separate Bright Data actions.
Where do the URLs come from?
Keep the competitor URLs in a Drive file and tell Notis how to locate that list in your instruction.
When this happens · Trigger
Do this · Action
Supported Triggers and Actions
Notis builds workflows that link Google Drive to Brightdata. A trigger fires from one place; an action lands in another.
Google Drive triggers
Brightdata actions
Recurring trigger
Notis starts this workflow on a schedule, such as daily, weekly, or during business hours.
Trigger Site Crawl
Tool to trigger a site crawl job to extract content across multiple pages or entire domains. use when you need to start a crawl for a given dataset and list of urls.
Webhook trigger
Notis starts this workflow when an external tool or custom backend sends an HTTP request.
Browse Available Scrapers
Tool to list all available pre-made scrapers (datasets) from bright data's marketplace. use when you need to browse available data sources for structured scraping.
Comment Added (Docs/Sheets/Slides)
Triggers when a new comment is added to Google Docs, Sheets, or Slides.
Filter Dataset
Tool to apply custom filter criteria to a marketplace dataset (beta). use after selecting a dataset to generate a filtered snapshot.
File Created
Triggers when a new file is created in Google Drive.
Get Available Cities
Tool to get available static network cities for a given country. use when you need to configure static proxy endpoints after selecting a country.
File Deleted or Trashed
Triggers when a file is moved to trash or permanently deleted in Drive.
Get Available Countries
Tool to list available countries and their iso 3166-1 alpha-2 codes. use when you need to configure zones with valid country codes before provisioning proxies.
File Shared (Permissions Added)
Triggers when new sharing permissions are granted to a file or folder. Uses Drive's `changes.list` endpoint with inline `permissions` in the `fields` mask so each change carries the file's current permission set provider-atomically. We diff that against `seen_permission_keys` to identify newly added grants. Drive page tokens are the primary cursor; if Drive rejects a stored token, the trigger raises `PollingTriggerError` without clearing state rather than silently re-baselining and dropping events. Limitation: truly ephemeral permissions (added and revoked between two polls without any other file modification in between) are not detected. Drive Activity API would catch those but requires an additional OAuth scope and a different payload contract.
Download Scraped Data
Tool to retrieve the scraped data from a completed crawl job by snapshot id. use after triggering a crawl or filtering a dataset to download the collected data.
File Updated
Triggers when a file's metadata or content changes in Google Drive.
Check Crawl Status
Tool to check the processing status of a crawl job using snapshot id. call before attempting to download results to ensure data collection is complete.
Google Drive Changes
Triggers when changes are detected in a Google Drive.
List Unlocker Zones
Tool to list your configured web unlocker zones and proxy endpoints. use to view available zones for web scraping and bot protection bypass.
Connect any two apps with Notis in the middle.
Google Drive and Brightdata, or any other combination from 1,000+ integrations.
When this happens · Trigger
Do this · Action
Save your first hour today.
7-day trial of any paid plan, with 20$ of usage included.
No card. Works with personal or business Brightdata.