Skip to content
Notis

Start Site Crawls from a Drive Seed List

Keep site seeds in Drive and start a crawl job when a new list is ready for broader research.

Trigger

File Created

Triggers when a new file is created in Google Drive.

Action

Start Crawl Job

Tool to spider a site for links and process them with the extract api into a single collection. use when you have seed urls and want to collect structured data across a site. requires a plus plan for crawl api access.

Why this helps

Expanding research from a handful of seed pages can take repetitive link discovery and manual extraction work.

  • Start a crawl job from seed URLs saved in a new file.
  • Collect structured data across a site through Diffbot's crawl API.
  • Use a Drive file as the handoff for a new research batch.

Setup

Build it in a few focused steps.

  • 1Connect Google Drive and Diffbot once in the Notis portal.
  • 2Create an automation named Crawl Sites from Drive Seeds.
  • 3Tell Notis to read seed URLs from each new file and use Diffbot Start Crawl Job to process the sites into a collection.
  • 4Choose File Created as the trigger and select where run reports should go.
  • 5Test with one real seed URL and confirm the account has crawl API access.

Questions about this workflow

Does the crawl action work on every Diffbot plan?

The listed action requires a Plus plan for crawl API access.

What should the file contain?

Include seed URLs for the sites you want Diffbot to crawl.

When this happens · Trigger

Do this · Action

Supported Triggers and Actions

Notis builds workflows that link Google Drive to Diffbot. A trigger fires from one place; an action lands in another.

Google Drive triggers

Diffbot actions

Recurring trigger

Notis starts this workflow on a schedule, such as daily, weekly, or during business hours.

TriggerScheduled

Diffbot Search

Tool to search data extracted by crawl or bulk jobs using dql queries. use after data extraction jobs complete to retrieve search results.

ActionInstant

Webhook trigger

Notis starts this workflow when an external tool or custom backend sends an HTTP request.

TriggerInstant

Get Diffbot Account Details

Tool to retrieve account details, including plan information and usage statistics. use after authenticating to verify subscription and daily quota status.

ActionInstant

Comment Added (Docs/Sheets/Slides)

Triggers when a new comment is added to Google Docs, Sheets, or Slides.

TriggerPolling

Diffbot Analyze

Tool to automatically determine a page's content type and route it to the appropriate extraction api. use when you have only a url and need diffbot to choose the right extractor.

ActionInstant

File Created

Triggers when a new file is created in Google Drive.

TriggerPolling

Get Article Data

Tool to extract information from articles, including authors, publication dates, and images. use when you need structured metadata from a web article url.

ActionInstant

File Deleted or Trashed

Triggers when a file is moved to trash or permanently deleted in Drive.

TriggerPolling

Get Discussion Thread

Tool to extract threads of content from forums, comment sections, and review pages. use when you need structured discussion data from web pages after identifying the discussion url.

ActionInstant

File Shared (Permissions Added)

Triggers when new sharing permissions are granted to a file or folder. Uses Drive's `changes.list` endpoint with inline `permissions` in the `fields` mask so each change carries the file's current permission set provider-atomically. We diff that against `seen_permission_keys` to identify newly added grants. Drive page tokens are the primary cursor; if Drive rejects a stored token, the trigger raises `PollingTriggerError` without clearing state rather than silently re-baselining and dropping events. Limitation: truly ephemeral permissions (added and revoked between two polls without any other file modification in between) are not detected. Drive Activity API would catch those but requires an additional OAuth scope and a different payload contract.

TriggerPolling

Diffbot Get Event

Tool to extract event details from web pages. use when you need structured event data such as venue, date, and description.

ActionInstant

File Updated

Triggers when a file's metadata or content changes in Google Drive.

TriggerPolling

Diffbot Get Image

Tool to extract detailed information about images, including dimensions and recognition data. use after confirming the image url is publicly accessible.

ActionInstant

Google Drive Changes

Triggers when changes are detected in a Google Drive.

TriggerPolling

Diffbot Get Product

Tool to extract product information such as specifications, prices, availability, and reviews. use when you need structured product data including specs, pricing, and reviews.

ActionInstant

Connect any two apps with Notis in the middle.

Google Drive and Diffbot, or any other combination from 1,000+ integrations.

When this happens · Trigger

Do this · Action

Save your first hour today.

7-day trial of any paid plan, with 20$ of usage included.
No card. Works with personal or business Diffbot.