Launch site crawls from a webhook
Give your research tools a clean handoff into a managed site crawl.
Trigger
Webhook received
Notis starts this workflow when an external tool or custom backend sends an HTTP request.
Action
Start Crawl Job
Tool to spider a site for links and process them with the extract api into a single collection. use when you have seed urls and want to collect structured data across a site. requires a plus plan for crawl api access.
Why this helps
A crawl request can wait in a queue because nobody starts the job at the right time.
- Start crawls from existing tools
- Keep crawl requests consistent
- Capture job IDs for follow up
Setup
Build it in a few focused steps.
- 1Connect Diffbot in Notis.
- 2Create an automation named Webhook site crawl launch.
- 3Tell Notis to start a Diffbot crawl for the public seed URL and scope supplied in the webhook, then report the job identifier.
- 4Choose a Notis webhook trigger and select a report channel.
- 5Test with one approved public seed URL.
Questions about this workflow
Is crawl access available on every plan?
Diffbot Crawl requires a plan that supports the Crawl API.
Can it crawl private sites?
The seed and pages must be accessible to Diffbot.
When this happens · Trigger
Do this · Action
Supported Triggers and Actions
Notis builds workflows that link Google Super to Diffbot. A trigger fires from one place; an action lands in another.
Google Super triggers
Diffbot actions
Recurring trigger
Notis starts this workflow on a schedule, such as daily, weekly, or during business hours.
Diffbot Search
Tool to search data extracted by crawl or bulk jobs using dql queries. use after data extraction jobs complete to retrieve search results.
Webhook trigger
Notis starts this workflow when an external tool or custom backend sends an HTTP request.
Get Diffbot Account Details
Tool to retrieve account details, including plan information and usage statistics. use after authenticating to verify subscription and daily quota status.
Aggregate Metric Changed
Triggers when an aggregate metric (SUM/COUNT/AVG/MIN/MAX) changes in a Google Sheets spreadsheet. This trigger monitors an aggregate calculation on a target column (optionally filtered by a search column/value) and fires when the calculated result changes.
Diffbot Analyze
Tool to automatically determine a page's content type and route it to the appropriate extraction api. use when you have only a url and need diffbot to choose the right extractor.
Attendee Response Changed
Polling trigger that fires when any attendee's RSVP changes to accepted, declined, or tentative. Returns attendee info and current status.
Get Article Data
Tool to extract information from articles, including authors, publication dates, and images. use when you need structured metadata from a web article url.
Cell Range Values Changed
Triggers when values in a specified A1 range change in Google Sheets. This trigger monitors a specific cell or range of cells and fires when any values change.
Get Discussion Thread
Tool to extract threads of content from forums, comment sections, and review pages. use when you need structured discussion data from web pages after identifying the discussion url.
Comment Added (Docs/Sheets/Slides)
Triggers when a new comment is added to Google Docs, Sheets, or Slides.
Diffbot Get Event
Tool to extract event details from web pages. use when you need structured event data such as venue, date, and description.
Conditional Format Rule Changed
Triggers when conditional formatting rules change in a Google Spreadsheet. Detects when rules are added, updated, or removed. Uses snapshot-based diffing to detect changes between polls.
Diffbot Get Image
Tool to extract detailed information about images, including dimensions and recognition data. use after confirming the image url is publicly accessible.
Data Validation Rule Changed
Triggers when data validation rules change (added/updated/removed) in a Google Spreadsheet. Uses snapshot-based diffing to detect changes between polls.
Diffbot Get Product
Tool to extract product information such as specifications, prices, availability, and reviews. use when you need structured product data including specs, pricing, and reviews.
Connect any two apps with Notis in the middle.
Google Super and Diffbot, or any other combination from 1,000+ integrations.
When this happens · Trigger
Do this · Action
Save your first hour today.
7-day trial of any paid plan, with 20$ of usage included.
No card. Works with personal or business Diffbot.