Start large URL research batches from a webhook
Send a batch of URLs to a Notis webhook and let Diffbot begin processing them asynchronously.
Trigger
Webhook received
Notis starts this workflow when an external tool or custom backend sends an HTTP request.
Action
Start Bulk Job
Tool to start a bulk extract job. use when processing large numbers of urls asynchronously.
Why this helps
Pasting long URL lists into separate research tools creates busywork and makes batch research easy to postpone.
- Start asynchronous extraction for a supplied batch of URLs.
- Reduce manual submission steps for recurring research requests.
- Use a webhook as a simple intake point for batch work.
Setup
Build it in a few focused steps.
- 1Connect Diffbot once in the Notis portal.
- 2Create an automation in Automations, New Automation, and provide a name and prompt.
- 3Tell Notis to start a Diffbot bulk extract job for the URLs included in the incoming HTTP request.
- 4Pick a webhook as the trigger and choose where run reports should go.
- 5Test by sending one real request with a small set of accessible URLs.
Questions about this workflow
Does the job finish immediately?
No. Bulk extraction runs asynchronously. Use the returned job details to track progress through the available Diffbot tools.
What should the request contain?
Include the URLs to process and any context needed to decide that this batch should be started.
When this happens · Trigger
Do this · Action
Supported Triggers and Actions
Notis builds workflows that link Whatsapp to Diffbot. A trigger fires from one place; an action lands in another.
Whatsapp triggers
Diffbot actions
Recurring trigger
Notis starts this workflow on a schedule, such as daily, weekly, or during business hours.
Diffbot Search
Tool to search data extracted by crawl or bulk jobs using dql queries. use after data extraction jobs complete to retrieve search results.
Webhook trigger
Notis starts this workflow when an external tool or custom backend sends an HTTP request.
Get Diffbot Account Details
Tool to retrieve account details, including plan information and usage statistics. use after authenticating to verify subscription and daily quota status.
Message Status Updated
Triggers when a WhatsApp message status changes. IMPORTANT LIMITATION: WhatsApp Cloud API does not provide a native polling endpoint for message status. Status updates are ONLY delivered via webhooks in real-time. This trigger cannot directly poll the WhatsApp API for status updates. This trigger will return empty results as WhatsApp does not support this operation. To track message status updates, you must: 1. Set up a webhook endpoint to receive status notifications from WhatsApp 2. Store the webhook data in your own database 3. Use a different mechanism to query your stored webhook data For more information, see: - https://developers.facebook.com/docs/whatsapp/cloud-api/webhooks
Diffbot Analyze
Tool to automatically determine a page's content type and route it to the appropriate extraction api. use when you have only a url and need diffbot to choose the right extractor.
New Message Received
Triggered in real time when your WhatsApp Business number receives an inbound message from a customer (text, media, location, or contact). Delivered via the Cloud API webhook.
Get Article Data
Tool to extract information from articles, including authors, publication dates, and images. use when you need structured metadata from a web article url.
Interactive Reply Received
Triggered when a customer taps a quick-reply button or selects an option from an interactive list message you sent.
Get Discussion Thread
Tool to extract threads of content from forums, comment sections, and review pages. use when you need structured discussion data from web pages after identifying the discussion url.
Message Template Status Update
Triggered when the review status of a WhatsApp message template changes — for example approved, rejected, or flagged — on your WhatsApp Business Account.
Diffbot Get Event
Tool to extract event details from web pages. use when you need structured event data such as venue, date, and description.
Diffbot Get Image
Tool to extract detailed information about images, including dimensions and recognition data. use after confirming the image url is publicly accessible.
Diffbot Get Product
Tool to extract product information such as specifications, prices, availability, and reviews. use when you need structured product data including specs, pricing, and reviews.
Connect any two apps with Notis in the middle.
Whatsapp and Diffbot, or any other combination from 1,000+ integrations.
When this happens · Trigger
Do this · Action
Save your first hour today.
7-day trial of any paid plan, with 20$ of usage included.
No card. Works with personal or business Diffbot.