Collect structured data across a site from seed URLs
Give Notis the starting pages and context, then let Diffbot crawl links and process the site into a collection.
Trigger
Webhook received
Notis starts this workflow when an external tool or custom backend sends an HTTP request.
Action
Start Crawl Job
Starts a crawl job to collect structured data from pages across a website.
Why this helps
Researching a site page by page makes it easy to miss useful linked pages and hard to keep the collection coherent.
- Starts a crawl from submitted seed URLs.
- Collects structured data across linked pages into one collection.
- Keeps the crawl request tied to its supplied context.
Setup
Build it in a few focused steps.
- 1Connect Abstract and Diffbot once in the Notis portal.
- 2Create an automation in Automations, New Automation, and name it.
- 3Describe the seed URLs and desired structured collection in one instruction.
- 4Choose a webhook trigger and where run reports should go.
- 5Test with real seed URLs and confirm your Diffbot plan supports crawl API access.
Questions about this workflow
Does site crawling require a particular plan?
Diffbot Start Crawl Job requires a Plus plan for crawl API access.
What should I submit?
Provide seed URLs and the intended research context. The crawl processes links from those seeds into a collection.
When this happens · Trigger
Do this · Action
Supported Triggers and Actions
Notis builds workflows that link Abstract to Diffbot. A trigger fires from one place; an action lands in another.
Abstract triggers
Diffbot actions
Recurring trigger
Notis starts this workflow on a schedule, such as daily, weekly, or during business hours.
Combine Entity Profiles
Webhook trigger
Notis starts this workflow when an external tool or custom backend sends an HTTP request.
Get Diffbot Account Details
Retrieves account details, credit balance, and usage statistics.
Create Bulk Extract Job
Diffbot Analyze
Analyzes a web page, identifies its type, and extracts structured data.
Create or Update Custom API
Get Article Data
Extracts structured information such as authors and publication dates from an article.
Create Bulk Enhance Job
Get Discussion Thread
Extracts posts and their relationships from a web discussion thread.
Connect any two apps with Notis in the middle.
Abstract and Diffbot, or any other combination from 1,000+ integrations.
When this happens · Trigger
Do this · Action
Save your first hour today.
7-day trial of any paid plan, with 20$ of usage included.
No card. Works with personal or business Diffbot.