Crawl partner sites for Adtraction research
Collect structured information across chosen partner sites from a small set of seed URLs.
Trigger
Recurring schedule
Notis starts this workflow on a schedule, such as daily, weekly, or during business hours.
Action
Start Crawl Job
Starts a crawl job to collect structured data from pages across a website.
Why this helps
Checking each page on a partner site individually turns basic research into repetitive browsing.
- Start a crawl from seed URLs on a schedule.
- Collect structured data across a site.
- Reduce repeated page-by-page research.
Setup
Build it in a few focused steps.
- 1Connect Adtraction and Diffbot once in the Notis portal.
- 2Create an automation in Automations, New Automation, or tell Notis what outcome to produce from any channel.
- 3Ask Notis to start a Diffbot crawl job from the supplied partner site seed URLs and summarize the submitted job details.
- 4Choose the notis_cron trigger and select the schedule and run report destination.
- 5Test with one real seed URL and check that the account can use the Crawl API.
Questions about this workflow
What does a crawl job do?
It spiders a site from seed URLs, follows links, and processes pages with an extract API into a collection.
Is this available on every Diffbot plan?
The Crawl API requires a Plus plan.
Does the scheduled run return all crawl data immediately?
This action starts a crawl job. Retrieve its collected data after the job completes.
When this happens · Trigger
Do this · Action
Supported Triggers and Actions
Notis builds workflows that link Adtraction to Diffbot. A trigger fires from one place; an action lands in another.
Adtraction triggers
Diffbot actions
Recurring trigger
Notis starts this workflow on a schedule, such as daily, weekly, or during business hours.
Combine Entity Profiles
Combines entity profiles into an enriched unified view using the Knowledge Graph.
Webhook trigger
Notis starts this workflow when an external tool or custom backend sends an HTTP request.
Get Diffbot Account Details
Retrieves account details, credit balance, and usage statistics.
Create Bulk Extract Job
Submits a bulk URL extraction job that runs in the background and provides downloadable results.
Diffbot Analyze
Analyzes a web page, identifies its type, and extracts structured data.
Create or Update Custom API
Creates or updates a Custom API with tailored website extraction rules.
Get Article Data
Extracts structured information such as authors and publication dates from an article.
Create Bulk Enhance Job
Submits a bulk entity enrichment job that runs asynchronously.
Get Discussion Thread
Extracts posts and their relationships from a web discussion thread.
Connect any two apps with Notis in the middle.
Adtraction and Diffbot, or any other combination from 1,000+ integrations.
When this happens · Trigger
Do this · Action
Save your first hour today.
7-day trial of any paid plan, with 20$ of usage included.
No card. Works with personal or business Diffbot.