Skip to content
Notis

Start a crawl from parsed seed links

Turn a parsed site or research brief into a Diffbot crawl job for broader structured collection.

Trigger

Webhook received

Notis starts this workflow when an external tool or custom backend sends an HTTP request.

Action

Start Crawl Job

Starts a crawl job to collect structured data from pages across a website.

Why this helps

Following a site link by link is a time consuming way to gather related information.

  • Start a site crawl from supplied seeds
  • Collect structured data across a site
  • Reduce manual link following

Setup

Build it in a few focused steps.

  • 1Connect Airparser and Diffbot once in Notis.
  • 2Create an automation in plain language or under Automations, New Automation.
  • 3Tell Notis to start a Diffbot crawl job using appropriate seed URLs from the parsed content.
  • 4Choose the webhook trigger and where run reports should go.
  • 5Test with one real seed URL and confirm your Diffbot plan supports crawl access.

Questions about this workflow

Does every Diffbot plan include crawl access?

The provided action description says crawl API access requires a Plus plan.

Does this return all crawl data in the same step?

It starts a crawl job; retrieve the collected data after the job completes.

When this happens · Trigger

Do this · Action

Supported Triggers and Actions

Notis builds workflows that link Airparser to Diffbot. A trigger fires from one place; an action lands in another.

Airparser triggers

Diffbot actions

Recurring trigger

Notis starts this workflow on a schedule, such as daily, weekly, or during business hours.

TriggerScheduled

Combine Entity Profiles

Combines entity profiles into an enriched unified view using the Knowledge Graph.

ActionInstant

Webhook trigger

Notis starts this workflow when an external tool or custom backend sends an HTTP request.

TriggerInstant

Get Diffbot Account Details

Retrieves account details, credit balance, and usage statistics.

ActionInstant

Create Bulk Extract Job

Submits a bulk URL extraction job that runs in the background and provides downloadable results.

ActionInstant

Diffbot Analyze

Analyzes a web page, identifies its type, and extracts structured data.

ActionInstant

Create or Update Custom API

Creates or updates a Custom API with tailored website extraction rules.

ActionInstant

Get Article Data

Extracts structured information such as authors and publication dates from an article.

ActionInstant

Create Bulk Enhance Job

Submits a bulk entity enrichment job that runs asynchronously.

ActionInstant

Get Discussion Thread

Extracts posts and their relationships from a web discussion thread.

ActionInstant

Connect any two apps with Notis in the middle.

Airparser and Diffbot, or any other combination from 1,000+ integrations.

When this happens · Trigger

Do this · Action

Save your first hour today.

7-day trial of any paid plan, with 20$ of usage included.
No card. Works with personal or business Diffbot.