Keep Site Crawl Progress in View
Get a recurring view of active Diffbot crawl jobs so site research progress does not get lost between sessions.
Trigger
Recurring schedule
Notis starts this workflow on a schedule, such as daily, weekly, or during business hours.
Action
Manage Crawl Job
Pauses, restarts, deletes, or reports the status of crawl jobs.
Why this helps
Crawl jobs can continue in the background while the research that started them moves on to other work.
- Review active crawl job status on a schedule.
- Keep site research progress easy to find.
- Reduce repeated manual checks.
Setup
Build it in a few focused steps.
- 1Connect Diffbot once in Notis.
- 2Create an automation from any channel or in Automations, New Automation.
- 3Tell Notis to retrieve active Diffbot crawl jobs and summarize their current status.
- 4Choose a recurring schedule and a report channel.
- 5Test with one real crawl job listing.
Questions about this workflow
Can this manage a crawl job?
This workflow lists active crawl jobs for review. The action also supports managing a named job, but this report is configured only to retrieve status.
Does it include completed crawl data?
No. This action checks crawl jobs. Use a crawl data action to download extracted results after completion.
When this happens · Trigger
Do this · Action
Supported Triggers and Actions
Notis builds workflows that link Airtop to Diffbot. A trigger fires from one place; an action lands in another.
Airtop triggers
Diffbot actions
Recurring trigger
Notis starts this workflow on a schedule, such as daily, weekly, or during business hours.
Combine Entity Profiles
Combines entity profiles into an enriched unified view using the Knowledge Graph.
Webhook trigger
Notis starts this workflow when an external tool or custom backend sends an HTTP request.
Get Diffbot Account Details
Retrieves account details, credit balance, and usage statistics.
Create Bulk Extract Job
Submits a bulk URL extraction job that runs in the background and provides downloadable results.
Diffbot Analyze
Analyzes a web page, identifies its type, and extracts structured data.
Create or Update Custom API
Creates or updates a Custom API with tailored website extraction rules.
Get Article Data
Extracts structured information such as authors and publication dates from an article.
Create Bulk Enhance Job
Submits a bulk entity enrichment job that runs asynchronously.
Get Discussion Thread
Extracts posts and their relationships from a web discussion thread.
Connect any two apps with Notis in the middle.
Airtop and Diffbot, or any other combination from 1,000+ integrations.
When this happens · Trigger
Do this · Action
Save your first hour today.
7-day trial of any paid plan, with 20$ of usage included.
No card. Works with personal or business Diffbot.