Skip to content
Notis

Crawl a source site from a ClickUp list

Update the source list and let a site crawl collect the pages your project needs.

Trigger

List Updated

Triggers when a List is updated (renamed, content edited, etc.).

Action

Start Crawl Job

Tool to spider a site for links and process them with the extract api into a single collection. use when you have seed urls and want to collect structured data across a site. requires a plus plan for crawl api access.

Why this helps

Source collection is delayed when someone must manually launch and monitor each crawl.

  • Launch crawls from project context
  • Collect linked pages consistently
  • Reduce manual research operations

Setup

Build it in a few focused steps.

  • 1Connect ClickUp and Diffbot in Notis.
  • 2Create an automation named Crawl updated source sites.
  • 3Tell Notis to find the seed URL in the updated list context and start a Diffbot Crawl Job, reporting the job id and scope.
  • 4Pick List Updated as the trigger.
  • 5Choose a report channel and test with one list containing a public seed URL.

Questions about this workflow

Is a Plus plan required?

Diffbot Crawl Job requires a Plus plan for crawl API access.

How does Notis know the seed URL?

Tell it where your team records the seed URL in the list name, description, or task context.

When this happens · Trigger

Do this · Action

Supported Triggers and Actions

Notis builds workflows that link Clickup to Diffbot. A trigger fires from one place; an action lands in another.

Clickup triggers

Diffbot actions

Recurring trigger

Notis starts this workflow on a schedule, such as daily, weekly, or during business hours.

TriggerScheduled

Diffbot Search

Tool to search data extracted by crawl or bulk jobs using dql queries. use after data extraction jobs complete to retrieve search results.

ActionInstant

Webhook trigger

Notis starts this workflow when an external tool or custom backend sends an HTTP request.

TriggerInstant

Get Diffbot Account Details

Tool to retrieve account details, including plan information and usage statistics. use after authenticating to verify subscription and daily quota status.

ActionInstant

Folder Created

Triggers when a new Folder is created.

TriggerInstant

Diffbot Analyze

Tool to automatically determine a page's content type and route it to the appropriate extraction api. use when you have only a url and need diffbot to choose the right extractor.

ActionInstant

Folder Deleted

Triggers when a Folder is deleted.

TriggerInstant

Get Article Data

Tool to extract information from articles, including authors, publication dates, and images. use when you need structured metadata from a web article url.

ActionInstant

Folder Updated

Triggers when a Folder is updated (renamed, content edited, etc.).

TriggerInstant

Get Discussion Thread

Tool to extract threads of content from forums, comment sections, and review pages. use when you need structured discussion data from web pages after identifying the discussion url.

ActionInstant

List Created

Triggers when a new List is created.

TriggerInstant

Diffbot Get Event

Tool to extract event details from web pages. use when you need structured event data such as venue, date, and description.

ActionInstant

List Deleted

Triggers when a List is deleted.

TriggerInstant

Diffbot Get Image

Tool to extract detailed information about images, including dimensions and recognition data. use after confirming the image url is publicly accessible.

ActionInstant

List Updated

Triggers when a List is updated (renamed, content edited, etc.).

TriggerInstant

Diffbot Get Product

Tool to extract product information such as specifications, prices, availability, and reviews. use when you need structured product data including specs, pricing, and reviews.

ActionInstant

Connect any two apps with Notis in the middle.

Clickup and Diffbot, or any other combination from 1,000+ integrations.

When this happens · Trigger

Do this · Action

Save your first hour today.

7-day trial of any paid plan, with 20$ of usage included.
No card. Works with personal or business Diffbot.