Skip to content
Notis

Surface possible duplicate document records

Use fields already stored from Affinda results to bring possible duplicate records into a review report.

Trigger

Recurring schedule

Notis starts this workflow on a schedule, such as daily, weekly, or during business hours.

Action

Execute ClickHouse Query

Runs a database query and returns the results.

Why this helps

Repeated documents can create noisy counts and extra review work when duplicates are hard to spot.

  • Surface possible duplicate candidates for review.
  • Apply consistent matching criteria.
  • Avoid treating a suspected duplicate as an automatic deletion.

Setup

Build it in a few focused steps.

  • 1Connect Affinda and ClickHouse once in the Notis portal.
  • 2Create an automation in Automations, New Automation, or describe it to Notis in plain language.
  • 3Specify the table and fields that define a possible duplicate, then ask Notis to query and summarize matching groups.
  • 4Choose a notis_cron schedule and select where run reports should go.
  • 5Test with one run and verify candidates before acting on them.

Questions about this workflow

Does it delete duplicate records?

No. The query surfaces candidates for review and does not change stored data.

What fields can identify duplicates?

Use identifiers present in your data, such as a document ID or a combination of extracted values.

When this happens · Trigger

Do this · Action

Supported Triggers and Actions

Notis builds workflows that link Affinda to ClickHouse. A trigger fires from one place; an action lands in another.

Affinda triggers

ClickHouse actions

Recurring trigger

Notis starts this workflow on a schedule, such as daily, weekly, or during business hours.

TriggerScheduled

Execute ClickHouse Query

Runs a database query and returns the results.

ActionInstant

Webhook trigger

Notis starts this workflow when an external tool or custom backend sends an HTTP request.

TriggerInstant

Get Database Schema

Retrieves an overview of a database's schema and tables.

ActionInstant

Get Table Schema

Gets the schema and column details for a table.

ActionInstant

Get ClickHouse Play Interface

Returns the ClickHouse Play interface for writing queries and viewing results.

ActionInstant

List ClickHouse Databases

Lists the databases in an instance.

ActionInstant

List ClickHouse Tables

Lists tables in databases with basic details.

ActionInstant

Connect any two apps with Notis in the middle.

Affinda and ClickHouse, or any other combination from 1,000+ integrations.

When this happens · Trigger

Do this · Action

Save your first hour today.

7-day trial of any paid plan, with 20$ of usage included.
No card. Works with personal or business ClickHouse.