Start a website crawl from Telegram
Capture a crawl request in a message and let Notis start the Brightdata job for you.
Trigger
New Message Received
Triggered when your bot receives a new message in a private chat, group, or supergroup. To receive every message in a group, Privacy Mode must be disabled for the bot in BotFather.
Action
Trigger Site Crawl
Tool to trigger a site crawl job to extract content across multiple pages or entire domains. use when you need to start a crawl for a given dataset and list of urls.
Why this helps
Setting up a crawl can get postponed when the request is buried in a chat and the research tool takes extra setup.
- Turn a clearly stated research task into a crawl request promptly.
- Keep requested URLs close to the discussion that explains why they matter.
- Get a job reference you can use for later status checks and data retrieval.
Setup
Build it in a few focused steps.
- 1Connect Telegram and Brightdata to Notis once through the portal.
- 2Create an automation in the portal or ask Notis conversationally to start crawls from Telegram requests.
- 3Use one instruction to recognize crawl requests, send their listed URLs to Brightdata, and report the returned snapshot reference.
- 4Select New Message Received as the trigger and choose a run-report channel.
- 5Test with a small set of public URLs you are authorized to crawl.
Questions about this workflow
What should the message contain?
Include the URLs or domain and the kind of content you want the crawl to collect.
Does starting the crawl return its data?
Starting a crawl creates a job. The workflow can report its snapshot reference so you can check status and retrieve data when complete.
When this happens · Trigger
Do this · Action
Supported Triggers and Actions
Notis builds workflows that link Telegram to Brightdata. A trigger fires from one place; an action lands in another.
Telegram triggers
Brightdata actions
Recurring trigger
Notis starts this workflow on a schedule, such as daily, weekly, or during business hours.
Trigger Site Crawl
Tool to trigger a site crawl job to extract content across multiple pages or entire domains. use when you need to start a crawl for a given dataset and list of urls.
Webhook trigger
Notis starts this workflow when an external tool or custom backend sends an HTTP request.
Browse Available Scrapers
Tool to list all available pre-made scrapers (datasets) from bright data's marketplace. use when you need to browse available data sources for structured scraping.
New Message Received
Triggered when your bot receives a new message in a private chat, group, or supergroup. To receive every message in a group, Privacy Mode must be disabled for the bot in BotFather.
Filter Dataset
Tool to apply custom filter criteria to a marketplace dataset (beta). use after selecting a dataset to generate a filtered snapshot.
New Channel Post
Triggered when a new post is published to a channel where your bot is an administrator.
Get Available Cities
Tool to get available static network cities for a given country. use when you need to configure static proxy endpoints after selecting a country.
Callback Query Received
Triggered when a user taps an inline keyboard button attached to one of your bot's messages.
Get Available Countries
Tool to list available countries and their iso 3166-1 alpha-2 codes. use when you need to configure zones with valid country codes before provisioning proxies.
Message Edited
Triggered when a message in a chat your bot can see is edited by its sender.
Download Scraped Data
Tool to retrieve the scraped data from a completed crawl job by snapshot id. use after triggering a crawl or filtering a dataset to download the collected data.
New Chat Member
Triggered when a new member joins a group or supergroup the bot belongs to, including when the bot itself is added.
Check Crawl Status
Tool to check the processing status of a crawl job using snapshot id. call before attempting to download results to ensure data collection is complete.
List Unlocker Zones
Tool to list your configured web unlocker zones and proxy endpoints. use to view available zones for web scraping and bot protection bypass.
Connect any two apps with Notis in the middle.
Telegram and Brightdata, or any other combination from 1,000+ integrations.
When this happens · Trigger
Do this · Action
Save your first hour today.
7-day trial of any paid plan, with 20$ of usage included.
No card. Works with personal or business Brightdata.