Keep a related set of page requests consistent
When a research task depends on session continuity, keep the related page requests on the same sticky session instead of starting from scratch.
Trigger
Webhook received
Notis starts this workflow when an external tool or custom backend sends an HTTP request.
Action
Set Session ID for Sticky Sessions
This tool implements the session id functionality for scrape.do to maintain a sticky session with the same proxy ip across multiple requests. it achieves this by adding a sessionid parameter to the query parameters of any scraping request, which is crucial for ensuring session consistency when scraping websites with stringent session requirements.
Why this helps
Inconsistent sessions can disrupt a multi-page source review and force you to repeat earlier steps.
- Keeps related requests on the same proxy IP when session continuity is needed.
- Reduces repeated setup across a multi-page research task.
- Makes session intent explicit in the incoming request.
Setup
Build it in a few focused steps.
- 1Connect Opoint and Scrape.do to Notis once through the portal.
- 2Create a webhook automation through the portal, or ask Notis to set it up in plain language.
- 3Give one instruction to use the supplied session identifier for related authorized public page requests.
- 4Select the incoming webhook trigger and a run-report channel.
- 5Test a small sequence of pages and confirm session continuity supports the task.
Questions about this workflow
When should I use a sticky session?
Use it when related requests need the same proxy IP across a session. It is not necessary for independent page fetches.
How should the identifier be supplied?
Provide the session identifier through the approved request context for your setup, and avoid reusing it beyond the intended task.
When this happens · Trigger
Do this · Action
Supported Triggers and Actions
Notis builds workflows that link Opoint to Scrape do. A trigger fires from one place; an action lands in another.
Opoint triggers
Scrape do actions
Recurring trigger
Notis starts this workflow on a schedule, such as daily, weekly, or during business hours.
Get Account Information
Retrieves account information and usage statistics from scrape.do. this action makes a get request to the scrape.do info endpoint to fetch: - subscription status - concurrent request limits and usage - monthly request limits and remaining requests - real-time usage statistics rate limit: maximum 10 requests per minute
Webhook trigger
Notis starts this workflow when an external tool or custom backend sends an HTTP request.
Get rendered page content
This tool allows you to scrape web pages with javascript rendering enabled. it's particularly useful for scraping dynamic websites where content is loaded through javascript. the tool will wait for the javascript to execute and return the fully rendered html content.
Scrape webpage using scrape.do
A tool to scrape web pages using scrape.do's api service. it makes a basic get request to fetch the content of a target webpage while handling anti-bot protections and proxy rotation automatically.
Use Scrape.do Proxy Mode
This tool implements the proxy mode functionality of scrape.do, which allows routing requests through their proxy server. it provides an alternative way to access web scraping capabilities by handling complex javascript-rendered pages, geolocation-based routing, device simulation, and built-in anti-bot and retry mechanisms.
Set Cookies for Scraping
This tool allows users to set specific cookies for their scraping requests to a target website. it is useful for maintaining session states or authentication through cookies.
Set Scrape.do Super Mode
The scrape do set super mode tool enables enhanced scraping by using residential and mobile proxies, bypassing blocks and restrictions associated with datacenter ips. when the 'super' parameter is set to true, it activates a mode that leverages a network of residential ip addresses, which is particularly useful to bypass strict anti-bot measures and for accessing websites that block datacenter ips.
Block specific URLs during scraping
This tool allows users to block specific urls during the scraping process. it's particularly useful for blocking unwanted resources like analytics scripts, advertisements, or any other urls that might interfere with the scraping process or slow it down. it provides granular control by allowing users to specify url patterns to block, thereby improving scraping performance and maintaining privacy.
Set custom headers for scrape.do request
A tool to send custom headers with scrape.do requests. this allows simulating specific browser behaviors or adding authentication headers by controlling all headers sent to the target website.
Connect any two apps with Notis in the middle.
Opoint and Scrape do, or any other combination from 1,000+ integrations.
When this happens · Trigger
Do this · Action
Save your first hour today.
7-day trial of any paid plan, with 20$ of usage included.
No card. Works with personal or business Scrape do.