🤖 Web Scraping
Modern tests to detect automated browser behavior. Cover most important leaks from Puppeteer and Playwright.
Preventing Selenium from being detected
A list of (almost) all headless web browsers in existence
A JavaScript implementation of a web browser without its graphical user interface
A drop-in replacement for puppeteer patched with rebrowser-patches. It allows to pass modern automation detection tests.
Spoof TLS/JA3 fingerprints in GO and Javascript
Successor of Undetected-Chromedriver. Providing a blazing fast framework for web automation, webscraping, bots and any other creative ideas which are normally hindered by annoying anti bot systems …
List of anti-detect and humanizing tools and browsers, including captcha solvers and sms-activation.
Collection of patches for puppeteer and playwright to avoid automation detection and leaks. Helps to avoid Cloudflare and DataDome CAPTCHA pages. Easy to patch/unpatch, can be enabled/disabled on d…
A JavaScript implementation of various web standards, for use with Node.js
Analysis of Bot Protection systems with available countermeasures 🚿. How to defeat anti-bot system 👻 and get around browser fingerprinting scripts 🕵️♂️ when scraping the web?
curl-impersonate: A special build of curl that can impersonate Chrome & Firefox
An easy-to-use HTTP client to spoof TLS/JA3, HTTP2 and HTTP3 fingerprint
Python binding for curl-impersonate fork via cffi. A http client that can impersonate browser tls/ja3/http2 fingerprints.
Prevent WebRTC leaks in Chromium browsers.
net/http.Client like HTTP Client with options to select specific client TLS Fingerprints to use for requests.
Juggler - Firefox Automation Protocol for implementing the Puppeteer API.
Fast, easy and reliable testing for anything that runs in a browser.
A custom Firefox Selenium-based Webdriver. Passes all bot mitigation systems
Curated list of awesome browser automation tools and resources
List of libraries, tools and APIs for web scraping and data processing.
A cloudflare verification bypass script for webscraping
A simple program for scraping Cloudflare clearance (cf_clearance) cookies from websites issuing Cloudflare challenges to visitors
💯 Teach puppeteer new tricks through plugins.
Passive TCP/IP Fingerprinting Tool. Run this on your server and find out what Operating Systems your clients are *really* using.