MerchantryTidbits

scraping / app

Scrapfly Anti-bot Detector

Capability: Scrapfly Anti-bot Detector

Use it when

  • Your scraper suddenly returns challenge pages and you need to identify which anti-bot vendor (Cloudflare, Akamai, DataDome, PerimeterX, Kasada) protects the site
  • Before building a crawler you want to audit a site's CAPTCHA and browser-fingerprinting defenses to choose the right automation stack

What it solves

Not the fit when

  • bypassing or automatically solving CAPTCHAs
  • headless or CI pipelines - requires an interactive Chrome session
  • browsers other than Chromium-based ones
  • selector-rot
  • geo-block
  • rate-limit-throttle
  • js-render-not-blocking

Install

Install from the Chrome Web Store (https://chromewebstore.google.com/detail/scrapfly/pdpakdgmjhkfimgaihlgaaiijlbilkca) or clone the repo and load its src/ folder as an unpacked extension via chrome://extensions with Developer mode enabled

Invoke

Navigate to the target site in Chrome, then click the extension icon to see detected anti-bot vendors, CAPTCHAs, and fingerprinting techniques with confidence scores; use the copy button to export detection data

Alternatives

No reviewed alternatives recorded yet.