scraping / library
Crawlee
Capability: Crawlee
Use it when
- production crawlers with browser and HTTP queues
- Apify-style crawling with retries and storage
What it solves
Not the fit when
- bot-detection-challenge guaranteed
Install
npm i crawlee playwright
Invoke
Create a `PlaywrightCrawler` or `CheerioCrawler` with a request handler, add seed URLs, then call `crawler.run()` and persist datasets.