MerchantryTidbits

scraping / api

Firecrawl

Capability: Firecrawl

Use it when

  • API crawl that returns markdown from any URL
  • turn websites into clean LLM-ready pages

What it solves

Not the fit when

  • offline free use
  • no-api-key environments

Install

pip install firecrawl-py  # requires FIRECRAWL_API_KEY

Invoke

Create `FirecrawlApp(api_key=...)`, call `scrape` for one page or `crawl` for a site, then consume the returned Markdown and metadata.

Alternatives

crawl4ai, watercrawl