Trafilatura

Use it when

• extract main article text and metadata from news HTML for RAG
• download and clean web pages to plain text at scale

What it solves

Install

pip install trafilatura

Invoke

import trafilatura; text = trafilatura.extract(downloaded)

Alternatives

No reviewed alternatives recorded yet.