Reading up on Beautiful Soup

DuckDB's full-text search extension offers BM25 scoring, stemming, and stop-word removal but lacks result highlighting and phrase queries.

Cloudflare launches a managed crawl endpoint that respects robots.txt, aiming to provide a well-behaved alternative to aggressive AI scrapers.