Cloudflare scraper

A page metadata scraper built on Cloudflare Workers, using HTMLRewriter to parse pages and pull out their content for Otter.

Posted: 3 Oct 2023

I finished creating the page metadata scraper that’s built with Cloudflare Workers. It uses HTMLRewriter to parse the page and extract content. It will be integrated into Otter soon.

The repo for it is here: github.com/mrmartineau/cloudflare-worker-scraper