Rust
How to Run a Fast Website Parser for LLMs on 14 Megabytes of RAM
A lightweight Rust-based web scraper that uses just 14MB of RAM and outputs clean Markdown for LLMs.
#crawler
5 projects JavaScript
How to Find Out What Protection is Running on a Site and What It's Collecting About You
A Chrome extension that detects anti-bot systems, CAPTCHAs, and 21 fingerprinting techniques in real time, helping developers and security researchers identify what protection is running on any website.
Python
How to Confuse Vulnerability Scanners with Krawl
Krawl is a deception server that pretends to be a vulnerable web app, feeding scanners infinite trap pages and wasting their resources.
Elixir
When Scrapy Feels Cramped and Python Is Slow: Collecting Data with Elixir Using Crawly
When Scrapy hits its limits and Python crawls, Crawly on the BEAM VM offers a powerful alternative for large-scale web scraping with familiar concepts and built-in management tools.
Java
How to Collect Data Without Pain or Code Using Spider- flow
Spider- flow turns web scraping into visual programming. With over 11k GitHub stars, this Java-based platform lets you build parsers by drawing flowcharts in your browser.
11,338