The web data tool directory

The directory for web scraping and AI data tools

6 search APIs, extraction tools, and browser platforms across 3 categories, reviewed for teams building AI products that read the web.

Curated by Nathan Kessler · Read weekly by AI product builders

These sponsor slots reach founders and PMs evaluating web data tools.

Large proxy network with scraping APIs for enterprise data

EnterpriseJul 2026Proxy Networks

Proxy pools and scraper APIs built for large-scale data teams

EnterpriseJul 2026Proxy Networks

Handles proxies, browsers, and CAPTCHAs behind one endpoint

FreemiumJul 2026Web Scraping APIs

Scraping API and cloud platform from the team behind Scrapy

FreemiumJul 2026Web Scraping APIs

Mature Python framework for building and running your own crawlers

FreeJul 2026Crawling Frameworks

Node and Python crawling library with built-in anti-blocking

FreeJul 2026Crawling Frameworks