distributed-crawling

Here are 2 public repositories matching this topic...

hlyylly / OpenCrawl

Distributed browser rendering as a service. Built for OpenClaw and AI agents on headless VPS without real browsers. Workers earn credits, users spend credits.

chrome-extension web-scraping fastapi ai-agent distributed-crawling cloudflare-r2 browser-rendering openclaw

Updated Apr 1, 2026
Python

DenimEvert / crawlab-capsolver

Star

Crawlab & CapSolver integration. Solve reCAPTCHA & Turnstile for distributed web crawling systems.

selenium web-scraping scrapy turnstile puppeteer crawlab distributed-crawling capsolver

Updated Jan 12, 2026
Python

Improve this page

Add a description, image, and links to the distributed-crawling topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the distributed-crawling topic, visit your repo's landing page and select "manage topics."

Learn more

Provide feedback

Saved searches

Use saved searches to filter your results more quickly