Skip to content
BranchesTags

Latest commit

 

History

23 Commits

Folders and files

NameName
Last commit message
Last commit date
assets
assets
 
 
README.md
README.md
 
 

Repository files navigation

Profile Views

Data Extraction Architect

203+ open-source tools: Web Data APIs, MCP servers, scrapers, AI agent data tools & awesome lists.

Google Maps · LinkedIn · Social Media · E-commerce · Search · MCP Servers

@DataScrape · CoreClaw

About

Building the largest open-source Web Data Infrastructure ecosystem on GitHub. 203 production-ready repos covering scraper tools, CoreClaw product APIs, competitor alternatives, AI agent data connectors, and curated awesome lists.

CoreClaw Product Lines

Product Description
Google Maps Scraper API Local business data extraction for lead gen & local SEO
LinkedIn Data API B2B contact and company data for sales automation
Social Media Data API Instagram, TikTok, YouTube, Facebook, Reddit data
E-commerce Data API Amazon, Walmart, eBay product and pricing data
Search Data API Google SERP data for SEO and market intelligence

Community

Join the DataScrape Discord community to discuss web data APIs, MCP servers, and AI agent workflows.

Repository Matrix (203 repos)

AI Agent Data

Repository Description
agentic-data-pipeline Agentic Data Pipeline - Real-time web data pipeline for AI a
ai-agent-data-tools AI Agent Data Tools - Connect AI agents to real-time web dat
ai-agent-web-scraper AI Agent Web Scraper - LLM-powered data extraction for agent
mcp-data-tools MCP Data Tools - Model Context Protocol server for web data
rag-data-source RAG Data Source - External web data for Retrieval-Augmented
social-media-sentiment-analysis-tool Social Media Sentiment Analysis Tool - Analyze compliant pub

Awesome Lists

Repository Description
awesome-ai-agents Awesome AI Agents - Curated AI agent tools, frameworks, and
awesome-data-apis Awesome Data APIs - Curated list of public web data APIs for
awesome-google-maps Awesome Google Maps - Curated tools for Google Maps data ext
awesome-lead-generation Awesome Lead Generation - Curated B2B lead gen tools, APIs,
awesome-web-scraping Awesome Web Scraping - Curated list of scraping tools, APIs,

Business Data Scrapers

Repository Description
opencorporates-search OpenCorporates Search - Structure public company registry re

Competitor Alternatives

Repository Description
brightdata-alternative Best Bright Data Alternative - Web data platform for AI agen
outscraper-alternative Best Outscraper Alternative - Google Maps data extraction AP
oxylabs-alternative Best Oxylabs Alternative - Residential proxy and web scrapin
phantombuster-alternative Best PhantomBuster Alternative - LinkedIn & social media aut
scraperapi-alternative Best ScraperAPI Alternative - Web scraping API with proxy ro
scrapingbee-alternative Best ScrapingBee Alternative - Web scraping API with JS rend
scrapingdog-alternative Best ScrapingDog Alternative - Web scraping API for develope
serpapi-alternative Best SerpAPI Alternative - Google SERP API with better rate
texau-alternative Best TexAu Alternative - LinkedIn automation and lead genera
zenscrape-alternative Best Zenscrape Alternative - Web scraping API for structured

Content Platform Scrapers

Repository Description
medium-scraper Scrape Medium articles, authors, and publication data
substack-scraper Scrape Substack newsletters, posts, and subscriber data

CoreClaw Products

Repository Description
amazon-product-api Amazon Product API - Real-time product, pricing, and review
best-amazon-scraper Best Amazon Scraper - Extract product data, prices, reviews,
best-google-maps-scraper Best Google Maps Scraper - Extract business data, reviews, r
best-instagram-scraper Best Instagram Scraper - Extract posts, profiles, stories, a
best-linkedin-scraper Best LinkedIn Scraper - Extract profiles, companies, and con
best-tiktok-scraper Best TikTok Scraper - Extract videos, hashtags, sounds, and
best-web-scraping-api Best Web Scraping API Comparison - CoreClaw vs competitors f
best-youtube-scraper Best YouTube Scraper - Extract video data, transcripts, and
business-data-api Business Data API - Company data, contact info, and firmogra
coreclaw-review CoreClaw Review - Web Data API platform features, pricing, a
data-extraction-api Data Extraction API - Structured data extraction for SaaS, A
google-maps-data-api Google Maps Data API - Structured local business data for AI
google-maps-scraper-api Google Maps Scraper API - Production-ready REST API for loca
google-search-api Google Search API - SERP data extraction for SEO and market
instagram-data-api Instagram Data API - Structured Instagram data for influence
lead-generation-api Lead Generation API - Extract B2B contact data, company info
linkedin-data-api LinkedIn Data API - B2B contact and company data for sales a
web-data-api Web Data API - Turn public web pages into structured data vi

Developer Community Scrapers

Repository Description
stackexchange-questions-scraper Stack Exchange Questions Scraper - Collect public questions,

Discord Scrapers

Repository Description
discord-server-scraper Scrape Discord servers, channels, and member lists data

E-commerce Scrapers

Repository Description
bestbuy-products-scraper Best Buy Products Scraper - Collect public product listings,
lazada-scraper Lazada Scraper - Collect public product, price, seller, and
zara-scraper Zara Scraper - Collect public product catalog, availability,

Education Data Scrapers

Repository Description
universities-directory-scraper Universities Directory Scraper - Build a structured director

Entertainment Data Scrapers

Repository Description
imdb-scraper IMDb Scraper - Collect public title, cast, rating, and relea

Facebook Scrapers

Repository Description
facebook-group-scraper Scrape Facebook groups, members, and group posts data

Gaming Scrapers

Repository Description
lichess-chess-users-scraper Lichess Chess Users Scraper - Collect public player profile

Google Scrapers

Repository Description
google-images-scraper Scrape Google Images search results, metadata, and source UR
google-news-scraper Scrape Google News articles, headlines, and source data
google-trends-scraper Scrape Google Trends data, search interest, and trending top

Instagram Scrapers

Repository Description
instagram-follower-counter Instagram Follower Counter - Track publicly visible follower
instagram-hashtag-scraper Scrape Instagram hashtags, posts, and trending content data
instagram-search-scraper Instagram Search Scraper - Collect public search result meta

Job Data Scrapers

Repository Description
google-jobs-scraper Google Jobs Scraper - Collect public job result metadata for
levels-fyi-salary-scraper Levels.fyi Salary Scraper - Collect publicly shared compensa

LinkedIn Scrapers

Repository Description
linkedin-job-scraper Scrape LinkedIn job postings, salaries, and application data
linkedin-sales-navigator-scraper Scrape LinkedIn Sales Navigator leads and accounts data

Local Business Scrapers

Repository Description
booksy-scraper Booksy Scraper - Collect public beauty and wellness business

MCP Servers

Repository Description
amazon-mcp-server Amazon MCP Server - AI agent access to product data, prices,
google-maps-mcp-server Google Maps MCP Server - AI agent access to local business d
linkedin-mcp-server LinkedIn MCP Server - Give AI agents access to profiles, com

Marketplace Scrapers

Repository Description
kijiji-scraper Kijiji Scraper - Collect public classified listing data for

Music & Audio Scrapers

Repository Description
spotify-scraper Scrape Spotify songs, playlists, artists, and podcasts data

Other Scrapers

Repository Description
aliexpress-scraper Scrape aliexpress scraper data
amazon-asin-scraper Amazon ASIN scraper - lookup ASIN data and product informati
amazon-price-scraper Amazon price scraper - track prices and extract pricing hist
amazon-product-scraper Amazon product scraper - extract product details, images, an
amazon-review-scraper Amazon review scraper - extract product reviews and ratings
amazon-reviews-scraper Scrape amazon reviews scraper data
amazon-scraper-api Amazon scraper API - REST API for Amazon data extraction
apify-google-maps-scraper Compare Apify Google Maps Scraper with modern alternatives.
apify-indeed-scraper Apify-style Indeed scraper alternative - free & open source
apify-instagram-scraper Compare Apify Instagram Scraper with modern alternatives. Co
apify-reddit-scraper Apify-style Reddit scraper alternative - free & open source
apify-tiktok-scraper Apify TikTok scraper alternative - free Python TikTok scrape
apify-zillow-scraper Apify-style Zillow scraper alternative - free & open source
awesome-apify-alternatives A curated list of the best Apify alternatives for web scrapi
az-roc-license-scraper Scrape az roc license scraper data
best-apify-alternative The best Apify alternative for Google Maps, LinkedIn, YouTub
best-apollo-scraper-reddit Reddit community recommended Apollo scraper alternative
best-ebay-scraper The best eBay scraper for extracting products, prices, selle
best-facebook-scraper The best Facebook scraper for extracting public pages, posts
best-google-search-scraper The best Google Search scraper for extracting organic result
best-indeed-scraper The best Indeed scraper for extracting job listings, compani
best-reddit-scraper The best Reddit scraper for extracting posts, comments, subr
best-walmart-scraper The best Walmart scraper for extracting products, prices, re
best-zillow-scraper The best Zillow scraper for extracting property listings, pr
bing-search-scraper Scrape bing search scraper data
bing-serp-tracker Scrape bing serp tracker data
blog CoreClaw blog - web scraping infrastructure insights. Served
bright-data-alternative Free open-source Bright Data alternative - web scraping prox
caleprocure-scraper Scrape caleprocure scraper data
colorado-professional-license-scraper Scrape colorado professional license scraper data
crawler-google-places Scrape crawler google places data
cruisemapper-cruises-scraper Scrape cruisemapper cruises scraper data
cslb-contractor-license-search Scrape cslb contractor license search data
dealwatch-scraper Scrape dealwatch scraper data
discord-scraper Scrape Discord messages, channels, members without API
dol-5500-scraper Scrape dol 5500 scraper data
easy-scrape-zillow-agents-free Free tool to scrape Zillow real estate agents listings
ebay-items-scraper Scrape ebay items scraper data
ebay-price-scraper eBay price scraper - track prices and extract sold item hist
ebay-web-scraper eBay web scraper - extract product listings, prices, seller
facebook-ads-library-scraper Scrape facebook ads library scraper data
facebook-marketplace-scraper Facebook Marketplace scraper - extract listings, prices, sel
facebook-page-scraper Facebook page scraper - extract page posts, reviews, insight
facebook-post-scraper Facebook post scraper - extract post data, reactions, commen
facebook-profile-scraper Facebook profile scraper - extract profiles, friends, photos
facebook-scrape-website Facebook scrape website - full Facebook data extraction tool
fcc-license-search Scrape fcc license search data
fmcsa-dot-crawler Scrape fmcsa dot crawler data
glassdoor-reviews-scraper Scrape glassdoor reviews scraper data
glassdoor-scraper Scrape Glassdoor job listings, salaries, company reviews
google-business-scraper Scrape Google Business Profiles - reviews, hours, contact in
google-map-scraper-api- Production-ready Google Maps Scraper API for extracting busi
google-maps-data-scraper Extract Google Maps business data, reviews, place IDs, email
google-place-id-api Get Google Place IDs without API key - free alternative
google-reviews-scraper Scrape Google Maps reviews - ratings, text, author, dates
google-shopping-scraper Scrape Google Shopping results - prices, products, sellers
hyperliquid-public-market-monitor Scrape hyperliquid public market monitor data
illinois-idfpr-license-scraper Scrape illinois idfpr license scraper data
indeed-job-scraper Free Indeed job scraper - extract job postings, salaries, co
instagram-account-scraper A powerful Python-based Instagram account scraper that extra
instagram-comment-scraper Instagram comment scraper - extract comments from posts and
instagram-email-scraper Instagram email scraper - extract emails from Instagram bios
instagram-follower-scraper Extract Instagram followers, public profiles, engagement met
instagram-following-scraper Scrape instagram following scraper data
instagram-profile-scraper Extract public Instagram profile data, business accounts, bi
instagram-scraper Extract Instagram profiles, posts, reels, comments, hashtags
instagram-tagged-mentions-posts-scraper Scrape instagram tagged mentions posts scraper data
insurance-license-search Scrape insurance license search data
irs-990-nonprofit-search Scrape irs 990 nonprofit search data
jooble-jobs-api Scrape jooble jobs api data
lead-scoring-engine Scrape lead scoring engine data
linkedin-email-scraper LinkedIn email scraper - extract emails from LinkedIn profil
linkedin-jobs-scraper Scrape linkedin jobs scraper data
linkedin-post-scraper LinkedIn post scraper - extract posts, likes, comments, anal
linkedin-post-search-scraper Scrape linkedin post search scraper data
linkedin-profile-data-scraper LinkedIn profile data scraper - extract profiles, experience
linkedin-scraper-api LinkedIn scraper API - REST API for LinkedIn data extraction
new-york-license-scraper Scrape new york license scraper data
nppes-npi-registry Scrape nppes npi registry data
ny-biz-lookup Scrape ny biz lookup data
ny-business-entity-scraper Scrape ny business entity scraper data
nysed-professional-license-search Scrape nysed professional license search data
or-biz-lookup Scrape or biz lookup data
outscraper-google-maps-scraper Compare Outscraper Google Maps Scraper with modern alternati
pinterest-scraper Scrape Pinterest pins, boards, images without API
pitchbook-scraper Scrape pitchbook scraper data
price-comparison Scrape price comparison data
public-onchain-token-monitor Scrape public onchain token monitor data
scrap-gold-ebay Scrap gold eBay - extract gold and precious metal listings f
scrape-google-maps Learn how to scrape Google Maps business listings, reviews,
scrape-indeed-job-postings Python tool to scrape Indeed job postings with full details
scrape-instagram-followers Learn how to scrape Instagram followers, public profiles, fo
scrape-instagram-photos Scrape Instagram photos - download photos from any profile i
scrape-yelp-reviews Free Yelp reviews scraper - extract ratings, text, dates
scrape-youtube-comments Scrape YouTube comments - extract comments from any video
scrape-youtube-search-results Scrape YouTube search results - extract videos, channels, pl
snapchat-profile-scraper Scrape snapchat profile scraper data
spotify-profiles-search-scraper Scrape spotify profiles search scraper data
telegram-scraper Scrape Telegram channels, messages, groups without API
texas-tdi-insurance-license Scrape texas tdi insurance license data
texas-trec-scraper Scrape texas trec scraper data
threads-scraper Scrape Meta Threads posts, profiles, replies without API
tiktok-comment-scraper TikTok comment scraper - extract comments from TikTok videos
tiktok-comments-scraper TikTok comments scraper - bulk extract comments and replies
tiktok-data-scraper-api TikTok data scraper API - REST API for TikTok data extractio
tiktok-profile-scraper TikTok profile scraper - extract profiles, followers, video
tiktok-video-scraper TikTok video scraper - extract video data, hashtags, trendin
trustmrr-startup-scraper Scrape trustmrr startup scraper data
twitch-scraper Scrape Twitch channels, streams, chat without API
tx-biz-lookup Scrape tx biz lookup data
website-content-crawler Scrape website content crawler data
wyoming-sos-registry Scrape wyoming sos registry data
x-scraper Scrape X/Twitter posts, profiles, followers without API
yellow-pages-scraper Scrape Yellow Pages business listings - phone, address, revi
youtube-video-scraper-api YouTube video scraper API - REST API for video data extracti
zenrows-alternative Free open-source ZenRows alternative - anti-bot bypass scrap
zillow-data-scraper Scrape Zillow property data - prices, addresses, Zestimate
zillow-scraper-api Zillow scraper API - structured JSON output for property dat
zoominfo-company-scraper Scrape zoominfo company scraper data

Pinterest Scrapers

Repository Description
pinterest-pin-scraper Scrape Pinterest pins, boards, and image data in bulk

Public Market Data

Repository Description
dexscreener-public-market-data DEX Screener Public Market Data - Monitor publicly available

Public Records Scrapers

Repository Description
louisiana-contractor-license-lookup Louisiana Contractor License Lookup - Query public contracto
public-permit-search Public Permit Search - Normalize publicly available permit r
tdlr-texas-professional-license-search TDLR Texas Professional License Search - Query public Texas

Real Estate Scrapers

Repository Description
realtor-scraper Realtor Scraper - Collect public real-estate listings, price

Reddit Scrapers

Repository Description
reddit-comment-scraper Scrape Reddit comments, replies, and user discussions in bul
reddit-post-scraper Scrape Reddit posts, subreddits, and karma data with filters
reddit-user-profile-posts-scraper Reddit User Profile Posts Scraper - Export public profile po

SEO Scrapers

Repository Description
google-trends-api Google Trends API - Collect public search-interest data for

Social Media Scrapers

Repository Description
quora-scraper Scrape Quora questions, answers, and user profiles data
slack-scraper Scrape Slack channels, messages, and workspace data
snapchat-scraper Scrape Snapchat stories, profiles, and public content data
whatsapp-scraper Scrape WhatsApp groups, contacts, and message data programma
x-tweet-scraper Scrape X (Twitter) tweets, threads, and timeline data in bul

Telegram Scrapers

Repository Description
telegram-channel-scraper Scrape Telegram channels, messages, and subscriber data

YouTube Scrapers

Repository Description
youtube-channel-scraper Scrape YouTube channel data, stats, and video lists in bulk

💎 Sponsored by CoreClaw

CoreClaw

Web Data Infrastructure for AI Agents & Automation

Production-ready REST APIs · AI-ready structured data · MCP-compatible · Free credits

Start Building Free

Python Repos License

About

Profile

Resources

Readme
Activity

Stars

1 star

Watchers

0 watching

Forks

0 forks
Report repository

Releases

Packages

Contributors