The list of Web Scraping APIs ⚙️
This is a curated directory of significant players that run APIs for data extraction. A web scraping API is a tool that has relatively recently emerged, designed to simplify the process of web scraping by handling proxies, browsers, and CAPTCHAs. It enables users to retrieve HTML from any web page through a simple API call.
Web scraping API is usually a low level tool meant to be used by developers who have scraping tasks on hand, by offering features like JavaScript (JS) rendering, geotargeting, and residential proxies, ensuring that requests aren't blocked by anti-bot detection measures. The API is customizable, with parameters that can be added to requests to enable various features such as JS rendering or IP geolocation.
Free Plan:
no
Pricing:
$15/GB + $3-6 per 1M reqs
ScrapeNinja
Afforadble and highly performant. Pure cloud web scraping API with built-in proxy rotation and JS rendering.
Founded:
2021
Free Plan:
✅
Pricing:
Starts from $25/mo, 100K API requests, proxy rotation
Octoparse
A visual & automatic web data extraction software which simulates human operation to interact with web pages.
Founded:
2016
Free Plan:
✅
Pricing:
Starts from $89/mo, 100 tasks, proxy rotation
Free Plan:
✅
Pricing:
Starts from $49/mo, 150K API credits
ParseHub
An easy-to-learn, visual tool for gathering data from the web. Was born out of the need to easily parse complicated financial documents.
Founded:
2015
Free Plan:
✅
Pricing:
Starts from $189/mo, 10000 pages per run, 20 private projects, proxy rotation
Free Plan:
no
Pricing:
Starts from $49/mo, 17,500 results, geo-targeting
Free Plan:
✅
Pricing:
Starts from $49/mo, 100K API credits, US and EU targeting only.
Apify
The ecosystem where developers build, and allow others to rent web scraping and browser automation actors.
Founded:
2015
Free Plan:
no
Pricing:
Starts from $49/mo, compute units pricing model instead of API credits
Free Plan:
no
Pricing:
pricing varies by tier of website
