The curated list ofWeb Scraping APIs 

This directory contains a compilation of key players offering APIs for data extraction. I write a brief overview of each service. I also include a link to the official website, pricing, and other relevant information. Consider this work in progress. 🛠

Web scraping API is a type of tool that has relatively recently emerged, designed to simplify the process of web scraping by handling proxies, browsers, and CAPTCHAs. It allows to (almost) effortlessly extract HTML from any webpage via a straightforward API call, instead of spending time fiddling around proxies and implementing retry logic manually.

BrightData Web Unlocker
BrightData Web Unlocker
Scraping API with per-GB pricing, from a big proxy player.
Founded:
2014
Free Plan:
no
Pricing:
$15/GB + $3-6 per 1M reqs
Read more
ScrapeNinja
ScrapeNinja
Afforadble and highly performant. Pure cloud web scraping API with built-in proxy rotation and JS rendering.
Founded:
2021
Free Plan:
✅
Pricing:
Starts from $25/mo, 100K API requests, proxy rotation
Read more
Octoparse
Octoparse
A visual & automatic web data extraction software which simulates human operation to interact with web pages.
Founded:
2016
Free Plan:
✅
Pricing:
Starts from $89/mo, 100 tasks, proxy rotation
Read more
ScrapingBee
ScrapingBee
A web scraping API that handles proxies and Headless Chrome for you.
Founded:
2019
Free Plan:
✅
Pricing:
Starts from $49/mo, 150K API credits
Read more
Oxylabs Web Scraper API
Oxylabs Web Scraper API
Web scraping API from big proxy player Oxylabs.
Founded:
2015
Free Plan:
no
Pricing:
Starts from $49/mo, 17,500 results, geo-targeting
Read more
ParseHub
ParseHub
An easy-to-learn, visual tool for gathering data from the web. Was born out of the need to easily parse complicated financial documents.
Founded:
2015
Free Plan:
✅
Pricing:
Starts from $189/mo, 10000 pages per run, 20 private projects, proxy rotation
Read more
Apify
Apify
The ecosystem where developers build, and allow others to rent web scraping and browser automation actors.
Founded:
2015
Free Plan:
no
Pricing:
Starts from $49/mo, compute units pricing model instead of API credits
Read more
ScraperAPI
ScraperAPI
Three scraping modes, including async mode.
Founded:
2018
Free Plan:
✅
Pricing:
Starts from $49/mo, 100K API credits, US and EU targeting only.
Read more
Zyte
Zyte
Scrapy inventors. Formerly known as ScrapingHub.
Founded:
2015
Free Plan:
no
Pricing:
pricing varies by tier of website
Read more
ScrapFly
ScrapFly
Versatile API with sessions and async webhook support.
Founded:
2020
Free Plan:
✅
Pricing:
Starts from $30/mo, 200K API credits
Read more
Return to home page.

About Pixeljets

Bonnie image
Anton Sidashin
As a web developer and CTO with over 15 years of experience, I am passionate about building profitable small SaaS products and pursuing Go-to-Market strategy for them. My areas of expertise include high performance, networking technology and APIs, SRE, automation using Puppeteer.js, web scraping, and SQL databases.
Read about me Read my blog
My blog posts
  • Choosing a proxy for web scraping

    Once you're familiar with basic web scraping tools like Scrapy, and you've scraped your first 1-2 websites, you'll probably get your first ban because your IP address has made too many requests

  • Building modern and production ready Node.js API: my boring setup

    I know how this desire to try out a new flashy npm package in a quick project can easily paralyze my will and the whole project's progress over exploring new docs and code. So in this writeup I would like to give appreciation to all the tools and techniques that have proven to be effective for me.