I like ScrapingBee landing design with bright colors and black accents. What I didn't like is that ScrapingBee geotargeting is somewhat restrictive - it is available on premium proxies only (and these eat API credits fast). The list of proxy countries is huge - practically every country is available. Out of the box ScrapingBee provides HTML API Request builder and Google API Request builder. . One successful Google API request launch ate 25 of 1000 free credits, so it's just 40 requests on a free plan. Dashboard of ScrapingBee was pretty slow from my experience and I got white screen of death a few times (just blank page, and loading spinner in Chrome).
ScrapingBee
Founded: 2019
Website: scrapingbee.com
A web scraping API that handles proxies and Headless Chrome for you.
Free Plan:
✅
1000 API credits
Pricing:
Starts from $49/mo, 150K API credits
Previous Page
Previous:
Octoparse
A visual & automatic web data extraction software which simulates human operation to interact with web pages. Next Page Next: Oxylabs Web Scraper API
Web scraping API from big proxy player Oxylabs.
A visual & automatic web data extraction software which simulates human operation to interact with web pages. Next Page Next: Oxylabs Web Scraper API
Web scraping API from big proxy player Oxylabs.
About Pixeljets
Anton Sidashin
As a web developer and CTO with over 15 years of experience, I am passionate about building profitable small SaaS products and pursuing Go-to-Market strategy for them. My areas of expertise include high performance, networking technology and APIs, SRE, automation using Puppeteer.js, web scraping, and SQL databases.My blog posts
-
Choosing a proxy for web scraping
Once you're familiar with basic web scraping tools like Scrapy, and you've scraped your first 1-2 websites, you'll probably get your first ban because your IP address has made too many requests
-
Building modern and production ready Node.js API: my boring setup
I know how this desire to try out a new flashy npm package in a quick project can easily paralyze my will and the whole project's progress over exploring new docs and code. So in this writeup I would like to give appreciation to all the tools and techniques that have proven to be effective for me.