I like ScrapingBee landing design with bright colors and black accents. What I didn't like is that ScrapingBee geotargeting is somewhat restrictive - it is available on premium proxies only (and these eat API credits fast). The list of proxy countries is huge - practically every country is available. Out of the box ScrapingBee provides HTML API Request builder and Google API Request builder. . One successful Google API request launch ate 25 of 1000 free credits, so it's just 40 requests on a free plan. Dashboard of ScrapingBee was pretty slow from my experience and I got white screen of death a few times (just blank page, and loading spinner in Chrome).
A visual & automatic web data extraction software which simulates human operation to interact with web pages. Next Page Next: Oxylabs Web Scraper API
Web scraping API from big proxy player Oxylabs.
Anton SidashinAs a web developer and CTO with over 15 years of experience, I am passionate about building profitable small SaaS products and pursuing Go-to-Market strategy for them. My areas of expertise include high performance, networking technology and APIs, SRE, automation using Puppeteer.js, web scraping, and SQL databases.
My blog posts
Choosing a proxy for web scraping
Once you're familiar with basic web scraping tools like Scrapy, and you've scraped your first 1-2 websites, you'll probably get your first ban because your IP address has made too many requests
Building modern and production ready Node.js API: my boring setup
I know how this desire to try out a new flashy npm package in a quick project can easily paralyze my will and the whole project's progress over exploring new docs and code. So in this writeup I would like to give appreciation to all the tools and techniques that have proven to be effective for me.