ScrapFly

Founded: 2020 Website: scrapfly.io/

Versatile API with sessions and async webhook support.

ScrapeFly is a versatile API scraping tool with great selection of countries for proxy geo-targeting. ScrapeFly geo-targeting

Great documentation, for example, a dedicated page with timeouts setup: https://scrapfly.io/docs/scrape-api/understand-timeout It also supports sessions and async webhooks. Also features "anti-bot bypass" mode (which we had mixed results with).

Free Plan:

✅

1K API credits, 5x for browser, 25x for JS rendering

Pricing:

Starts from $30/mo, 200K API credits

Previous: Zyte
Scrapy inventors. Formerly known as ScrapingHub.

About Pixeljets

Anton Sidashin

As a web developer and CTO with over 15 years of experience, I am passionate about building profitable small SaaS products and pursuing Go-to-Market strategy for them. My areas of expertise include high performance, networking technology and APIs, SRE, automation using Puppeteer.js, web scraping, and SQL databases.

Read about me Read my blog

My blog posts

Choosing a proxy for web scraping
Once you're familiar with basic web scraping tools like Scrapy, and you've scraped your first 1-2 websites, you'll probably get your first ban because your IP address has made too many requests
Building modern and production ready Node.js API: my boring setup
I know how this desire to try out a new flashy npm package in a quick project can easily paralyze my will and the whole project's progress over exploring new docs and code. So in this writeup I would like to give appreciation to all the tools and techniques that have proven to be effective for me.