puppeteer Puppeteer: click an element and get raw JSON from XHR/AJAX response This lately became a pretty popular question when scraping with Puppeteer: let's say you want to interact with the page (e.g. click the button) and retrieve the raw ajax response (usually, JSON)
puppeteer Taming real browser for web scraping: Chrome (Puppeteer) as a cloud API service Okay, let's admit it - web scraping via Puppeteer and Playwright is the most versatile and flexible way of web scraping nowadays. Unfortunately it's also the most cumbersome, time consuming way of scraping,
scraping ScrapeNinja: bypassing CloudFlare 403 (code:1020) errors I've recently started getting Cloudflare 1020 (403) errors when scraping some random e-commerce website. At first, I thought that the website didn't like my scraper IP address, but changing IP addresses to clean