Pixeljets
  • Home
  • Vue.js posts
  • Author

puppeteer

A collection of 3 posts

Puppeteer: click an element and get raw JSON from XHR/AJAX response
puppeteer

Puppeteer: click an element and get raw JSON from XHR/AJAX response

This lately became a pretty popular question when scraping with Puppeteer: let's say you want to interact with the page (e.g. click the button) and retrieve the raw ajax response (usually, JSON)

  • Anton Sidashin
    Anton Sidashin
5 min read
Taming real browser for web scraping: Chrome (Puppeteer) as a cloud API service
puppeteer

Taming real browser for web scraping: Chrome (Puppeteer) as a cloud API service

Okay, let's admit it - web scraping via Puppeteer and Playwright is the most versatile and flexible way of web scraping nowadays. Unfortunately it's also the most cumbersome, time consuming way of scraping,

  • Anton Sidashin
    Anton Sidashin
9 min read
ScrapeNinja: bypassing CloudFlare 403 (code:1020) errors
scraping

ScrapeNinja: bypassing CloudFlare 403 (code:1020) errors

I've recently started getting Cloudflare 1020 (403) errors when scraping some random e-commerce website. At first, I thought that the website didn't like my scraper IP address, but changing IP addresses to clean

  • Anton Sidashin
    Anton Sidashin
6 min read
Pixeljets © 2022
Latest Posts Ghost