n8n

Building n8n web crawler for RAG

This week, I’m introducing a new project at ScrapeNinja: a recursive web crawler, packed into an n8n community node. It isn’t just another scraper - it’s an advanced, powerful open-source tool that executes in your local n8n instance and can be used to harvest huge amounts of data, for example I use it to consolidate technical documentation (many web pages) into a clean Markdown file that I can feed into a large language model (LLM) for retrieval augmented generation (RAG) and other advanced use

14 min read

Web scraping in n8n

I am a big fan of n8n and I am using it for a lot of my projects. I love that it provides a self-hosted version and this self-hosted version is not paywalled like if often happens with so-called "open core" products which just use "open source" as a marketing term. Web scraping in n8n can be both simple and sophisticated, depending on your approach and tools. In this blog post, I will explore two ways of scraping: basic HTTP requests and advanced scraping techniques using ScrapeNinja n8n int

9 min read

My experience using n8n, from a developer perspective

1.5 years ago, I wrote a blog post sharing my thoughts and experience on using Make.com, Zapier, and Pipedream from my perspective (I recommend reading that piece before continuing here). When exploring these awesome platforms, I was mostly interested in how no-code and low-code products can enhance my life as a developer. My goal is to minimize coding and increase my output. UPD 2025: more of my n8n blog posts: * n8n vs real coding for SaaS products * Web scraping in n8n My technical backg

9 min read

Self-hosted is awesome

I'm a big fan of self-hosting. As an indie hacker who has launched several micro-SaaS products and as a CTO of a small company, I now prefer self-hosting all the tools I might need. With the rise of high-quality self-hosted offerings from talented teams using open source as their primary marketing channel while offering a cloud version of their product to generate revenue, we can save tens and hundreds of thousands of dollars over the lifetime of our projects, while maintaining full control over

7 min read