Author: Data Journal

TikTok is one of my favorite platforms — not just for fun videos, but also for the powerful…

Let’s be honest, scraping YouTube isn’t always easy. With data restrictions and the possibility of getting blocked, it…

YouTube is massive, hosting billions of active users and millions of new videos uploaded daily. The platform offers a…

Proxycurl was one of the top tools for scraping LinkedIn, offering services like profile and company data extraction….

In this guide, I’ll show you how to set up a proxy using HttpClient in C#. It’s a…

In this guide, I’ll walk you through the steps to set up this no-code solution. Whether you’re gathering…

In this guide, I’ll walk you through the key differences between RAG and Agentic RAG, how they work,…

In this article, I’ll walk you through how to set up and use ScrapydWeb to deploy your spiders,…

When you’re scraping data from websites with Puppeteer, timing is everything. If your page isn’t fully loaded before you…

In this article, I’ll delve into how Rust is being used today, the impact it’s having across various industries, and…

In this article, I’ll show you how to build a basic distributed web crawling system using Python, Celery,…

In this article, I’ll explain what anti-bots are, how they work, and how you can get around them…

In this article, we’ll walk you through how to scale up your web scraping using Puppeteer Cluster, allowing you…

In this article, I’ll walk you through the process of scraping the cf_clearance cookie from Cloudflare-protected sites and…

If you’re using Rust (like I am), you’ll want a parser that’s fast, safe, and easy to work…

In this guide, I’ll walk you through how to set puppeteer-humanize up, use it, and talk about its limits —…