DEV Community

Scraping

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
How to Scrape Google Search Results with Python Without Getting Blocked (2026)
zyvop profile

How to Scrape Google Search Results with Python Without Getting Blocked (2026)

#pythongooglescraper2026 #googleserpscrapingpython #scraping #beautifulsoup4
Comments
10 min read
Proxy Rotation & Session Management for AI Web Agents
alterlab profile

Proxy Rotation & Session Management for AI Web Agents

#scraping #python #api #proxies
Comments
6 min read
I Built an API That Turns Any Website Into JSON Using Just CSS Selectors
sergio_morales_c705507bcd profile

I Built an API That Turns Any Website Into JSON Using Just CSS Selectors

#showdev #webdev #api #scraping
Comments
2 min read
Rate Limits & Anti-Bots in Agentic Scraping
alterlab profile

Rate Limits & Anti-Bots in Agentic Scraping

#antibot #scraping #ratelimiting #python
1
Comments
5 min read
The Anti-Bot Detection Checklist I Use Before Every Scraping Project
charles_90891cea4a1800830 profile

The Anti-Bot Detection Checklist I Use Before Every Scraping Project

#scraping #bots #tutorial #node
Comments
4 min read
My Apify Promotion Filter: Scale Clean APIs, Hold Back Noisy Demand
the_aientrepreneur_7ae85 profile

My Apify Promotion Filter: Scale Clean APIs, Hold Back Noisy Demand

#webdev #api #apify #scraping
Comments
3 min read
Regex broke my scraper: Using LLMs for robust data extraction
__c1b9e06dc90a7e0a676b profile

Regex broke my scraper: Using LLMs for robust data extraction

#webdev #ai #python #scraping
2
Comments
5 min read
My web scraping nightmare ended when I let an LLM read the HTML
__c1b9e06dc90a7e0a676b profile

My web scraping nightmare ended when I let an LLM read the HTML

#webdev #python #ai #scraping
Comments
5 min read
I Thought I Knew Web Scraping — Until I Hit JavaScript
__c1b9e06dc90a7e0a676b profile

I Thought I Knew Web Scraping — Until I Hit JavaScript

#webdev #python #scraping #ai
Comments
4 min read
Why I Gave Up on Regex and Started Using AI for Web Scraping
__c1b9e06dc90a7e0a676b profile

Why I Gave Up on Regex and Started Using AI for Web Scraping

#webdev #python #ai #scraping
Comments
5 min read
I Spent a Weekend Fighting Flaky Scrapers — Here’s What Finally Worked
__c1b9e06dc90a7e0a676b profile

I Spent a Weekend Fighting Flaky Scrapers — Here’s What Finally Worked

#webdev #python #ai #scraping
Comments
5 min read
Advanced Headless Browser Anti-Bot Techniques: TLS & Canvas
alterlab profile

Advanced Headless Browser Anti-Bot Techniques: TLS & Canvas

#antibot #headlessbrowsers #api #scraping
Comments
6 min read
Optimizing Chunking and Data Extraction for Zero-Hallucination RAG
alterlab profile

Optimizing Chunking and Data Extraction for Zero-Hallucination RAG

#rag #llm #datapipelines #scraping
Comments
4 min read
Scraping Real Estate & Job Data with Python: Zillow, Indeed & More (2026)
zyvop profile
ZyVOP

Scraping Real Estate & Job Data with Python: Zillow, Indeed & More (2026)

#scraping #scrapezillowpython2026 #scrapeindeedjoblistingspython #pythonjobboardscraper
Comments
14 min read
Track YC Demo Day Companies in Real Time (with code)
nexgendata profile

Track YC Demo Day Companies in Real Time (with code)

#ycombinator #demoday #scraping #preseed
Comments
5 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.