WEB DATA EXTRACT SUMMIT 2025

Enterprise-scale scraping demands control, reliability, and engineering discipline that no-code AI tools can’t match. AI coding offers hope, but often fails to deliver effective spiders. This talk shows how to bridge the gap and meet the needs of professional web data teams.

Learn how advanced scraping teams decode anti-bot systems at scale, reverse-engineering requests, exploiting weaknesses, and deploying resilient bypasses across thousands of feeds without compromising speed, stability, or compliance in real-world high-volume environments.

Unpack the AI-era web scraping arms race, where LLMs write scrapers, proxies crash in cost, and bots evade detection—revealing the real-world stack behind scalable data extraction, price intelligence, and modern web-scale signal mining.

Learn how data extraction teams scale horizontal scraping to uncover contact intelligence from hundreds of thousands of unknown company websites, discovering hidden domains via POI datasets and map APIs, decoding diverse layouts with adaptive rules and NER, and extracting emails and phones using LLMs and SpaCy—delivering structured intelligence across massive, unpredictable web ecosystems without sacrificing speed, cost, or precision.

Discover why web scraping is uniquely hard for AI agents. This talk explains the key challenges that cause them to fail and offers practical strategies and tools to make agents more resilient in real-world scraping.

Learn how advanced scraping teams harness IPv6 to unlock vast, low-cost address space for cleaner, faster, and more resilient operations—understanding how sites assign reputation to IPv6 blocks, mastering rDNS for credibility, and isolating jobs across /48 segments to maximize success at scale.

Learn how legal experts navigate the intersection of AI, web scraping, and intellectual property, covering topics like the EU AI Act, risk assessment for AI systems, prohibited uses, copyright case law including fair use debates, guidance from data protection authorities, and how to ensure compliance while fostering innovation.

Investigate how bot-generated content, synthetic signals, and looming regulations like the EU AI Act reshape scraping—forcing practitioners to rethink trust, traceability, and tactics in a web where authenticity is no longer guaranteed.

Learn how SerpApi scales scraping Google using geolocated proxies, headless browsers, and adaptive parsing pipelines to reliably extract search results across languages, devices, and experiments while converting unstable HTML into clean, usable data.