Live Workshop

Mastering Data Harmony: Techniques for Matching and Deduplication of Scraped Data

December 13, 2023
Workshop Summary

In this interactive workshop, we delve into the complex issue of matching and deduplicating data as your web scraping projects extend across multiple data sources. Linking items between different domains, connecting products between e-commerce sites, matching real estate listings to public records, and correlating news stories between newspapers - these all pose significant challenges.

Learning how to efficiently aggregate this information is vital for constructing a resilient database that data scientists can leverage for insights or resale to other businesses.

Participants will learn about:
- Recognizing the importance and challenges of data matching and deduplication in web scraping projects.
- Exploring various approaches to tackle this issue in their pipelines, from simple solutions like sniffing unique IDs from within HTML, to complex strategies involving multimodal matching using text and image vector representations.
- Creating robust databases using the matching and deduplication techniques learned.
- Understanding the value of these databases to data scientists and other businesses.

Join Our Free Community to Participate in The Workshop

linkedin facebook pinterest youtube rss twitter instagram facebook-blank rss-blank linkedin-blank pinterest youtube twitter instagram