A Variety Of Purposes For Using Web Data Extraction

Web data extraction has a lot of purposes: web indexing, web mashup, web data integration, data mining, website change detection, price change and price comparison monitoring, gathering information about real estate, many kinds of research and tracking and so on. Most common techniques used to extract web data are a simple manual examination, meaning copy/paste, HTTP programming, text pattern matching, HTML parsing, Vertical aggregation, DOM parsing, Computer vision webpage analysis and so on. Also, many software companies have developed specific, customized tools for data extraction.

Finally, even though data extraction (web scraping) is a common practice, the legality of it can vary from country to country. Many websites cite data extraction to be contrary to the terms of use, but the main question is the methods on how to enforce these terms.