Data Integration
Competitive research with an edge: scrape any webpage with Talend
We’re back with another Job of the Week! The title is admittedly growing on me...
This week’s job takes us into the world of data scraping. First, let’s answer two common FAQ’s:
What is data scraping?
Data scraping refers to the technique of extracting data from another program. Most commonly, this process is used in web scraping: using an application to extract valuable information from a website.
What is data scraping used for?
While this has a wide range of use cases, the most common use of extracting data (or, data scraping) is web scraping for competitive and market research. Great example? E-commerce websites. Extracting product and pricing data from e-commerce websites could give you intelligence on trends, pricing, and more – enabling better marketing decisions based on what others in your market are doing. Other uses include:
Product trend monitoring
Price intelligence
Competitor monitoring
Market research
Even lead generation!
While collecting data can be a lot harder than it looks, this will show you just how simple the job structure really is.
Richard starts by teaching you how to extract link titles and URLs from a website. Download the full job here, and watch the full segment below:
So you’re thinking about moving to the cloud, but not sure where to start? In this episode, our hosts explore the most important things to consider when moving to the cloud (or migrating to a new cloud). From what to look for in a cloud provider to whether to choose a multi-cloud solution to the benefits of cloud vs on-premises, you won’t want to miss this episode.
In this article:
Data Integration