In the enterprise data analytics arena, the traditional enterprise data warehouse has a new and powerful counterpart: the data warehouse powered by Hadoop. Sometimes called a "data lake", a data warehouse Hadoop system has advantages that make it a compelling complement or alternative to the conventional data warehouse, including the ability to aggregate and analyze a greater volume and variety of data and to do so at a lower cost than conventional data warehouse technologies. Along with these rewards come challenges around Hadoop data ingestion and management of the data warehouse Hadoop system. Many leading companies have turned to Qlik (Attunity) software to meet these data warehouse Hadoop challenges.

Data Warehouse Hadoop Ingestion with Qlik Replicate (formerly Attunity Replicate)

Qlik (Attunity) is a long-time leader in the enterprise data management space, always pushing the envelope to redefine answers to core questions like what is data replication and integration in the modern enterprise. For the more than 2000 Qlik (Attunity) customers worldwide, modern data integration is increasingly focused on big data ingestion into data warehouse Hadoop environments to power analytics and business intelligence.

As a solution for migrating data into a data warehouse Hadoop platform, Qlik Replicate (formerly Attunity Replicate) is:

  • Simple to use. Data architects and analysts can configure, execute, and monitor Hadoop data ingestion jobs through the Qlik Replicate (formerly Attunity Replicate) graphical user interface, with no need for manual scripting and no need for deep expertise in the source system protocols or Hadoop protocols.
  • Versatile. Through a single unified solution, Qlik Replicate (formerly Attunity Replicate) users can create Hadoop data ingestion feeds from nearly any type of source system – whether it's Oracle to Hadoop data migration or ingestion into Hadoop from any other major RDBMS, enterprise data warehouse, mainframe, or file system. On the Hadoop side, Qlik Replicate (formerly Attunity Replicate) supports all leading Hadoop distributions as well as cloud-based Hadoop platforms such as AWS Elastic MapReduce.
  • Fast. Qlik Replicate (formerly Attunity Replicate) supports high-volume, high-performance bulk loading from the source systems to the data warehouse Hadoop environment and then can automatically switch over to log-based change data capture to continuously stream in fresh source data to support real time data warehousing and timely analytics.

Data Warehouse Hadoop Management with Qlik Visibility (formerly Attunity Visibility)

The large volume and variety of data in a typical data warehouse Hadoop environment poses challenges for operational control, governance, and capacity management. That's why organizations often pair the Qlik Replicate (formerly Attunity Replicate) Hadoop data integration tool with Qlik Visibility (formerly Attunity Visibility) software for data usage analytics. With Qlik Visibility (formerly Attunity Visibility), Hadoop operations staff can maintain real-time insight into:

  • Hadoop storage and compute usage trends and projections
  • Which data in the Hadoop cluster is heavily used, lightly used, or not used at all
  • Which Hadoop applications and workloads are consuming the most compute resources
  • Hadoop resource usage broken down by business group and by individual users
  • And more