Databricks – Data Pipeline Automation with Spark

Qlik (Attunity) offers solutions for real-time data ingest and pipeline automation for the Databricks Unified Analytics Platform to accelerate machine learning (ML), artificial intelligence (AI) and data science initiatives.

Qlik Replicate

Universal data replication and data ingestion

Qlik Replicate™ (formerly Attunity Replicate) continuously integrates multiple data sources (Oracle, Microsoft SQL Server, SAP, mainframe and more) into the Databricks Unified Analytics Platform. Qlik Replicate’s  automated change data capture (CDC) helps customers avoid the heavy lifting of manually extracting data, transferring via API/script, chopping, staging, and importing.

Key benefits of Qlik Replicate are quick and easy setup, CDC, data integrity with check mechanisms, monitoring for peace of mind, control and auditing, and secure data delivery with industry-standard SSL encryption.

“Qlik provides a great complement to our Databricks Unified Analytics Platform by delivering a wide variety of transactional data sources in real-time and at massive scale directly into Databricks Unified Analytics Platform. Building machine learning models requires data teams to iterate on data. Qlik solutions ensure that data teams are using the most up-to-date data possible.”

Pankaj Dugar, Vice President of ISV & Technology Partners, Databricks

Qlik Replicate

Agile data lake and data warehouse automation

Qlik Compose™ for Data Lakes (formerly Attunity Compose) automates the data pipeline to create analytics-ready data in Databricks Delta. Data continuously flows through the pipeline from initial ingestion, into a full historical data store and ultimately to provisioned data marts. Transformation logic is automatically generated without the need for manual coding and pushed down to Spark for run time execution.

Learn more about Qlik Replicate.