Databricks – Data Pipeline Automation with Spark

Qlik (Attunity) offers solutions for real-time data ingest and pipeline automation for the Databricks Unified Analytics Platform to accelerate machine learning (ML), artificial intelligence (AI) and data science initiatives.

Attunity Replicate

Universal data replication and data ingestion

Attunity Replicate® continuously integrates multiple data sources (Oracle, Microsoft SQL Server, SAP, mainframe and more) into the Databricks Unified Analytics Platform. Attunity Replicate’s  automated change data capture (CDC) helps customers avoid the heavy lifting of manually extracting data, transferring via API/script, chopping, staging, and importing.

Key benefits of Attunity Replicate are quick and easy setup, CDC, data integrity with check mechanisms, monitoring for peace of mind, control and auditing, and secure data delivery with industry-standard SSL encryption.

“Attunity provides a great complement to our Databricks Unified Analytics Platform by delivering a wide variety of transactional data sources in real-time and at massive scale directly into Databricks Unified Analytics Platform. Building machine learning models requires data teams to iterate on data. Attunity solutions ensure that data teams are using the most up-to-date data possible.”

Pankaj Dugar, Vice President of ISV & Technology Partners, Databricks

Attunity Replicate

Agile data lake and data warehouse automation

Attunity® Compose for Data Lakes automates the data pipeline to create analytics-ready data in Databricks Delta. Data continuously flows through the pipeline from initial ingestion, into a full historical data store and ultimately to provisioned data marts. Transformation logic is automatically generated without the need for manual coding and pushed down to Spark for runtime execution.

Learn more about Attunity Replicate.