Design and implement data pipelines in Azure Databricks for ingesting and transforming data from upstream systems, including SAP, PIPS, POS into WFM and UKG. Collaborate with Java/API developers to integrate event-driven triggers into data pipelines.
Numbers & Facts
Location
Washington, DC
Description
Job Titel: Databrick Engineer
Location: Seattle, WA
Duration: 6 months
Job ID: 10492558
Role Description
Design and implement data pipelines in Azure Databricks for ingesting and transforming data from upstream systems, including SAP, PIPS, POS into WFM and UKG
Optimize ETL/ELT workflows for performance and scalability
Collaborate with Java/API developers to integrate event-driven triggers into data pipelines
Implement data quality checks, schema validation, and error handling
Support batch and near-real-time data flows for both operational and analytics use cases
Work with Boomi and WFM teams to ensure data contracts and canonical models are enforced
Essential Skills
Design and implement data pipelines in Azure Databricks for ingesting and transforming data from upstream systems, including SAP, PIPS, POS into WFM and UKG
Optimize ETL/ELT workflows for performance and scalability
Collaborate with Java/API developers to integrate event-driven triggers into data pipelines
Implement data quality checks, schema validation, and error handling
Support batch and near-real-time data flows for operational and analytics use cases
Work with Boomi and WFM teams to ensure data contracts and canonical models are enforced