10+ years of Data Engineering experience with 7+ years of hands-on Databricks expertise delivering large-scale cloud modernization programs. Drive implementation of ETL/ELT pipelines, Lakeflow Jobs, DLT pipelines, Auto Loader, CDC, and Data Quality frameworks.
Numbers & Facts
Location
Jacksonville, FL (Remote)
Description
Position: Lead Databricks Data Engineer Location: Remote Duration: Contract
10+ years of Data Engineering experience with 7+ years of hands-on Databricks expertise delivering large-scale cloud modernization programs.
Strong expertise in Databricks, PySpark, Python, SQL, AWS, Delta Lake, Unity Catalog, and Lakehouse Architecture.
Lead Redshift-to-Databricks migration strategy, including discovery, assessment, dependency analysis, and migration planning.
Design and govern target-state architecture, including Medallion layers, data modeling, security, observability, and DevSecOps standards.
Drive implementation of ETL/ELT pipelines, Lakeflow Jobs, DLT pipelines, Auto Loader, CDC, and Data Quality frameworks.
Lead onshore/offshore teams, provide technical guidance, conduct design reviews, and ensure delivery excellence across all workstreams.
Collaborate with business, architecture, security, infrastructure, governance, and application teams to manage dependencies, risks, and solution decisions.
Own migration execution through testing, validation, cutover, hypercare, governance, and stakeholder communication, ensuring a secure and compliant Databricks platform.