Sr. Data Engineer with Databricks

We are seeking an experienced Senior Data Engineer with strong Databricks expertise to join our data engineering team supporting in Houston, TX. The ideal candidate will have hands-on experience designing and developing scalable data pipelines, data platforms, and ETL/ELT solutions using Databricks, Apache Spark, Python, and SQL.

The candidate will work closely with data architects, analysts, application teams, and business stakeholders to build reliable and high-performance data solutions supporting enterprise analytics and data-driven initiatives.

• Design, develop, and maintain scalable data pipelines and ETL/ELT processes using Databricks.
• Develop data engineering solutions using Databricks, Apache Spark, PySpark, Python, and SQL.
• Build and optimize data pipelines using Delta Lake and Databricks Lakehouse architecture.
• Work with large and complex datasets and implement efficient data transformation and processing strategies.
• Develop batch and near-real-time data ingestion pipelines from multiple enterprise data sources.
• Implement data quality, validation, monitoring, and error-handling processes.
• Optimize Spark jobs, SQL queries, data models, and Databricks workloads for performance and cost.
• Work with cloud-based data platforms and integrate Databricks with enterprise systems.
  Collaborate with data architects and engineering teams on data architecture and solution design.
• Implement CI/CD and automated deployment processes for data engineering workloads.
• Troubleshoot production data pipelines and resolve performance and data-quality issues.
• Participate in code reviews, technical documentation, and engineering best practices.
• Ensure solutions meet enterprise security, governance, scalability, and reliability standards.