Design, build, and optimize enterprise-scale Databricks and data lakehouse architectures. Develop and maintain data pipelines using Apache Spark, Delta Lake, and related technologies.
Numbers & Facts
Location
Atlanta, GA
Job Type
Full-time
Description
Benefits:
401(k) matching
Dental insurance
Health insurance
Databricks Architect Atlanta GA Onsite
Responsibilities:
Design, build, and optimize enterprise-scale Databricks and data lakehouse architectures
Develop and maintain data pipelines using Apache Spark, Delta Lake, and related technologies
Collaborate with data engineers, analysts, and business stakeholders to define technical requirements
Establish best practices for data governance, security, and performance tuning within Databricks
Lead cloud data platform integrations across AWS, Azure, or GCP environments
Provide technical guidance and mentorship to junior data engineering team members
Monitor, troubleshoot, and continuously improve platform reliability and efficiency
Requirements:
5+ years of experience in data architecture, data engineering, or a related field
Hands-on expertise with Databricks, Apache Spark, and Delta Lake
Proficiency in Python, Scala, or SQL for large-scale data processing
Experience with cloud platforms such as AWS, Microsoft Azure, or Google Cloud Platform
Strong understanding of data lakehouse, data warehouse, and ETL/ELT design patterns
Databricks Certified Associate or Professional certification is a plus
Excellent communication skills with the ability to translate complex technical concepts to stakeholders