Highlights
The ideal candidate will have strong expertise in Spark, Delta Lake, data engineering, and cloud platforms (Azure/AWS/GCP), along with proven experience in architecting modern data solutions. We are looking for an experienced Databricks Architect to lead the design, development, and implementation of scalable data platforms on Databricks.
Numbers & Facts
| Location | Dallas, TX |
| Industry | Computer/IT Services |
| Company Size | 1,500 to 1,999 employees |
| Year Founded | 2004 |
| Website | https://www.anblicks.com/ |
Description
Databricks Architect
Job Summary
We are looking for an experienced Databricks Architect to lead the design, development, and implementation of scalable data platforms on Databricks. The ideal candidate will have strong expertise in Spark, Delta Lake, data engineering, and cloud platforms (Azure/AWS/GCP), along with proven experience in architecting modern data solutions.
Key Responsibilities
- Design and implement end-to-end data architecture using Databricks Lakehouse platform
- Define data engineering best practices and build scalable ETL/ELT pipelines
- Architect solutions leveraging Apache Spark (PySpark/Scala) and Databricks workflows
- Implement Delta Lake for data reliability, performance, and governance
- Collaborate with stakeholders to understand business requirements and translate them into technical solutions
- Optimize performance, cost, and scalability of data pipelines
- Provide technical leadership, mentoring data engineers and developers
- Ensure data security, governance, and compliance standards are met
- Integrate Databricks with cloud services (Azure, AWS, or GCP) and other enterprise systems
- Support real-time and batch data processing use cases
Required Skills & Qualifications
Technical Skills
- Strong hands-on experience with Databricks Platform
- Expertise in Apache Spark (PySpark / Scala / SQL)
- Experience with Delta Lake, Unity Catalog, and Lakehouse architecture
- Proficiency in data pipelines, ETL/ELT frameworks
- Strong experience in SQL and data modeling
- Hands-on experience with cloud platforms:
- Azure (ADF, ADLS, Synapse) OR
- AWS (S3, Glue, EMR) OR
Data Engineering Concepts
- Data warehousing and data lake solutions
- Batch & real-time data processing
- Data governance and security frameworks
- Performance tuning and optimization
Tools & Technologies
- Databricks Workflows / Jobs
- Airflow / ADF / Prefect (any orchestration tool)
- CI/CD pipelines (Azure DevOps, GitHub Actions)
- Streaming tools like Kafka (preferred)
Preferred Qualifications
- Databricks Certifications (e.g., Databricks Certified Professional / Associate)
- Experience in data migration to Databricks
About Company
Since 2004, Anblicks has been helping customers across the globe, enabling them with digital transformation services. Anblicks specialized in delivering Big Four consulting experience to mid-size enterprises.
Anblicks employs more than 400 technology professionals and over 100 data analysts and data science experts. With a focus on Logistics, Healthcare, BFSI and Retail industries, Anblicks continues to drive technology innovation while providing customers with world-class levels of services and support.
Anblicks is headquartered in Dallas, Texas with additional offices in other U.S. states, Canada and India.