A leading financial services organization is seeking a Senior Databricks Cloud Platform Engineer to help design, build, and optimize a modern cloud-based data platform supporting enterprise analytics and data initiatives.
This position combines hands-on engineering with architectural responsibilities, offering the opportunity to build scalable infrastructure, secure cloud environments, and enterprise-grade data platforms using AWS and Databricks.
What You'll Tackle- Design and implement enterprise-scale Databricks solutions on AWS.
- Build scalable and automated data ingestion pipelines.
- Develop cloud-native data lake and lakehouse architectures.
- Optimize Spark workloads for large-scale distributed processing.
- Build Infrastructure as Code using Terraform.
- Configure secure AWS networking including S3, IAM, VPC, and PrivateLink.
- Implement Databricks security and governance best practices.
- Develop REST API integrations and automated ingestion frameworks.
- Collaborate with infrastructure, cloud, security, and application engineering teams.
- Improve platform scalability, reliability, and operational efficiency.
QUALIFICATIONS- 10+ years of cloud, platform, or data engineering experience.
- 5+ years working with Databricks on AWS.
- Strong Python, PySpark, and SQL development skills.
- Hands-on experience with Terraform.
- Deep knowledge of AWS cloud services including S3, IAM, VPC, and PrivateLink.
- Experience building enterprise-scale cloud data platforms.
- Strong understanding of distributed computing and Spark optimization.
- Experience designing secure cloud architectures.
- Experience building REST API integrations.
- Strong communication and stakeholder collaboration skills.
- AWS Certifications.
- Databricks Certifications.
- Unity Catalog.
- CI/CD automation.
- Enterprise cloud security.
- Financial Services experience.