Python Databricks Developer

The ideal candidate will have strong expertise in Python, FastAPI, Databricks, PySpark, SQL, and cloud-based data engineering, with experience building data pipelines, REST APIs, and analytics solutions in enterprise environments. Integrate APIs with data platforms including Azure Data Lake, Databricks, Snowflake, SQL databases, and cloud services.

Job title: Python Databricks Developer
Location: Plano, TX 75075 (Onsite)
Duration: 08 Months

Minimum years of experience required: 8-10 Years
Education Qualification required: BE

Detailed JD Given below:
Role Objective
Python FastAPI & Databricks Developer to design, develop, and maintain scalable data and application solutions. The ideal candidate will have strong expertise in Python, FastAPI, Databricks, PySpark, SQL, and cloud-based data engineering, with experience building data pipelines, REST APIs, and analytics solutions in enterprise environments

Key Responsibilities
Design and develop scalable REST APIs using Python FastAPI.
Build and optimize ETL/ELT pipelines using Databricks and PySpark.
Develop data ingestion, transformation, and processing frameworks for structured and unstructured data.
Create and maintain Delta Lake architectures following Bronze, Silver, and Gold layer standards.
Integrate APIs with data platforms including Azure Data Lake, Databricks, Snowflake, SQL databases, and cloud services.
Implement data quality checks, monitoring, logging, and alerting mechanisms.
Optimize Spark jobs for performance and cost efficiency.
Collaborate with data scientists to operationalize ML models and data products.
Participate in code reviews, testing, CI/CD implementation, and production support.
Ensure adherence to security, governance, and coding standards

Required Skills & Qualifications
Technical Skills
Strong experience with Python (Advanced),FastAPI, REST API Development, Async Programming (async/await).
Hands-on experience in Databricks, PySpark, Spark SQL, Delta Lake, Data Modeling, ETL/ELT Design.
Knowledge in CI/CD automation, deployment pipelines, and DevOps practices.
Strong Expertise in stakeholder management

Qualifications
6 years of experience in Python and Databricks Skills.
Python/Databricks certifications are preferred.
Strong analytical, troubleshooting, and problem-solving skills.
Excellent communication and collaboration skills in a global delivery environment.