$100,000–$140,000 Per Year
Amazon Web Services (AWS), Artificial Intelligence (AI), Business Intelligence, Business Intelligence Software, Cisco Unity, Cloud Computing, Communication Skills, Cost Control, Data Management, Data Processing, Data Quality, Data Science, Data Sets, Database Extract Transform and Load (ETL), GCP (Good Clinical Practices), Microsoft Windows Azure, Performance Tuning/Optimization, Power BI, Problem Solving Skills, Python Programming/Scripting Language, Regulatory Compliance, Requirements Management, SQL (Structured Query Language), Scalable System Development, Tableau
Must Have Technical/Functional Skills
- Design and develop scalable data pipelines and ETL workflows using Databricks (Spark, PySpark)
- Build and optimize Delta Lake architectures for high-performance data processing
- Develop and deploy AI/ML models and advanced analytics solutions
- Implement Agentic AI / GenAI solutions using Databricks (e.g., Agent Bricks, LLM-based workflows)
- Develop BI and analytics datasets for downstream reporting and visualization
- Collaborate with business and data science teams to translate requirements into solutions
- Optimize performance, cost, and scalability of data pipelines on cloud platforms
- Ensure data quality, governance, and compliance standards are met
- Excellent problem-solving and communication skills.
Roles & Responsibilities
We are seeking an experienced Databricks Developer to design, develop, and optimize scalable data and AI-driven solutions on cloud platforms. The role requires strong expertise in data engineering, machine learning, and modern analytics leveraging Databricks and AI frameworks.
Key Responsibilities
- Design and develop scalable data pipelines and ETL workflows using Databricks (Spark, PySpark)
- Build and optimize Delta Lake architectures for high-performance data processing
- Develop and deploy AI/ML models and advanced analytics solutions
- Implement Agentic AI / GenAI solutions using Databricks (e.g., Agent Bricks, LLM-based workflows)
- Develop BI and analytics datasets for downstream reporting and visualization
- Collaborate with business and data science teams to translate requirements into solutions
- Optimize performance, cost, and scalability of data pipelines on cloud platforms
- Ensure data quality, governance, and compliance standards are met
Required Skills & Experience
- Strong hands-on experience with Databricks (Workflows, Delta Lake, Unity Catalog)
- Expertise in ETL/Data Engineering using Spark/PySpark
- Experience with AI/ML model development and deployment
- Knowledge of Agentic AI / GenAI frameworks and LLM integration
- Strong understanding of cloud platforms (AWS / Azure / GCP)
- Experience with BI tools (Power BI, Tableau, etc.)
- Proficiency in SQL, Python
Salary Range: $100,000 to $140,000 per year
T
Tata Consultancy Services Ltd