Databricks Lead

Role: Lead

Required Skills: Python | Apache Spark

Qualification: BACHELOR OF COMPUTER SCIENCE

Experience: 10 - 20 Years

Function: TECHNOLOGY

Apply By: 2026-12-19

Must Have Technical/Functional Skills

• Databricks Lakehouse Platform
• Delta Lake
• Unity Catalog
• Databricks Workflows
• Databricks SQL
• Delta Live Tables
• MLflow
• Apache Spark
• PySpark
• Data Modeling
• ETL/ELT Architecture
• Streaming Data Processing
• Data Quality Frameworks
• Event-Driven Architectures

Programming

• Python
• SQL

Roles & Responsibilities

• Define and execute the enterprise data platform strategy leveraging Databricks and cloud-native

technologies.

• Establish reference architectures, standards, and engineering best practices.
• Lead technical design reviews and architecture governance forums.
• Create reusable frameworks and accelerators to improve productivity and quality.
• Design and oversee implementation of scalable batch, streaming, and real-time data pipelines.
• Lead development of data products supporting analytics, reporting, data science, and AI

initiatives.

• Ensure high standards for reliability, scalability, observability, security, and maintainability.
• Drive adoption of DataOps, DevOps, and CI/CD practices across engineering teams.
• Define enterprise Lakehouse architecture patterns.
• Establish data models, storage strategies, and data lifecycle management processes.
• Lead implementation of data governance, metadata management, lineage, and access controls.
• Ensure platform compliance with organizational security and regulatory requirements.
• Partner with data science and AI teams to operationalize machine learning workloads.
• Enable model training, deployment, monitoring, and lifecycle management.
• Support GenAI, predictive analytics, and intelligent automation initiatives.
• Build scalable data foundations for AI-driven business capabilities.
• Lead and mentor data engineering teams.
• Manage technical delivery across multiple workstreams and vendors.
• Collaborate with business stakeholders to translate requirements into scalable solutions.
• Provide regular updates to leadership on delivery progress, risks, and architectural decisions.

Generic Managerial Skills

• 12+ years of experience in Data Engineering and Analytics.
• 5+ years of hands-on Databricks experience.
• 3+ years leading enterprise-scale data engineering teams.
• Proven experience building large-scale cloud data platforms.
• Experience leading distributed teams in Agile delivery environments

Salary Range: $130,000-$150,000 a year

TCS Employee Benefits Summary:

Discretionary Annual Incentive.

Comprehensive Medical Coverage: Medical & Health, Dental & Vision, Disability Planning & Insurance, Pet Insurance Plans.

Family Support: Maternal & Parental Leaves.

Insurance Options: Auto & Home Insurance, Identity Theft Protection.

Convenience & Professional Growth: Commuter Benefits & Certification & amp; Training Reimbursement.

Time Off: Vacation, Time Off, Sick Leave & Holidays.

Legal & Financial Assistance: Legal Assistance, 401K Plan, Perform ance Bonus, College Fund, Student Loan Refinancing.

#LI-SP1