Lead Data Engineer

Encora Digital

  • Brazil, IN
  • 29 days ago

    Highlights

    Lead and mentor a team of data engineers, setting technical direction, conducting code reviews, and promoting engineering excellence. Collaborate closely with cross-functional stakeholders (data, product, architecture, and business teams) to translate requirements into robust technical designs.

    Numbers & Facts

    LocationBrazil, IN

    Description

    Job Title: Lead Data Engineer

    Key Skills: DBT, Python, SQL, Snowflake, Databricks

    Location: Brazil

    Mode: Remote

    We at Coforge are hiring Lead Data Engineer with the following skill set.

    Key Responsibilities

    • Lead and mentor a team of data engineers, setting technical direction, conducting code reviews, and promoting engineering excellence.
    • Own the end-to-end architecture and design of the data platform, ensuring scalability, reliability, and alignment with business needs.
    • Take full ownership of implementation delivery, from design through deployment, ensuring high-quality, production-ready solutions.
    • Define and drive the data migration strategy from Snowflake / SSIS to Azure Databricks and DBT, including architecture decisions and execution oversight.
    • Collaborate closely with cross-functional stakeholders (data, product, architecture, and business teams) to translate requirements into robust technical designs.
    • Design and oversee the development of scalable data pipelines and data models, ensuring best practices in performance and maintainability.
    • Lead the implementation of infrastructure-as-code using Terraform, enforcing consistency and automation across environments.
    • Establish and enforce architectural standards, design patterns, and engineering best practices across the data ecosystem.
    • Ensure reliable and efficient data integration between Legacy system and Azure environments, with strong focus on data quality and observability.
    • Drive CI/CD adoption and oversee release processes for data pipelines and platform components.
    • Act as the primary technical owner for troubleshooting complex issues and ensuring long-term stability of the platform.
    • Maintain comprehensive documentation of architecture, design decisions, and implementation standards.

    Required Skills & Qualifications

    • Proven experience owning system design and leading implementations of large-scale data platforms.
    • Strong hands-on expertise with Snowflake, Azure Databricks, and DBT with strong Python.
    • Will have worked on large scale data transformations comprising of thousands of DBT models and data pipelines handling terabytes of data daily
    • Deep understanding of data architecture, data modelling, and distributed data systems.
    • Extensive experience with Terraform and infrastructure-as-code principles.
    • Demonstrated experience leading cloud-to-cloud data migration projects (AWS to Azure preferred).
    • Strong experience with CI/CD pipelines and Git-based version control.
    • Advanced SQL skills and deep knowledge of ETL/ELT frameworks.
    • Strong problem-solving skills with the ability to make architectural trade-offs and decisions.
    • Excellent communication skills, with the ability to influence both technical and non-technical stakeholders.
    • Ability to thrive in a fast-paced, ownership-driven environment.
    • Previous experience in the insurance or financial sector industry, with strong understanding of core domains such as claims, policies, underwriting, and risk.
    • Will have manged teams with a level of maturity and able to demonstrate key success outcomes with these teams.
    • Will have managed low, mid and top performers within the team to get the best from them via mentoring, development and training needs where needed.

    Preferred Skills:

    • Experience implementing data governance, observability, and quality frameworks.
    • Strong knowledge of security and compliance standards in insurance or financial services.
    • Experience with real-time and streaming data technologies (Kafka, Event Hubs, Delta Live Tables).
    • Familiarity with lakehouse architecture and cost/performance optimization strategies.
    • Experience operating in multi-cloud or hybrid cloud environments.

    Posted On: 14-07-2026

    At Coforge, we hire professionals based solely on their skills and do not discriminate based on age, disability, religion, gender, sexual orientation, socioeconomic status, or nationality.

    Similar Jobs