Lead Data Integration Engineer

EPAM Systems Inc

Atlanta, GA

JOB DETAILS
SKILLS
Amazon Web Services (AWS), Apache, Architectural Design, Architectural Services, Artificial Intelligence (AI), Automation, Bash Scripting, Best Practices, Big Data, C-Level Management, Centers for Disease Control and Prevention (CDC), Cloud Computing, Code Reviews, Computer Programming, Computer Vision, Continuous Deployment/Delivery, Continuous Integration, Data Collection, Data Management, Data Mapping, Data Modeling, Data Storage, Data Warehousing, Database Design, Database Extract Transform and Load (ETL), Documentation, English Language, Enterprise Architecture, GCP (Good Clinical Practices), Git, HIPAA (Health Insurance Portability and Accountability Act), High Reliability, Identify Issues, Identity Data Management, Information/Data Security (InfoSec), Leadership, Machine Learning, Mentoring, Microsoft Windows Azure, OLAP (OnLine Analytical Processing), Performance Analysis, Presentation/Verbal Skills, Python Programming/Scripting Language, Quality Assurance, Regulatory Compliance, Requirements Management, Resource Management, Return on Investment (ROI), Risk Management, SQL (Structured Query Language), Sales Management, Sales Presentation, Scala Programming Language, Schedule Development, Scripting (Scripting Languages), Snowflake Schema, Software Development, Software Engineering, Source Code/Configuration Management (SCM), Sprint Planning, Star Schema, System Integration (SI), Systems Scalability, Team Lead/Manager, Team Player, Technical Leadership, Technical Presentation, Technical/Engineering Design, Testing, Transaction Processing/Management, Writing Skills
LOCATION
Atlanta, GA
POSTED
28 days ago

Back to Search

Lead Data Integration Engineer

Remote in Georgia, & 4 others

Data Integration

apply

FacebookLinkedInSend via email

Looking for something else?

Find a vacancy that works for you. Send us your CV to receive a personalized offer.

Find me a job

Location-specific conditions & benefits*

Choose an option

We are seeking an experienced and visionary Lead Data Integration Engineer to join our growing data solutions team. In this pivotal technical leadership role, you will act as a Tech Lead / Team Lead responsible for architecting, designing, and maintaining complex, enterprise-grade data pipelines.

You will lead a high-performing engineering team (5+ engineers), shaping cloud-native and hybrid data solution architectures while establishing best practices. Leveraging your extensive expertise in cloud infrastructure, database modeling, orchestration, and data security, you will transform raw data environments into robust, high-performance, and scalable analytical assets.

Responsibilities

  • Mentor & Lead: Guide a team of data integration and ETL engineers, fostering a collaborative, innovation-driven culture. Manage sprint planning, resource allocation, and risk management

  • Code Review & Quality Assurance: Conduct regular code reviews and set up testing frameworks to ensure compliant, highly performant, and secure database code (SQL, Python, Scala)

  • Culture of Excellence: Act as a role model, championing modern software development practices (CI/CD, version control via Git, modular code design, automated alerting, and monitoring)

  • Modern ETL/ELT Design: Architect end-to-end data pipeline solutions using serverless frameworks or hybrid setups

  • Orchestration & Automation: Establish robust pipeline scheduling and workflow orchestration using tools like Apache Airflow (Astronomer) or cloud-native schedulers to achieve high pipeline reliability (>99.5%) and minimize troubleshooting times

  • Data Modeling & Warehousing: Design, model, and maintain scalable corporate data systems (OLAP, OLTP, Star/Snowflake schemas, Data Lakes, Lakehouses, and Data Meshes)

  • Change Data Capture (CDC): Implement modern ingestion patterns, CDC methods, micro-batching, delta extracts, and routine partition maintenance

  • Bridge Business & Tech: Collaborate with product owners, enterprise architects, and business stakeholders to translate complex requirements into detailed technical specifications and data-flow diagrams

  • Present Solutions: Confidently present advanced technical architectures to C-level client executives, showcasing ROI, architectural benefits, and performance gains

Requirements

  • Experience: 5+ years of proven experience in data management, database design, migration, storage, and advanced data modeling

  • Leadership: Demonstrated experience leading, mentoring, and developing teams of data engineers (experience managing teams of 4-7 engineers is highly preferred)

  • Data Integration & ETL Tools: Deep hands-on experience with major ETL tools such as Talend, AWS Glue, Azure Data Factory, GCP Dataflow, or Apache NiFi

  • Orchestration Mastery: Strong working experience with orchestration and scheduling engines, particularly Apache Airflow (Astronomer)

  • Programming & Scripting: Strong production coding skills in SQL, Python (PySpark, Pandas), Scala, SparkSQL, or Bash

  • Cloud Platforms: Extensive knowledge of at least one major cloud platform (AWS, Azure, GCP) with emphasis on big data warehousing engines (such as Redshift, Snowflake, Google BigQuery, or Azure Synapse)

  • Infrastructure & Security: Proven understanding of cloud security structures (identity and access management, data masking, and RLS) and compliance standards (GDPR, HIPAA, PI)

  • Documentation: Ability to write high-quality technical design specifications, mapping documentation, and data lineage reports

  • Communication & English: Excellent verbal and written English communication (B2+/C1 level), capable of directly managing international clients and conducting presentations

Nice to have

  • Serverless Engineering: Experience architecting fully serverless cloud data pipelines (e.g., combining AWS S3, Athena, and AWS Lambda)

  • AI/ML Integration: Exposure to integrating machine learning models, computer vision, or generative AI workflows into data pipeline ingestion processes

  • Advanced Certifications: Professional certifications in Cloud Architecture (AWS, Azure, GCP), Talend, or Airflow

About the Company

E

EPAM Systems Inc