AWS Lambda, Access Control, Amazon Simple Storage Service (S3), Amazon Web Services (AWS), Application Integration, Application Programming Interface (API), Architectural Design, Architectural Services, Artificial Intelligence (AI), Automation, Business Skills, Capability Maturity Model (CMM), Cisco Unity, Cloud Computing, Communication Skills, Consulting, Continuous Deployment/Delivery, Continuous Integration, Cost Control, Data Management, Data Modeling, Data Quality, Data Warehousing, Database Extract Transform and Load (ETL), Disaster Recovery, Docker, Documentation, Electronic Medical Records, Financial Services, Fortune 1000 Customers, GitHub, Government, Hybrid Cloud, Information Technology & Information Systems, Information Technology Consulting, Information Technology Outsourcing, Jenkins, Leadership, Manufacturing, Mentoring, Metadata, Model Validation, Nearshoring, Operational Support, Performance Tuning/Optimization, Policy Implementation, Programming Tools, Recruiting Strategy, Requirements Management, Security Compliance, Software Development Lifecycle (SDLC), Software Engineering, System Integration (SI), Technical Leadership, Technical Support, Technical Writing, Technical/Engineering Design, Telecommunications
Stefanini Group is hiring!
Stefanini is looking for a Lead Cloud Data Engineer (Data Mesh & AI) for San Francisco, CA/Los Angeles, CA (Onsite)
For quick Apply, please reach out to Prakhar Goel: 248 263 5255/ Prakhar.goel@stefanini.com
W2 candidates Preferred!
We are seeking an experienced Lead Data Engineer to join our team and drive the development of modern data platforms and AI-augmented solutions. This role is critical to supporting ongoing operations of Large Data Warehouse, architecting the Large Data Hub, and preparing for the enterprise data mesh modernization program.
Responsibilities:
Data Engineering & Pipeline Development:
Develop and maintain end-to-end ETL/ELT pipelines for data ingestion from multiple sources (databases, APIs, streaming), transformation, quality validation, data modeling, and consumption layer optimization using AWS services (Glue, EMR, Lambda, Kinesis, Step Functions)Implement data governance policies, metadata management, data lineage tracking, fine-grained access controls, and automated data quality frameworks with validation rules, anomaly detection, and monitoring/alerting mechanismsData Mesh Architecture:
Design and implement Data Mesh architecture on AWS with federated governance, defining domain boundaries, data product specifications, and self-serve infrastructure patterns across Databricks, Starburst, Collibra, and Immuta platformsDevelop reusable frameworks, accelerators, and self-serve tools enabling domain teams to independently publish, discover, and consume data products while ensuring performance optimization and cost efficiencyDevSecOps & Infrastructure:
Integrate DevSecOps practices including CI/CD pipelines, infrastructure as code (Terraform/CloudFormation), automated security scanning, compliance validation, and disaster recovery strategies
AI-Augmented Development:
Design and build agentic AI solutions, RAG pipelines, and intelligent automation using LLMs, orchestration frameworks, and AI-powered development tools (Copilot, Claude Code) to enhance platform capabilities and accelerate SDLC
Technical Leadership & Collaboration:
Provide L3 technical support and mentor engineering teams on data mesh principles and modern data technologiesCollaborate with stakeholders to translate business requirements into technical solutionsLead architecture design reviews and create comprehensive technical documentation
#LI-PG1
#LI-ONSITE
Qualifications:
Data Mesh Architecture & AWS (5+ years required):
Deep experience designing distributed data architectures on AWS (S3, Glue, Lake Formation, EMR, Redshift)Hands-on implementation of data mesh principles including domain-oriented data ownership, data as a product, and federated computational governance
Modern Data Platform Technologies:
Proficiency: Databricks (Unity Catalog, Delta Lake), Starburst/Trino (federated query), Collibra (data governance), or Immuta (dynamic data access control)Ability to architect multi-technology solutions
DevSecOps & Infrastructure as Code:
Strong experience with CI/CD pipelines (GitLab/GitHub Actions, Jenkins)Containerization expertise (Docker/ECS)Infrastructure automation (Terraform, CloudFormation)Security compliance frameworks for AWS GovCloud environments
AI-Augmented Development & Engineering:
Demonstrated use of generative AI tools for accelerating SDLC activities including code generation, testing, and documentationExperience designing or implementing agentic AI solutions using Amazon Bedrock or similar frameworks
Leadership & Soft Skills
Proven ability to translate business requirements into technical solutionsExperience leading technical design sessions and mentoring engineering teamsStrong communication skills to convey complex architectural concepts to both technical and non-technical stakeholdersExperience working across hybrid cloud/on-premises environments
Listed salary ranges may vary based on experience, qualifications, and local market. Also, some positions may include bonuses or other incentives.
Stefanini takes pride in hiring top talent and developing relationships with our future employees. Our talent acquisition teams will never make an offer of employment without having a phone conversation with you. Those face-to-face conversations will involve a description of the job for which you have applied. We also speak with you about the process including interviews and job offers.
About Stefanini Group:
The Stefanini Group is a global provider of offshore, onshore and near shore outsourcing, IT digital consulting, systems integration, application, and strategic staffing services to Fortune 1000 enterprises around the world. Our presence is in countries like the Americas, Europe, Africa, and Asia, and more than four hundred clients across a broad spectrum of markets, including financial services, manufacturing, telecommunications, chemical services, technology, public sector, and utilities. Stefanini is a CMM level 5, IT consulting company with a global presence. We are CMM Level 5 company.
S
Stefanini
Stefanini is a global IT services company with over 24,000 employees across 77 offices in 40 countries across the Americas, Europe, Africa, Australia, and Asia. Since 1987, Stefanini has been providing offshore, onshore and nearshore IT services, including application development and outsourcing services, IT infrastructure outsourcing (help desk support and desktop services), systems integration, consulting and strategic staffing to Fortune 1000 enterprises around the world.
With a base of over 500 active clients, including more than 300 multinationals, Stefanini maintains a strong presence in industries such as financial services, manufacturing, telecommunications, chemical, services, technology, public sector, and utilities. Clients benefit from Stefanini's financial stability, sustained year-over-year growth, and zero net debt. The corporate global headquarters is located in Sao Paulo, Brazil with European headquarters in Brussels and North American headquarters in metropolitan Detroit.