Position Title: Microsoft Fabric Data Engineer
Location: Indianapolis, IN.
Let's create our future together at The AES Group!
About The AES Group:
The AES Group is a premier technology consulting company that has been bringing businesses and talent together for over 20 years to deliver the most innovative technology solutions that create the most positive impact on society. AES has helped over 40 business enterprises, including Fortune 500 companies, engage their customers, empower their employees, and transform their business operations with the power of cloud, data, AI, and other emerging technologies.
Our client is building a governed data and AI platform, integrating device, laboratory, partner, and document data into a unified foundation that supports regulatory reporting, advanced analytics, and AI-driven scientific insights
The Data Engineer is a hands-on builder responsible for developing data pipelines, API integrations, and AI infrastructure that bring structured and unstructured data into a governed Azure-based architecture. This delivery-focused role requires designing, coding, testing, and maintaining production-ready solutions across both AI document ingestion and structured ETL/ELT data engineering tracks.
Key Responsibilities
Data Engineering & Integration
- Design, build, and maintain data pipelines that integrate laboratory, quality, design, and partner data into Azure Fabric Lakehouse and PostgreSQL using a Bronze-Silver-Gold architecture.
- Develop ETL/ELT processes with data validation, harmonization, auditability, data quality controls, and regulatory-compliant lineage from source to governed datasets.
- Build AI-ready document ingestion pipelines and MCP connectors for systems such as SharePoint, Qdocs/Veeva, Jama, and TurboAC, supporting semantic search, retrieval, and enterprise LLM applications.
- Develop partner data ingestion workflows leveraging OCR, LLM-based extraction, confidence scoring, and exception handling for external CMO/CRO documentation.
- Implement monitoring, alerting, operational documentation, and data lineage across all pipelines and integrations.
API & Platform Engineering
- Develop and maintain RESTful API and instrument data connectors with secure authentication, error handling, schema management, and production-grade reliability.
- Integrate Azure OpenAI (or equivalent) services into retrieval-augmented generation (RAG) solutions using a vendor-agnostic architecture.
- Build and support cloud-native data solutions across Azure Fabric and AWS, including containerized services, CI/CD pipelines, infrastructure security, secrets management, and cross-cloud data movement.
Data Modeling & Governance
- Implement and maintain PostgreSQL and medallion-layer data models, including harmonization logic, referential integrity, lineage tracking, and governed data standards.
- Partner with Data Architects and WBWD stakeholders to evolve schemas, data structures, and integration patterns as business requirements mature
Basic Qualifications
- 5+ years of hands-on data engineering or backend engineering experience delivering production-grade data pipelines, integrations, and relational data models.
- Strong experience building API integrations and data connectors using REST APIs, OAuth, webhooks, and modern integration frameworks; experience with MCP or similar protocols preferred.
- Experience designing and implementing document ingestion and AI search solutions, including OCR, chunking, embeddings, vector databases, and retrieval-augmented generation (RAG) using Azure OpenAI, OpenAI, Claude, or similar technologies.
- Proven expertise delivering production workloads on Microsoft Azure, including Azure Fabric (Lakehouse, Data Factory, Pipelines, Delta Lake), Azure Functions, Storage, and AI Services.
- Hands-on AWS experience supporting data engineering solutions using services such as S3, Lambda, API Gateway, Glue, and RDS/Aurora.
- Strong proficiency in Python and/or PySpark for pipeline orchestration, data transformation, API development, testing, and CI/CD automation.
- Experience designing and supporting ETL/ELT pipelines with data validation, quality controls, monitoring, error handling, and operational reliability.
- Advanced knowledge of PostgreSQL, relational database design, schema modeling, query optimization, and medallion architecture (Bronze/Silver/Gold) data platforms.
- Experience implementing data lineage, auditability, and governance controls within regulated or compliance-sensitive environments, including familiarity with ALCOA+ principles
Preferred Qualifications
- Experience in pharmaceutical, biotechnology, or medical device development environments -working knowledge of regulated data requirements is a strong differentiator
- Familiarity with GxP data integrity requirements (21 CFR Part 11, ALCOA+) and their practical implications for data pipeline design, electronic records, and audit trail implementation
- Direct experience with any DDCS or WBWD systems: Oracle Agile PLM / Siemens Teamcenter, LabVantage LIMS, Darwin, Veeva Vault/QDocs, SmartLab/Biovia LES, NuGenesis NG9
- Microsoft Azure Data Engineer Associate or AWS Certified Data Engineer certification
- Experience with infrastructure-as-code (Bicep, Terraform) and GitOps deployment patterns for Azure-native data workloads
- Familiarity with LangChain, semantic chunking strategies, or embedding model selection for domain-specific scientific document retrieval
- Experience with Microsoft Fabric Unity Catalog, Delta Sharing, or governed data sharing patterns across workspaces
- Experience with Docker and Kubernetes-based orchestration for data pipeline services in production environments
Let your future start with The AES Group and join our mission to create the most positive impact on society with the power of technology. Apply now
Terms & Conditions for Candidate Portal
Last Updated: May 6th, 2026
Please read these Terms & Conditions ("Agreement", "Terms") carefully before using the Candidate Portal ("Portal", "Service") provided by The AES Group ("we", "us", "our").
By accessing or registering for the Portal, you ("Candidate", "User", "you", "your") agree to be bound by these Terms.
If you do not agree with any part of these Terms, you may not use the Portal.
- Acceptance of Terms
By accessing or using the Candidate Portal, you affirm that you are at least 18 years old and are legally authorized to enter into this Agreement.
If you are accessing the Portal on behalf of an employer or third party, you represent that you have the authority to bind that entity to these Terms.
- Purpose of Portal
The Portal is provided as a digital platform for Candidates to:
- Create and manage profiles
- Upload resumes, documents, and other professional details
- View and apply for job opportunities
- Track application status
- Communicate with recruiters and client organizations
- Access profile and document-related information
These Terms govern your use of the Portal and all related services.
- User Registration & Account Security
- You agree to provide accurate, complete, and current information during signup.
- You are responsible for maintaining the confidentiality of your account credentials.
- You agree to immediately notify us of any unauthorized use of your account.
- You are responsible for all activities that occur under your account.
- Document Upload & Verification
You understand and agree that:
- All resumes, documents, and information you upload must be true, accurate, and valid
- You are fully responsible for the accuracy and legality of the information you provide
- The Portal may use third-party verification services where applicable
- We reserve the right to reject or remove any document or information that appears invalid or misleading
- Use of Portal Services
You agree to use the Portal in compliance with:
- Applicable laws and regulations
- Professional standards for IT professionals
- Client-specific requirements
- Instructions provided on the Portal
Prohibited actions include, but are not limited to:
- Uploading false or misleading information
- Interfering with Portal operations
- Sharing your credentials or login with others
- Attempting to bypass or manipulate application processes
- Job Application
You acknowledge that:
- Job opportunities displayed on the Portal are not guaranteed of employment.
- Applications are subject to client requirements, screening, and approval.
- Job details (role, location, requirements) are subject to change.
- Profile Accuracy & Updates
- You agree to maintain accurate and up-to-date information in your profile.
- Failure to keep your profile updated may impact your eligibility for job opportunities or result in account restrictions.
- Privacy & Data Use
Your use of the Portal is subject to our Privacy Policy, which describes how we collect, use, and safeguard your personal information.
By using the Portal, you consent to the collection and use of information as described.
- Intellectual Property
All intellectual property contained in or presented through the Portal is owned by us or our licensors.
You may not copy, modify, distribute, or otherwise use any Portal content without express written permission.
- Disclaimer of Warranties
The Portal and all content and services are provided "as is" and "as available."
We make no warranties, express or implied, including:
- Merchantability
- Fitness for a particular purpose
- Accuracy or completeness of information
- Limitation of Liability
To the fullest extent permitted by law, we are not liable for:
- Direct, indirect, incidental, special, or consequential damages
- Loss of data, profits, or business opportunities
- Claims arising from job application outcomes
- Amendments
We may modify these Terms at any time.
Changes will be posted on the Portal with an updated "Last Updated" date.
Your continued use of the Portal after changes indicates your acceptance.
- Termination
We may suspend or terminate your access to the Portal if you violate these Terms or for any reason, with or without notice.