Data Engineer

eTeam Inc.

Fort Mill, SC

Apply

JOB DETAILS

SALARY

$55–$62.50 Per Hour

SKILLS

Amazon Web Services (AWS), Application Programming Interface (API), Code Reviews, Communication Skills, Data Management, Data Processing, DevOps, Docker, Ecosystems, Error Handling, Java, Leadership, Manufacturing Data Management, Microservices, Microsoft Windows Azure, Node.js, Performance Engineering, Performance Tuning/Optimization, Production Support, Python Programming/Scripting Language, REST (Representational State Transfer), Root Cause Analysis, SQL (Structured Query Language), Stewardship, User Interface/Experience (UI/UX)

LOCATION

Fort Mill, SC

POSTED

9 days ago

Role Name: Data Engineer
Location: Fort Mill, SC - 100% onsite

CGEMJP00345463

JOB DESCRIPTION:
JD

Role Overview

We are looking for a Senior Markit EDM Developer Technical SME with deep expertise in IHS Markit EDMand strong experience in modern cloudnative eventdriven and data engineering ecosystems

This role goes beyond traditional EDM development and requires ownership of endtoend data mastering architecture integrating EDM with data lakes microservices APIs streaming platforms and DevOps pipelines

Key Responsibilities

1 Markit EDM CADIS Core Development

Lead design and development of enterprise MDM solutions on Markit EDM CADIS
Architect and implement
Core Matcher frameworks entity resolution survivorship rules
Golden Record creation and lifecycle management
Develop E2E data mastering pipelines including
Data Constructors
Data Porters
Data Flows Rules Engines
Ensure scalability reusability and performance optimization

2 Workflow UI Data Governance

Design and develop Workflow UI components
WF Pages WF Elements userdriven stewardship flows
Implement data governance workflows approval exception handling audit trails
Enable data lineage transparency and stewardship across domains especially PartyClient

3 EventDriven RealTime Architecture

Implement realtime data processing and notifications using
Apache Kafka Confluent
Eventdriven EDM triggers
Design near realtime mastering and synchronization patterns
Integrate EDM into enterprise event ecosystems

4 API Microservices Integration

Develop and expose RESTful APIs using
Data Generators
Process Launchers
Integrate with microservices architecture Spring Boot Java Nodejs
Enable APIfirst EDM integration strategy across systems

5 Cloud Modern Data Platform

Deploy and manage EDM solutions on AWS or Azure equivalent
AWS Glue ETL orchestration
Lambda serverless triggers
S3 Data Lake integration
RDS Aurora
SNSSQS eventing
Integrate EDM with modern data platforms
Snowflake Databricks Redshift
Design hybrid architecture
EDM golden source Data Lake analytical layer

6 Data Engineering Advanced Processing

Work with Python PySpark Spark SQL for
Data transformation
Enrichment pipelines
Largescale data processing
Handle ingestion from
APIs flat files streaming feeds databases
Optimize largevolume batch and streaming pipelines

7 DevOps CICD Infrastructure

Build and maintain CICD pipelines for EDM
GitHub GitLab
Octopus Deploy Jenkins Azure DevOps
Use Infrastructure as Code IaC
Terraform CloudFormation
Implement
Automated deployments
Environment promotion
Version control strategies

8 Containerization Platform Engineering

Work with Docker Kubernetes EKSAKS for
Microservices deployment
Integration layers around EDM
Enable scalable resilient cloudnative deployments

9 Observability Performance Engineering

Implement monitoring and logging using
Splunk ELK Prometheus Grafana CloudWatch
Perform
Performance tuning of matchers and batch jobs
Rootcause analysis and production support

10 Database Data Modeling

Design and optimize across
SQL Server Oracle PostgreSQL
Snowflake cloudnative warehouses
Develop
Complex SQL
Stored procedures
Indexing and performance tuning strategies

11 Leadership Delivery

Lead onsiteoffshore model delivery
Act as technical SME and solution architect for EDM
Collaborate with
Business Analysts
Data Architects
Scrum Teams
Conduct
Code reviews
Design reviews
Release governance

Required Qualifications

510 years of experience in MDM with 5 years in Markit EDM IHS
Strong expertise in
Core Matcher design
Data mastering pipelines
WorkflowUI development
Handson experience with
Kafka or equivalent streaming
AWS cloud services
REST API development
Strong database experience across RDBMS cloud data warehouses
Experience with CICD Git Terraform
Proficiency in Python or Sparkbased data processing

Preferred Qualifications

Experience with Markit EDM Cloud 19x
Strong domain knowledge in
Party Client Instrument MDM
Experience with
Databricks Snowflake ecosystems
Microservices architecture Spring Boot Nodejs
Kubernetes containerization
Exposure to data governance frameworks Collibra Alation etc

Key Competencies

Deep expertise in Markit EDM modern data ecosystem
Strong architecture and system design mindset
Ability to lead complex data platform transformations
Excellent communication and stakeholder management
Strong problemsolving and performance optimization skills

About the Company

eTeam Inc.

Looking for a great job? Join eTeam. We’re looking for talented staffing professionals to join our staff. We also provide contract assignments and full-time jobs at Fortune 2000 Companies. We’ve been named one of the best companies to work for by Staffing Industry Analysts and New Jersey Business.

COMPANY SIZE

100 to 499 employees

INDUSTRY

Other/Not Classified

FOUNDED

1998

WEBSITE