Analysis Skills, Application Programming Interface (API), Atlassian JIRA, Customer Relationship Management (CRM), Data Management, Data Processing, Data Quality, ERP (Enterprise Resource Planning), High Availability, High Reliability, Microsoft Product Family, SQL (Structured Query Language), Scalable System Development, Scripting (Scripting Languages), System Integration (SI), Writing Skills
Location: Charlotte, NC 28202
Hybrid role ( 2-3 days onsite)
12 months contract
Mid level position ( 5 - 7 years of exp)
Summary:
Develops scripts, processes, and tools to ingest, transform, and deliver data in a MS Fabric environment to support analytics and reporting needs.
Lakehouse Architecture & Platform Engineering:
Design, build, and maintain scalable lakehouse architecture in Microsoft Fabric and OneLake
Ensure high availability, reliability, and performance of data platforms
Data Pipelines & Ingestion
Build and maintain end-to-end data pipelines for ingestion, transformation, and serving
Develop scalable ingestion frameworks for batch and real-time sources (APIs, databases, event streams)
Integrate enterprise systems (Jira, ERP, CRM, flat files, streaming sources)
Data Processing & Transformation
Develop and execute large-scale Spark jobs (batch and streaming)
Author and maintain notebooks (PySpark, SQL) for transformation and analysis
Implement data cleansing, enrichment, and transformation logic
Data Quality & Integration
Build ingestion logic for structured, semi-structured, and unstructured data
Implement data validation and quality controls
Data Enablement
Deliver analytics-ready datasets for Power BI and downstream consumption
Skill Requirements:
Microsoft Fabric (Lakehouse, OneLake, Pipelines, Notebooks)
Apache Spark (PySpark, Spark SQL)
SQL
Python
Delta Lake / Delta Tables
Data Pipeline Design (ETL / ELT)
API & Streaming Data Integratione
eTeam Inc.
Looking for a great job? Join eTeam. We’re looking for talented staffing professionals to join our staff. We also provide contract assignments and full-time jobs at Fortune 2000 Companies. We’ve been named one of the best companies to work for by Staffing Industry Analysts and New Jersey Business.