Data Developer

Summary : Develops scripts, processes, and tools to ingest, transform, and deliver data in a MS Fabric environment to support analytics and reporting needs. Develop scalable ingestion frameworks for batch and real-time sources (APIs, databases, event streams).

Job Title: Data Developer
Location: Charlotte, NC 28202
Hybrid role ( 2-3 days onsite)
12 months contract
Mid level position ( 5 - 7 years of exp)

Summary:
Develops scripts, processes, and tools to ingest, transform, and deliver data in a MS Fabric environment to support analytics and reporting needs.

Lakehouse Architecture & Platform Engineering:
Design, build, and maintain scalable lakehouse architecture in Microsoft Fabric and OneLake
Ensure high availability, reliability, and performance of data platforms
Data Pipelines & Ingestion

Build and maintain end-to-end data pipelines for ingestion, transformation, and serving
Develop scalable ingestion frameworks for batch and real-time sources (APIs, databases, event streams)
Integrate enterprise systems (Jira, ERP, CRM, flat files, streaming sources)
Data Processing & Transformation

Develop and execute large-scale Spark jobs (batch and streaming)
Author and maintain notebooks (PySpark, SQL) for transformation and analysis
Implement data cleansing, enrichment, and transformation logic
Data Quality & Integration

Build ingestion logic for structured, semi-structured, and unstructured data
Implement data validation and quality controls
Data Enablement

Deliver analytics-ready datasets for Power BI and downstream consumption

Skill Requirements:
Microsoft Fabric (Lakehouse, OneLake, Pipelines, Notebooks)
Apache Spark (PySpark, Spark SQL)
SQL
Python
Delta Lake / Delta Tables
Data Pipeline Design (ETL / ELT)
API & Streaming Data Integration