Data Engineer

TechDigital

Princeton, NJ

Apply

JOB DETAILS

SKILLS

Architectural Analysis, Best Practices, Big Data, Data Analysis, Data Lake, Data Management, Data Modeling, Data Processing, Data Quality, Data Warehousing, Database Extract Transform and Load (ETL), Debugging Skills, Ecosystems, Identify Issues, Information/Data Security (InfoSec), Metadata, Microsoft Windows Azure, Problem Solving Skills, Python Programming/Scripting Language, Relational Databases (RDBMS), SQL (Structured Query Language)

LOCATION

Princeton, NJ

POSTED

30+ days ago

Minimum Mandatory Skills ADF, Data Bricks
Desired Skills Python, PySpark

Key Responsibilities:

Design and implement ETL/ELT pipelines using Azure Data Factory.
Develop and optimize data processing workflows in Azure Databricks using PySpark.
Integrate data from multiple sources into a unified data platform.
Ensure data quality, security and compliance across all processes.
Collaborate with data architects, analysts and business teams to deliver reliable data solutions.
Monitor and troubleshoot data pipelines for performance and reliability.
Implement best practices for data governance, metadata management and data lineage.

Required Skills & Qualifications:

6–8 years of experience in data engineering and data platform development.
Strong hands-on experience with Azure Data Factory, Azure Databricks and PySpark.
Proficiency in SQL and working with relational databases.
Experience with data modeling, data warehousing and big data processing.
Familiarity with Azure ecosystem (Data Lake, Synapse, Key Vault, etc.).
Strong problem-solving and debugging skills.

About the Company

TechDigital

COMPANY SIZE

100 to 499 employees

INDUSTRY

Other/Not Classified