Azure Data Engineer
Charlotte, NC - hybrid
12 months+
Role Description
*** is in the process of leading a Digital Transformation across our Americas Division as we continue to modernize our technology, focus on our data-driven approach, grow, and plan for the future. As a result of this expansion, we are seeking experienced software Data engineers spread across Charlotte (N.C), Jersey City (N.J) and India, with 10+ years of relevant experience to support the design and development of a strategic data platform for *** Capital Markets and Nikko Securities Group.
Role Objectives
These roles will be part of the Data Strategy team spanning across the business Capital Markets and Nikko securities teams, business Americas Division's broker-dealer and swap-dealer entities.
These roles will be involved in the active development of the data platform in close coordination with the *** team, beginning with the establishment of a reference data system for securities and pricing data, and later moving to other data domains.
The consulting team will need to follow internal developments standards to contribute to the overall agenda of the Data Strategy team.
The implementation of this strategic platform on ***'s Azure Cloud Platform will require solutions and know-how as listed in the qualifications below.
Qualifications and Skills
10+ years of experience in software development using Python, PySpark and its frameworks.
Proven experience as a Data Engineer/Data Quality Engineer with experience in Azure cloud.
Experience implementing solutions using -
Azure cloud services
Azure Data Factory
Azure Lake Gen 2
Azure Databases
Azure Databricks
Data Quality Framework/Solution
Collibra Data Quality or any Data Quality tools (IDQ/IBM/Ab-Initio)
Collibra Data Governance and Data lineage knowledge.
Power BI
Well versed with Azure Databricks
Strong SQL skills with RDMS or noSQL databases
Familiarity with the DevOps lifecycle (git, Jenkins, etc.), CI/CD processes
Good understanding of ETL/ELT processes
Experience in financial services industry, financial instruments, asset classes and market data are a plus.