Job Title: Data Engineer
Location: New York City, NY (Hybrid, 3 days in a week)
In-person Interview is required
Job Description:
Looking for skilled Data engineer with comprehensive experience in designing, developing, and maintaining scalable data solutions within the financial and regulatory domains. Proven expertise in leading end-to-end data architectures, integrating diverse data sources, and ensuring data quality and accuracy.
Core Competencies:
- Advanced proficiency in Python, SQL Server, Snowflake, Azure Databricks, and PySpark.
- Strong understanding of relational databases, ETL processes, and data modeling.
- Expertise in system design, architecture, and implementing robust data pipelines.
- Hands-on experience with data validation, quality checks, and automation tools (Autosys, Control-M).
- Effective communicator with the ability to collaborate with business analysts, users, and global teams.
Key Responsibilities:
- Collaborate with business stakeholders to gather technical specifications and translate business requirements into technical solutions.
- Develop and optimize data models and schemas for efficient data integration and analysis.
- Lead application development involving Python, Pyspark, SQL, Snowflake, and Databricks platforms.
- Implement data validation procedures to maintain high data quality standards.
- Conduct comprehensive testing (UT, SIT, UAT) alongside business and testing teams.
- Provide ongoing support, troubleshooting, and maintenance in production environments.
- Contribute to architecture and design discussions to ensure scalable, maintainable data solutions.
- Experience with financial systems (capital markets, credit risk, and regulatory compliance applications).