Senior Data Engineer

This team partners with middle-and back-office application teams to design, build, and support next-generation data platforms and pipelines that ingest, process, and transform large-scale data into business-ready datasets. Strong experience with modern data engineering technologies such as Spark, Databricks, Trino, Iceberg, Snowflake, Parquet, Apache Arrow, Polars, and/or Kafka.

Overview:

We are hiring a Data Engineer to join our Data Technologies team. This team partners with middle-and back-office application teams to design, build, and support next-generation data platforms and pipelines that ingest, process, and transform large-scale data into business-ready datasets. We are looking for an experienced data engineer who is passionate about modern data architectures, distributed data processing, and scalable analytics platforms.

In this role, you will:

• Design, develop, and support scalable data pipelines and data products for middle- and back-office systems
• Architect and implement modern data platform solutions
• Build and optimize large-scale batch and streaming data processing workflows
• Collaborate with application teams to model, transform, and deliver data solutions that meet business requirements
• Monitor, troubleshoot, and optimize data processing environments to ensure reliability, scalability, and performance

What we’re looking for:

• 5+ years of experience in data engineering, data platforms, or large-scale distributed data processing
• Strong experience with modern data engineering technologies such as Spark, Databricks, Trino, Iceberg, Snowflake, Parquet, Apache Arrow, Polars, and/or Kafka
• Strong Python development skills required
• Experience designing and optimizing high-volume data pipelines and data processing frameworks
• Experience with query optimization and performance tuning in large-scale analytical environments
• Experience with on-premises data platforms preferred
• Industry experience within capital markets or financial services is required
• Domain knowledge particularly Operations and/or Compliance, is highly preferred
• Ability and flexibility to provide occasional off-hours/weekend support

 

#LI-RH1