Data Engineer- 181441

Data Engineer

We are seeking a highly motivated Data Engineer to join our Data Aggregation team. Data Aggregation is a growing area, and we are looking for a skilled engineer to drive the design and development of industry-leading external-facing solutions. The comprehensive data solutions will seek to bring together retail, clearing, and custody capabilities to help external FinTech partners with financial goal planning, investment advice, and financial projections capabilities to better serve clients and more efficiently accomplish their financial objectives.

The Expertise You Have

• Bachelor's degree in Computer Science, Information Systems, or a related field
• Proven track record in data engineering
• 10+ years of experience developing Spark Services for data movement
• Ability to schedule, monitor, and debug ETL Spark Batch processes
• Hands-on experience with Java clients for consuming REST and SOAP APIs and Scala Spark batch applications
• Experience developing, testing, deploying, and maintaining ETL Batch Jobs using Apache Spark/EMR Jobs
• Proficiency utilizing Apache Spark cluster-computing framework to process big data and write to NoSQL databases (e.g., Cassandra or Yugabyte)
• Experience with cloud-based data warehousing and data lake solutions such as Snowflake
• Experience with data storage and data management for large datasets (e.g., Parquet, HDF5)
• Proven experience building and deploying software solutions utilizing public cloud provider services such as AWS