| Location | Philadelphia, PA |
Data Engineer
Philadelphia, PA 19103 (hybrid)
Pay: $100,000-120,000
About the Role: We are seeking a highly skilled Data Engineer to join our innovative team. The successful candidate will play a crucial role in extending our ROCI big data platform and graphDB to support the syndication of the platform. You will work on cutting-edge technologies and complex data systems to drive our data engineering efforts to new heights.
Key Responsibilities:
Develop and maintain the NEO4J Graph database to support complex data relationships and syndication needs.
Design and implement ETL processes using Databricks, ensuring efficient data transformation and loading.
Automate and optimize AWS pipelines to streamline data processing and integration.
Work with ECS, EKS, and Django-based APIs to build scalable and robust data solutions.
Collaborate with cross-functional teams to understand data requirements and deliver high-quality data engineering solutions.
Troubleshoot and resolve issues related to data processing, storage, and retrieval.
Continuously evaluate and improve the performance, scalability, and reliability of the data platform.
Stay updated with the latest industry trends and technologies to ensure the platform remains at the forefront of innovation.
Qualifications:
Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.
Proven experience in developing and managing NEO4J Graph databases.
Hands-on experience with Databricks ETL processes.
Strong expertise in AWS pipeline automation.
Familiarity with ECS, EKS, and Django-based APIs.
Excellent problem-solving skills and attention to detail.
Strong communication and collaboration skills.
Ability to work in a fast-paced and dynamic environment.
Preferred Qualifications:
Experience with other big data technologies and platforms.