Our client is currently seeking a direct hire Sr. Data Engineer.
No C2C. This is a direct hire position.
Building a DMP that will process 100’s of billions of data elements from dozens of data sources with incredible performance Working in concert with the Data Science team to ensure that we continue to be the leader in growth-oriented insights Collaborating with our core Services team to deliver sophisticated API’s to our partners and development teams Working closely with the Data Acquisition team to fully understand opportunities and complexities in bringing new sources of data Exploring new technologies to solve complex problems and help to meet high demands for usability, performance and security requirements Bringing your ideas around technology and process to drive solutions and support your team Embracing a hands-on approach to fully understand our current DMP system comprised of components that include: Boomi, Kafka, Hadoop/EMR, Elastic Search, Druid, MySQL, Tez, Cascading and Oozie
What you'll bring with you:
A Bachelor’s degree in Computer Science or related field; serious bonus points for advanced degrees Experience delivering high quality software in Massively Parallel Processing (MPP) environments on a public cloud platform – we use AWS At least 5 years of experience working on a highly technical engineering team in with high volumes of consumer data – financial services, patient information, adtech or ecommerce are interesting to us Proven track record of innovation and expertise in enterprise grade Data Engineering A strong understanding and advocacy of modern software engineering process and procedures in areas such as DevOps, software quality, and documentation Ability to work effectively in a strong team environment to innovate and produce solutions Hands on experience with SQL/NoSQL technologies, Spark, functional programming and distributed/fault tolerant data processing A passion for learning new technologies, data analysis, and identifying data patterns and trends
Amazon Web Services