Reporting to the Team Manager for Data Engineering, the Data Engineer will be part of the core group responsible for the end to end data management on the Big Data platform.
The Data Engineer will be responsible for data ingestion, data validation, code development on various big data technologies, data analysis troubleshooting and user interactions working in an agile team.
Effectively partner with the Data and Analytics team to understand their data requirements, work on data ingestion, analysis, validation, transformation etc.
Partner closely with various analytics projects to provide value from a data engineering perspective.
Provide support for development work supporting the ingestion framework, SQL and anything else needed for generating validations.
Support & monitor various data feeds as required for the project.
Experience in working in Agile/Scrum framework and participate in all ceremonies and deliver
Apply quality assurance best practices to all work products
Bachelor's or Advanced Degree in Information Management, Computer Science, Mathematics, Statistics, or related fields desired
Financial Services background or experience preferred across different LOBs. (Consumer, Commercial, Asset Management & CIB)
Proven proficiency with data analysis and ability to troubleshoot data issues.
Proficiency across the full range of big data technologies and/or database and business intelligence tools; publishing and presenting information in an engaging way
Intensive, recent experience in assessing and sourcing data needs
Detail oriented with a commitment to innovation
Strong experience in Big Data Hadoop stack - Hive, Impala, Spark, Spark/SQL
Experience in Python, Java, Spark development is highly desired.
Experience with MPP databases like Teradata or Oracle is preferred.
Experience in Big Data technologies like Pig, Kafka is preferred
Exposure to machine learning is preferred
Exposure to ETL tools ( ABINTIO, INFORMATICA, DataStage or Others) a plus.
Good communication skills and ability to interact with users, make presentations and guide conversations.
Experience with scheduling & data integration tools like Control-M and Ni-Fi is highly desired.
Strong exposure in Data Management, Governance and Controls functions
Experience in data analysis, validation and reporting is a plus.
Ability to present complex information in an understandable and compelling manne
U.S. Citizens and those authorized to work in the U.S. are encouraged to apply. We are unable to sponsor at this time. At present no Corp to Corp relationships will be considered for this opportunity. AIC is an Equal Opportunity Employer
privacy and protection,
when applying to a job online, never give your social security number to a prospective employer, provide credit card or bank account information, or perform any sort of monetary transaction.Learn more.
By applying to a job using CareerBuilder you are agreeing to comply with and be subject to the CareerBuilder
Terms and Conditions
for use of our website. To use our website, you must agree with the
Terms and Conditions
and both meet and comply with their provisions.
AIC is a leading talent solutions firm that provides highly-skilled Information Technology (IT), Engineering, and Finance professionals to clients nationwide. With an unwavering commitment to excellence, integrity, and innovation, AIC draws from 50 years of experience in the consulting services industry to provide unparalleled business and technical expertise to middle market and Fortune1000 companies. Founded in 1966, AIC is part of the ACS Group.
Our services are designed to meet clients' changing needs and our approach is flexible and collaborative. We take the time to understand your business and the unique needs of your environment, and then apply our technical knowledge and industry perspective to deliver a custom solution. Whether that means supplying you with an individual, several members of a joint project team or a completely outsourced solution, AIC has the expertise and the resources to deliver.
Our experience, passion and client-centric approach have resulted in a long track record of success. For more than 45 years, AIC has provided the added technical capacity and expertise required to help businesses drive value, control costs and deliver on the promise of a more efficient and productive enterprise.