Development and implementation of data integration solutions involving Informatica and Hadoop.
Should be able to lead multiple projects concurrently each with competing deadlines.
Should be knowledgeable in Treasury Payments and Deposits domains.
Serves as a fully seasoned/proficient technical resource; provides technical knowledge and capabilities as team member and individual contributor.
Typically 5-7 or more years of data delivery/integration experience
Works under minimal supervision
Has the knowledge of Hadoop Spark/Spark Streaming best practices and standards as well as standard software development lifecycle experience.
Must have an understanding of our ability to quickly grasp technology concepts
Solid quantitative, analytical, process development, facilitation skills, and organizational skills required
Strong communication, presentation, interpersonal, software development and work management skills are essential
Coordinate with deployment and support teams and ensure projects are successfully deployed into testing and Production environments.
Development experience using Agile process
Experience in designing, developing and deploying Real time and Near real time batch data integration solutions
Work with people in different time zones teams
Required Skill:
Informatica
Very good understanding of Hadoop components, architecture tool sets.
Spark and Scala.
Must have Architected, developed implemented solutions using real time streaming technologies (Spark Streaming/Kafka).
At least 3 years hands on experience in Scala.
Minimum 3 years of hands-on experience in Spark.
Good knowledge of spark configurations and Spark/Scala performance tuning.
Strong working knowledge on Hive, Impala, Oozie.
Experience working with Exadata Oracle SQL Tuning.
Experience developing Streaming/Near Real time and Batch data integration solutions.
Hands on experience in UNIX Shell Scripting.
Working experience in scheduling jobs with Autosys