MUST HAVE: Scala, Java, Pyspark, Spark, BigQuery, Dataproc
NICE TO HAVE: Event Engine, Cloud composer, Shell scripts, Hadoop(MapR), Hive, Scheduler
Minimum 4+ years of experience in Implementing data migration program from Hadoop (On-prem) with Scala, Java, Python, Spark to GCP BigQuery, Dataproc
Minimum experience of 4+ years in Integrating plugins for GitHub Action to CICD platform to ensure software quality and security.
Experience of 4+ years on Google Cloud platform (GCP) tools mainly BigQuery, Dataproc, Cloud composer, Cloud storage, etc.,
Minimum 4+ years of experience in Cloud Deployments.
Configuring scripts in Cloud console / Jenkins for Automated executions
Prior work experience in BFSI Warehouse functional domains will be an added advantage.
Hands on experience on Pipeline creation with Scala scripts from scratch and troubleshooting cloud configuration issues.
Should have worked on Git and Continuous Integration environment like GitHub action, Jenkins
Should have experience SQLs, NoSQL Databases
Should have experience in working in teams following Agile or XP methodology.
Should have BFSI domain experience to understand the business requirement.
Minimum 2+ years of Senior programming level experience involving some architecture and high-level design.
Understanding of distributed systems and related concepts required.