Senior Big Data Engineer Scala/Spark

Ability to work in team in diverse/multiple stakeholder environment and collaborate with upstream/downstream functional teams to identify, troubleshoot and resolve data issues. At least 8 years of experience in designing and developing large scale, distributed data processing pipelines using Apache Spark and related technologies.

Title: Senior Big Data Engineer Scala/Spark
Location: Irving, TX 75039 (Onsite-Hybrid. Client to consider candidates willing to relocate)
Duration: 12 months

Must Have Skills:

• Spark
• Scala
• Python
• SQL

Nice to Have Skills:

• Spark Streaming
• Hadoop
• Hive
• SQL
• Sqoop
• Impala

Detailed Job Description:

• At least 8 years of experience and strong knowledge in Scala programming language.
• Able to write clean, maintainable and efficient Scala code following best practices.
• Good knowledge on the fundamental Data Structures and their usage
• At least 8 years of experience in designing and developing large scale, distributed data processing pipelines using Apache Spark and related technologies.
• Having expertise in Spark Core, Spark SQL and Spark Streaming.
• Experience with Python, Hadoop, HDFS, Hive and other BigData technologies.
• Familiarity with Data warehousing and ETL concepts and techniques
• Having expertise in Database concepts and SQL/NoSQL operations.
• UNIX shell scripting will be an added advantage in scheduling/running application jobs.
• At least 8 years of experience in Project development life cycle activities and maintenance/support projects.
• Work in an Agile environment and participation in scrum daily standups, sprint planning reviews and retrospectives.
• Understand project requirements and translate them into technical solutions which meets the project quality standards
• Ability to work in team in diverse/multiple stakeholder environment and collaborate with upstream/downstream functional teams to identify, troubleshoot and resolve data issues.
• Strong problem solving and Good Analytical skills.
• Excellent verbal and written communication skills.
• Experience and desire to work in a Global delivery environment.
• Stay up to date with new technologies and industry trends in Development.
• Minimum Years of Experience:
• 8 years

Certifications Needed:

• Karat assessment. Need to be cleared before onboarding

Top 3 responsibilities you would expect the Subcon to shoulder and execute:

• Coding
• Requirement gathering
• Team lead