Spark Scala Developer / Technology Lead Big Data

Job Title: Spark Scala Developer / Technology Lead Big Data

Location: Irving, TX 75039 (Hybrid/Onsite)
Candidates willing to relocate will be considered.

Duration: 12 Months

Experience Required

• Minimum 8 years of IT experience
• Minimum 8 years of hands-on experience with Scala and Apache Spark

Required Skills

• Apache Spark
• Scala
• Python
• SQL

Nice to Have Skills

• Spark Streaming
• Hadoop
• HDFS
• Hive
• Sqoop
• Impala
• NoSQL Databases
• UNIX Shell Scripting

Job Responsibilities

• Design, develop, and support large-scale distributed data processing applications using Apache Spark and Scala.
• Build and optimize data pipelines using Spark Core, Spark SQL, and Spark Streaming.
• Develop scalable solutions for processing large volumes of data.
• Write clean, efficient, and maintainable Scala code following best practices.
• Work with Python, Hadoop, Hive, HDFS, and other Big Data technologies.
• Design and develop ETL and data warehousing solutions.
• Perform SQL and NoSQL database development and optimization.
• Analyze, troubleshoot, and resolve data processing and performance issues.
• Collaborate with business users, architects, and cross-functional teams.
• Participate in Agile ceremonies including daily standups, sprint planning, reviews, and retrospectives.
• Support production environments and ongoing application maintenance.
• Stay current with emerging Big Data technologies and industry trends.

Required Qualifications

• Strong hands-on experience with Spark Core, Spark SQL, and Spark Streaming.
• Strong programming experience in Scala.
• Experience with Python and SQL.
• Good understanding of Data Structures and Algorithms.
• Experience with Hadoop ecosystem technologies.
• Knowledge of ETL and Data Warehousing concepts.
• Strong analytical, troubleshooting, and problem-solving skills.
• Excellent communication and teamwork skills.

Interview Process

• Karat Assessment (Mandatory)
• Face-to-Face Client Interview