Experience working with large data sets , experience working with distributed computing ( MapReduce, Hadoop, Hive, Pig, Apache Spar k, etc.). Experience in Unix/Linux shell scripting or similar programming/scripting knowledge.
Numbers & Facts
Location
Sunnyvale, California
Description
We have following urgent role with our DIRECT clientTitle: Sr. Data Engineer ( SQL / Big data / Hadoop )Location: Sunnyvale, CA Duration: 6+ Months Rate: MarketTechnical Requirements
Advanced SQL (preferably Teradata)
Experience working with large data sets, experience working with distributed computing (MapReduce, Hadoop, Hive, Pig, Apache Spark, etc.).
Strong Hadoop scripting skills to process petabytes of data
Experience in Unix/Linux shell scripting or similar programming/scripting knowledge
Experience in ETL/ processes
Real time data ingestion (Kafka) Nice to Have
Development experience with Java, Scala, Flume, Python