Proficient in Pyspark, Spark SQL & Spark streaming for processing data for various use cases, creation of an optimized storage layer, scheduling features for job automation. Working knowledge of Apache Spark's execution model, query planning and execution and familiarity with Big Data technology.