Job Title - Data Engineer Location - Chicago, IL Remote Duration - 12+ months Rate - DOE U.S. Citizens and those authorized to work in the U.S. are encouraged to apply. We are unable to sponsor at this time. JOB DESCRIPTIO N- 5+ years of experience in a Data Engineer role, with a Graduate degree in Computer Science, Statistics, Informatics, Information Systems, or another quantitative field.
- Very good knowledge in
- SQL (7+ out of 10)PySpark
- Databricks on Azure (7+ out of 10)
- (7+ out of 10)
- SparkSQL (7+ out of 10)
- Azure/ADLS (7+ out of 10)
- Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.
- Great numerical and analytical skills
- Data engineering certifications/Azure is a plus
- Create and maintain optimal data pipeline architecture
- Analyze and organize raw data
- Write pseudo code
- Combine raw information from different sources
- Explore ways to enhance data quality and reliability
- Working with stakeholders including data, design, product and executive teams and assisting them with data-related technical issues
- Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
- Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
- Experience supporting and working with cross-functional teams in a dynamic environment.
- Build processes supporting data transformation, data structures, metadata, dependency, and workload management