Databricks Engineer

Secret clearance is required (or the ability to obtain Secret Clearance)Onsite 5 days/week - LOCAL is a must (Metro East / Southern IL)Requirements:Secret clearance is required (or the ability to obtain Secret Clearance)Minimum of 3 years of experience as a Data Engineer, with demonstrated experience creating data pipelines from scratch.Strong problem-solving skills and ability to solve complex data-related issues.Demonstrated experience working with large datasets and leveraging big data technologies to process and analyze data efficiently.Understanding of data modeling/visualization, database design principles, and data governance practices.Excellent communication and collaboration skills, with the ability to work effectively with cross-functional teams.Detail-oriented mindset with a commitment to delivering high-quality results.Responsibilities:Create and optimize data pipelines from scratch, ensuring scalability, reliability, and high-performance processing.Perform data cleansing, data integration, and data quality assurance activities to maintain the accuracy and integrity of large datasets.Leverage big data technologies to efficiently process and analyze large datasets, particularly those encountered in a federal agency.Implement and enforce data governance policies and procedures, ensuring compliance with regulatory requirements and industry best practices.Work closely with cross-functional teams to understand data requirements and design optimal data models and architectures.Collaborate with data scientists, analysts, and stakeholders to provide timely and accurate data insights and support decision-making processes.Maintain documentation for software applications, workflows, and processes.Stay updated with emerging trends and advancements in data engineering and recommend suitable tools and technologies for continuous improvement.Seniority level Seniority level Mid-Senior levelEmployment type Employment type Full-timeJob function Job function Information Technology and OtherIndustries Military and International Affairs and Information ServicesReferrals increase your chances of interviewing at SBS Creatix by 2xInferred from the description for this job Medical insuranceVision insurance401(k)Get notified when a new job is posted.Sign in to set job alerts for “Data Engineer” roles. Scott AFB, IL $77,000.00-$90,000.00 1 month agoEdwardsville, IL $82,212.00-$123,323.20 1 month agoO'Fallon, IL $90,000.00-$150,000.00 1 day agoO'Fallon, IL $90,000.00-$150,000.00 1 day agoScott AFB, IL $125,000.00-$135,000.00 1 month agoScott AFB, IL $125,000.00-$135,000.00 1 month agoSt Louis, MO $80,000.00-$100,000.00 3 days agoSt Louis, MO $104,650.00-$189,175.00 3 days agoSt Louis, MO $89,700.00-$162,150.00 1 day agoSt Louis, MO $75,200.00-$158,100.00 1 week agoScott AFB, IL $86,000.00-$138,000.00 3 weeks agoSt Louis, MO $75,920.00-$129,480.00 6 days agoWe're unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.#J-18808-Ljbffr