Administrative Skills, Agile Programming Methodologies, Apache Spark, Big Data, Computer Programming, Computer Science, Continuous Deployment/Delivery, Continuous Integration, Data Analysis, Data Management, Data Processing, Database Extract Transform and Load (ETL), Identify Issues, Information Technology & Information Systems, Problem Solving Skills, Python Programming/Scripting Language, SQL (Structured Query Language), Scalable System Development, Scrum Project Management and Software Development, Technical Writing, Technical/Engineering Design
Databricks Engineer/Admin - Myrtle Point, OR
Duration: 6+ months
REMOTE
Seeking for a highly skilled Databricks Data Engineer to design, build, and manage scalable data solutions. The ideal candidate will have strong hands-on experience with Databricks administration and data engineering, including building robust ETL/ELT pipelines and optimizing big data processing workflows.
Key Responsibilities:
- Administer and manage Databricks workspaces, clusters, and security configurations.
- Design, develop, and maintain scalable data pipelines using Databricks and Apache Spark.
- Implement and optimize Delta Lake architecture.
- Collaborate with data analysts, architects, and business stakeholders to deliver data solutions.
- Troubleshoot and resolve production issues related to data pipelines.
- Document technical designs, processes, and standards.
Required Qualifications:- Bachelor’s degree in Computer Science, Information Systems, or related field.
- Hands-on experience as a Databricks Administrator and Data Engineer.
- Strong experience with Apache Spark / PySpark.
- Experience implementing Delta Lake.
- Strong SQL and Python programming skills.
Preferred Qualifications:- Experience with CI/CD pipelines for data engineering.
- Experience working in Agile/Scrum environments.