Databricks Engineer

Job Description

• Location: Cincinnati, OH
• Duration: 6 months
• MSP Owner: William Bristol
• Role: Databricks Engineer
• Experience Required: 6–8 years

Must-Have Technical/Functional Skills

• Experience generating data pipelines using Azure Data Factory (ADF).
• Experience ingesting data from multiple sources using Azure ADF.
• Experience transforming data using Azure Databricks and Delta Lake.
• Experience with Azure DevOps CI/CD, including Stories, Bugs, and Issue Management.
• Experience implementing Prefect.
• Strong experience with Databricks.

Roles & Responsibilities

• Work on Agile development projects and participate in sprint delivery.
• Implement integration solutions in Microsoft Azure.
• Perform data analysis to troubleshoot data-related issues.
• Assist in identifying and resolving data-related issues.
• Work independently as an individual contributor and problem solver.
• Develop and maintain data pipelines and integration solutions.

Generic Managerial Skills

• Experience working in Agile development environments.
• Experience participating in sprint planning and delivery.
• Strong collaboration and problem-solving skills.

Key Search Keywords

• Azure Databricks
• Azure Data Factory (ADF)
• Delta Lake
• Azure DevOps
• Prefect
• Data Pipelines
• Data Ingestion
• Data Transformation
• Microsoft Azure

Pre-Screening Questionnaire

• Should be proficient in querying databases and analyzing data.
• Should be able to write SQL queries involving:
  • Joins
  • Duplicate record identification
  • Data validation and analysis
  • Complex data troubleshooting

Regulated Positions

• Regulated Positions require TAG to recruit candidates with specific work authorizations, including:
  • US Citizens
  • US Persons
• These positions may be regulated under applicable MSA requirements, including:
  • ITAR (International Traffic in Arms Regulations)
  • NERC CIP (NERC Critical Infrastructure Protection)
  • NRC (Nuclear Regulatory Commission)
  • Other applicable regulations

Resume Naming Convention

• Format: PTN_US_GBAMSREQID_CandidateBeelineID
• Example: PTN_US_9999999_SKIPJOHNSON0413
• Requirement: ALL CAPS with no spaces; use underscores only as separators.