Azure Databricks Infrastructure Engineer

A senior-level architect or lead engineer who has previously executed Azure Databricks tenant-to-tenant migrations, understands both platform and data engineering concerns, can engage with executive stakeholders, and can lead migration activities from assessment through production cutover with minimal supervision. The successful candidate will have deep expertise in Databricks, Azure cloud services, identity and access management, networking, data engineering, and platform modernization.

Position:Azure Databricks Infrastructure Engineer
Location:REMOTE
Duration: Long Term Contract
No OPT, No Fake visas, 13+ years profiles only
 
Position Summary
We are seeking an experienced Azure Databricks Infrastructure Engineer to execute migrations of Azure Databricks environments between Azure tenants. The successful candidate will have deep expertise in Databricks, Azure cloud services, identity and access management, networking, data engineering, and platform modernization.
This role is responsible for executing a migration strategy that minimizes risk, downtime, and business disruption.
The ideal candidate will combine strong technical capabilities with consulting skills and be comfortable interacting with architects, platform teams, security organizations, and business stakeholders.
 
Key Responsibilities
Migration Planning
          Analyze tenant-specific dependencies, networking requirements, DNS, Private Endpoints, and identity integrations.
          Define migration waves and cutover strategies.
Databricks Migration Execution
          Migrate Databricks workspaces between Azure tenants.
          Rebuild or migrate:
o          Workspaces
o          Compute policies
o          Job schedules
o          Repositories
o          Workflows
o          Secret scopes
o          Access controls
          Migrate notebooks, libraries, packages, and configuration artifacts.
          Validate Unity Catalog and data governance configurations.
          Implement infrastructure-as-code and automation where applicable.
Security and Identity
          Migrate and validate:
o          Microsoft Entra ID integrations
o          Managed identities
o          Service principals
o          RBAC assignments
o          Databricks groups and permissions
          Coordinate Key Vault migration and secret rotation activities.
          Ensure compliance with Principle of Least Privilege (PLP).
          Support security reviews and governance approvals.
Data Migration
          Assess and migrate associated datasets and storage integrations.
          Validate Delta Lake tables, metadata, and schemas.
          Develop rollback and recovery procedures.
Automation and DevOps
          Develop Infrastructure-as-Code solutions using:
o          Terraform
o          Bicep
o          ARM Templates
          Automate migration and validation activities wherever possible.
 
Required Technical Skills
Azure
          Azure Databricks
          Microsoft Entra ID
          Azure Virtual Networks
          Private Endpoints
          Azure Key Vault
          Azure Storage Accounts
          Azure Data Lake Storage Gen2
          Azure Monitor
          Log Analytics
          Azure Policy
          Azure RBAC
Databricks
          Workspace administration
          Unity Catalog
          Delta Lake
          Databricks Repos
          MLflow
          Cluster management
          Cluster policies
          Secret scopes
          Databricks REST APIs
Automation
          Terraform
          Azure DevOps
          GitHub Actions
          PowerShell
          Azure CLI
          Databricks CLI
 
Required Experience

• 7+ years of Azure cloud experience.
• 5+ years of Azure Databricks administration and engineering experience.
• Demonstrated experience migrating Azure resources across tenants.
• Experience with large-scale data platform migrations.
• Experience designing secure cloud landing zones.
• Experience implementing Infrastructure as Code.
• Experience working in regulated enterprise environments.

 
Preferred Qualifications

• Azure Solutions Architect Expert\
• Databricks Administrator Certification
• Databricks Solution Architect Certification
• Experience with Unity Catalog migrations
• Experience with mergers, acquisitions, divestitures, or tenant-to-tenant transformations

 
Deliverables
The resource should be capable of independently producing:

• Migration strategy and wave plan
• Detailed migration runbooks
• Cutover and rollback plans
• Operational handover documentation

Ideal Candidate Profile
A senior-level architect or lead engineer who has previously executed Azure Databricks tenant-to-tenant migrations, understands both platform and data engineering concerns, can engage with executive stakeholders, and can lead migration activities from assessment through production cutover with minimal supervision.
 
Full Legal Name:
Contact Number:
Email ID:             
Current Location:
Visa Status:
Hourly Rate:
Availability:
Telephonic Interview:
Face to Face Interview:
 
 
Thanks / Regards

This is a remote position.