Azure Cloud Data Engineer

Request ID: 110252-1
Title: Azure Cloud Data Engineer
Locations: - Charlotte, NC
Duration: 06 Months
Pay Range: $45 - $50/ Hour on W2/C2C (All inclusive)

We are seeking a highly motivated Azure Cloud Data Engineer with strong expertise in Azure cloud services, modern data engineering practices, and cloud infrastructure management. The ideal candidate will be responsible for designing, developing, and optimizing scalable data pipelines and cloud-based solutions leveraging Azure Data Services.

The candidate should possess hands-on experience with Azure Data Factory (ADF), Azure Databricks, Azure Synapse Analytics, Azure SQL Database, Data Lake technologies, Infrastructure as Code (IaC), and cloud automation.

Key Responsibilities

• Design, develop, and maintain scalable data pipelines using Azure cloud services.
• Develop end-to-end ETL/ELT solutions using Azure Data Factory (ADF).
• Build and optimize data processing workflows using Azure Databricks, Spark, and PySpark.
• Design, implement, and manage cloud-native applications and Azure infrastructure.
• Develop and maintain data warehousing solutions using Azure Synapse Analytics and Azure SQL Database.
• Create and manage cloud resources using Infrastructure as Code (ARM Templates, Terraform).
• Automate infrastructure provisioning, deployment, and operational activities.
• Develop scripts using Python and PowerShell for automation and administration tasks.
• Collaborate with DevOps teams to integrate data solutions into CI/CD pipelines.
• Monitor cloud resources and optimize performance, scalability, and cost efficiency.
• Implement security best practices and governance standards across Azure environments.
• Troubleshoot production issues related to data pipelines, Azure services, and infrastructure.
• Participate in architecture discussions and recommend best cloud engineering practices.

Required Skills

Azure Technologies

• Azure Data Factory (ADF)
• Azure Databricks
• Azure Synapse Analytics
• Azure SQL Database
• Azure Data Lake Storage (ADLS)
• Azure Virtual Machines
• Azure Storage Accounts
• Azure Networking
• Azure Resource Manager (ARM)

Data Engineering

• ETL / ELT Development
• Data Pipeline Development
• Data Integration
• Data Warehousing
• Data Modeling
• Data Transformation
• Batch and Streaming Data Processing

Programming & Scripting

• Python
• PySpark
• Spark
• SQL
• PowerShell
• Scala (Preferred)
• Java (Preferred)

Infrastructure & DevOps

• Terraform
• ARM Templates
• CI/CD Pipelines
• Azure DevOps
• Git
• Infrastructure as Code (IaC)

Cloud & Architecture

• Azure Cloud Architecture
• Cloud Computing
• Resource Management
• Security & Governance
• Performance Optimization
• Cost Optimization