Application Programming Interface (API), Code Coverage, Continuous Deployment/Delivery, Continuous Integration, Data Processing, Data Quality, Database Extract Transform and Load (ETL), Debugging Skills, Error Handling, Identify Issues, Integration Testing, Microsoft SQL Server, Microsoft Windows Azure, Performance Tuning/Optimization, Python Programming/Scripting Language, Query Optimization, SQL (Structured Query Language), Test Automation, Unit Test
Hi Professionals,
Title: Senior Data Engineer Azure Databricks & SQL Server(Onsite at Chicago,IL)
Location: Chicago,IL(Onsite)- Needs candidates to go for in person client interview(Expenses will be Bear by client) and 3 days Work from Office per Week.
JD:
- Strong knowledge of ETL/ELT concepts: pipeline design, incremental loads, data validation, troubleshooting.
- Advanced SQL: CTEs, joins, views, query optimization, performance tuning.
- Python: Production-grade coding, APIs, testing, logging, CI/CD, unit/integration testing, code coverage.
- PySpark: Distributed data processing, performance optimization, debugging, CI/CD, automated testing.
- Azure Data Factory (ADF): Pipeline development, parameterization, triggers, monitoring, error handling, integration with Databricks & ADLS.
- Databricks: Notebooks, jobs/workflows, Delta Lake, cluster/job configuration.
- Azure: ADLS Gen2, Azure Portal, Storage Explorer, Azure SQL, Azure OpenAI integration, Pulumi for infrastructure provisioning.
"Disclaimer: E-Solutions Inc. provides equal employment opportunities (EEO) to all employees and applicants for employment without regard to race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, disability, genetic information, marital status, amnesty, or status as a covered veteran in accordance with applicable federal, state and local laws. We especially invite women, minorities, veterans, and individuals with disabilities to apply. EEO/AA/M/F/Vet/Disability."