Must Have - Azure Data Factory, Databricks, Python/PySpark, Oracle / SQL and Experience in Data Migration / Conversion project
1. Clear understanding of ETL concepts like full load and incremental load using Databricks and ADF pipelines.
2. Create ETL pipelines with Azure Data factory and sequence data bricks jobs in ADF.
3. Creation of reusable notebooks in Azure Databricks and experience with functions and parameters.
4. Good knowledge and experience in Python programming language.
5. Good Oracle and SQL Server query experience with knowledge of CTE, Ansi SQL and Oracle functions.
6. Experience in minus, except, union and other set operators in SQL.
7. Good experience in creating PLSQL blocks, triggers and indexes.
8. Query performance tuning experience with knowledge in Indexes and partitions.
9. Strong troubleshooting skills and defect resolution.
10. Good communication skills and client facing skills.