Sr Data Analyst ( Azure Data Factory)

Design, develop, and optimize data pipelines, ETL processes, and data flows using Azure Data Factory (ADF), Databricks, Informatica PowerCenter, SSIS, and similar tools. - Report to and work collaboratively within a team that includes a Data Manager, Data Modeller, Data Engineering Lead, Data Engineers, Business Analyst, QA Testers, and DBA.

Job Summary (List Format):

- Serve as a Senior Data Engineer supporting the CT Enterprise Data Warehouse (EDW) within the Enterprise Datawarehouse and Analytics group at Optum.
- Work hands-on with large healthcare data sets, primarily Medicaid, focusing on translating complex business requirements into robust enterprise data solutions.
- Design, develop, and optimize data pipelines, ETL processes, and data flows using Azure Data Factory (ADF), Databricks, Informatica PowerCenter, SSIS, and similar tools.
- Develop, maintain, and optimize data warehouses using relational databases such as Oracle, Snowflake, and SQL Server.
- Create and maintain stored procedures (Oracle PL/SQL, SQL Server T-SQL, Snowflake SQL) to support business and data processing requirements.
- Utilize Python scripting for data processing, automation, and workflow integration.
- Collaborate with teams using source control tools such as Azure DevOps, GitHub, or SVN.
- Process both structured and unstructured data, including healthcare data formats such as HL7 and FHIR.
- Analyze complex project requirements, develop detailed ETL specifications, and ensure alignment with business and technical needs.
- Participate in data governance, privacy, security, analytics, visualization, and information modeling initiatives.
- Troubleshoot, optimize, and improve data pipelines and workflows for performance and reliability.
- Stay current with evolving technologies and adapt solutions to meet changing business requirements.
- Report to and work collaboratively within a team that includes a Data Manager, Data Modeller, Data Engineering Lead, Data Engineers, Business Analyst, QA Testers, and DBA.
- No professional license or certification required, though Azure certifications are preferred.
- The ideal candidate will have a strong background in healthcare data, specifically Medicaid, and expertise in Microsoft Azure, Snowflake, and Azure Data Factory.
- The interview process involves three rounds, with a technical focus, conducted via video.

Top Required Skills/Experience (years indicated):
1. 8+ years Data Engineering (Data Warehousing focus)
2. 5+ years Azure Data Factory (ADF) & Databricks
3. 5+ years ETL development with Informatica PowerCenter, SSIS, or similar
4. 5+ years with relational databases (Oracle, Snowflake, SQL Server)
5. 5+ years creating stored procedures (PL/SQL, T-SQL, Snowflake SQL)
6. 3+ years Python scripting
7. 3+ years source control (Azure DevOps, GitHub, SVN)
8. 2+ years processing structured & unstructured data
9. Experience with HL7 & FHIR healthcare data standards
10. 3+ years requirements analysis and ETL specifications

Preferred/Bonus Skills:
- Batch or PowerShell scripting (3+ years)
- Data modeling in data warehouse environments (3+ years)
- Experience with Spark and Azure Data Fabric
- API design/building in Snowflake and ADF (REST, RPC)
- Experience with Medicaid/Medicare/Healthcare applications
- Azure data engineering/analytics certifications

Education:
- Bachelor's or Advanced Degree in Information Technology/Computer Science, Mathematics/Statistics, Analytics, or Business

Other Details:
- Contract-to-hire; candidates needing sponsorship can be considered.
- Background check and drug screen not required.