JOB SUMMARY:CARE is looking for a Cloud solution architect to be part of our Digital team. This person will design, develop, maintain and support our Enterprise Data Warehouse & BI platform.
RESPONSIBILITIES: Work in an agile environment to analyze, design, develop and deliver Enterprise Data Warehouse solutions using Cloud technologies and Big data platform.
Create ETL pipelines using Python, Azure data factory, Airflow.
Work on creating data pipelines to create and maintain Data lake on AWS or Azure Cloud or equivalent cloud platform.
Work with systems that handle sensitive data with regulatory compliance and change management processes, including data masking, row and column level data security implementations.
Develop collaborative relationships with key sponsors and IT resources for the efficient resolution of work requests.
Analyze raw data sources and data transformation requirements for structured, semi-structured and unstructured data.
Experience working with REST API and micro services-based data integrations to complete data ingestion from varied data sources, open-source platforms.
Write code, and leverage tools, to transform data to incorporate business logic as defined in conjunction with various stakeholders.
Develop, enforce, and recommend enhancements to applications in the area of standards, methodologies, compliance, and quality assurance practices; participate in design and code walkthrough.
Work with team members through all phases of the Systems Development Life Cycle (SDLC) using Agile practices.
Develop and design solutions to support the data analytics and reporting needs, with data warehouse / No SQL and Power BI
Work with real time data streaming and processing using Open source technologies like Kafka , Spark etc.
Good communication skills to present technical solutions, architecture and standards supporting the Digital teams data policies and best practices.