AWS Cloud and Spark Architect

Experience Required

• 7+ years of experience in Amazon Web Service (AWS) Cloud Computing
• 10+ years of experience in Development, Design, Architect Implementation, and Analytics Solutions
• Hands-on development, design, setup, and development of applications using AWS-Python/PySpark/Cloud
• Very strong Spark Architecture/Development knowledge
• 510 years of experience in Python and PySpark
• At least 8+ years of experience on AWS (Glue, S3, Lambda at the minimum)
• Candidates need to be very skilled in Python core programming and Spark
• Experience in DevOps building pipelines, etc.
• Ability to design and demonstrate system architecture with different environments
• Hands-on experience in Data Warehousing and SQL
• Experience with Pandas
• Strong expertise in SQL is required
• Solid experience with Git software version control and good understanding of code branching strategies and organization for code reuse
• Experience with DevOps & CI/CD tools Jenkins, CloudBees, Please Build, etc.
• Proficiency working with large data stores and data sets
• Healthcare knowledge is a must
• Agile methodology (Jira preferable)

Roles & Responsibilities

• Must have capability to understand the current architecture
• Architect, design, code, and implement cloud-based Spark applications
• Support existing code through enhancement, troubleshooting, and maintenance as per requirements
• Maintain consistent practices for source code management in GitHub
• Comply with established CI/CD practices, and participate in the creation of new CI/CD methods
• Attend daily scrum calls and actively participate in updating/creating user stories and tasks in Jira
• Work closely with business analysts
• Lead innovation by exploring, investigating, recommending, benchmarking, and implementing data-centric technologies for the platform
• Collaborate within a project team to solve complex problems
• Lead by example, coaching and mentoring peers, and guiding less experienced team members
• Operate as part of the extended management team