Senior Data Engineer (GenAI / AWS)

Experience: 6 10 years Cloud Platform: AWS Primary Language: Python

Key Responsibilities

• Design and develop data pipelines using AWS Step Functions, Lambda, S3, Textract, and Comprehend.
• Build automated document-processing workflows for extracting, transforming, and processing structured and unstructured data.
• Implement document chunking, embeddings, vector indexing, and semantic search.
• Develop and maintain vector databases and knowledge bases to support Retrieval-Augmented Generation (RAG).
• Integrate knowledge bases with AI agents for contextual information retrieval.
• Build AI agents using Claude Agent SDK and deploy them on Amazon Bedrock AgentCore Runtime.
• Develop CI/CD pipelines using GitHub Actions to automate builds, testing, and deployments.
• Optimize data pipelines for scalability, reliability, security, and performance.

Must-have vs. good-to-have skills

Important: If this individual must personally build and deploy the Claude agents, move Claude Agent SDK and AgentCore Runtime into the must-have category.