Our Client, an IT Services and Consultant company, is looking for an AWS Data Engineer - Python, AWS Glue & Lambda for their Remote location. Implement data ingestion, transformation, and orchestration workflows to move data from source systems to target platforms.
Numbers & Facts
Location
IN
Description
Our Client, an IT Services and Consultant company, is looking for an AWS Data Engineer - Python, AWS Glue & Lambda for their Remote location.
Responsibilities:
Design, develop, and maintain end-to-end data pipelines using AWS services.
Implement data ingestion, transformation, and orchestration workflows to move data from source systems to target platforms.
Utilize AWS services such as S3, Glue, Lambda, and EC2 to build scalable data processing solutions.
Develop and integrate REST APIs to support data exchange and business applications.
Build automation solutions using Python and TypeScript.
Collaborate with cross-functional teams to understand data requirements and implement high-quality solutions.
Implement CI/CD pipelines and DevOps best practices using tools such as GitHub and Bamboo.
Monitor, troubleshoot, and optimize data workflows to ensure performance, reliability, and scalability.
Participate in code reviews, testing, deployment, and production support activities.
Requirements:
Strong hands-on experience with AWS cloud services, including:
AWS Glue
AWS Lambda
Amazon EC2
Amazon S3
Experience building and orchestrating data pipelines in AWS environments.
Proficiency in Python development.
Experience with REST API development and integration.
Working knowledge of TypeScript.
Experience with CI/CD tools such as GitHub and Bamboo.
Understanding of data engineering, ETL/ELT processes, and cloud-based data architectures.
Preferred Qualifications:
Experience with modern data lake or analytics platforms.
Familiarity with Agile development methodologies.
Knowledge of monitoring, logging, and cloud security best practices.
Experience working in large-scale enterprise environments.
Experience:
8+ years of experience in Data Engineering or Cloud Engineering.
5+ years of hands-on experience with AWS-based data solutions.