Data Engineer

Data Pipelines & ETL: Architect, build, and maintain high-performance batch and near-real-time ETL pipelines using pySpark, AWS Glue, AWS Batch, or similar tools, orchestrated with tools like Apache Airflow. Responsibilities: Backend & APIs: Design, develop, and implement secure RESTful and GraphQL APIs, microservices, and low-latency data services integrated with data pipelines using Python, Boto3, and AWS services.

Sr. Data & Full-Stack Engineer - W2 only 
Location: Remote 

Must-Have:
I'd screen heavily for:

• Strong AWS
• Strong Data Engineering
• Python
• Data pipelines
• GraphQL API development
• Building backend services/microservices
• Low-latency application development
• Performance troubleshooting
• Monitoring/observability
• DynamoDB
• S3
• AWS Glue
• Spark
• Snowflake

Job Description:

• Senior Data & Full-Stack Engineer
• Seeking a Senior Data & Full-Stack Engineer with strong experience in API development in Python and robust data engineering.
• Engineers should have a proven track record of writing reliable, high-performance, production-grade code grounded in strong system design, data modeling, and engineering best practices.
• The ideal candidate will provide technical leadership in building scalable end-to-end web applications, driving system design, and managing cloud-native data processing pipelines. Domain experience working within Identity and Access Management is a strong plus, but not strictly required.

Responsibilities:

• Backend & APIs: Design, develop, and implement secure RESTful and GraphQL APIs, microservices, and low-latency data services integrated with data pipelines using Python, Boto3, and AWS services.
• Frontend UI: Build and maintain responsive, modular web applications utilizing React, JavaScript, HTML, and CSS.
• Data Pipelines & ETL: Architect, build, and maintain high-performance batch and near-real-time ETL pipelines using pySpark, AWS Glue, AWS Batch, or similar tools, orchestrated with tools like Apache Airflow. Process diverse data formats across SQL data warehouses and unstructured sources, collaborating cross-functionally to deliver scalable data solutions.
• Data Modeling & Storage: Optimize performance and design schema models across relational PostgreSQL, SQL Server and NoSQL DynamoDB databases, along with data warehouses like Snowflake.
• DevOps & Infrastructure: Manage infrastructure monitoring with CloudWatch, incident response, and CI/CD pipelines leveraging Jenkins, Docker, Kubernetes/EKS, and Git/GitHub. Experience utilizing and developing within AWS services. Troubleshoot and resolve issues related to AWS services and infrastructure.
• Testing: Establish rigorous automated unit and integration test suites to ensure high reliability and system stability.
• Cloud Optimization: Optimize data storage and processing using cloud-native services and technologies such as AWS S3, AWS Glue, AWS Batch, Lambda, and related AWS services.
• Skills:
• Languages & Frameworks: Python, Advanced SQL, JavaScript, HTML, CSS, React (Nice to have: Java, Kotlin, C#)
• Data Engineering & Analytics: Apache Spark, pySpark, Snowflake, AWS Glue, AWS Batch, ETL pipeline design, Apache Airflow
• Databases & Storage: AWS S3, Relational databases PostgreSQL, SQL Server, NoSQL DynamoDB
• API & Backend Development: REST API design, GraphQL/Apollo, Boto3, API contracts, microservices, low-latency API integration Nice to have: SQS/SNS messaging
• AWS Infrastructure & Cloud Services: Lambda, ECS, EC2, RDS, Route53, S3, CloudWatch, serverless architectures
• DevOps & Testing: Jenkins, Docker, Kubernetes/EKS, CI/CD pipelines, Git/GitHub, automated testing unit/integration
• Strategic Nice-to-Haves: IAM, cybersecurity data environments, access governance, identity platforms, Spring Batch, event-driven architectures

Note:

Pay Range: $90- $95

The specific compensation for this position will be determined by a number of factors, including the scope, complexity and location of the role as well as the cost of labor in the market; the skills, education, training, credentials and experience of the candidate; and other conditions of employment. Our full-time consultants have access to benefits including medical, dental, vision and 401K contributions as well as any other PTO, sick leave, and other benefits mandated by appliable state or localities where you reside or work.

#LI-AS2