Senior Data Engineer Identity & Access ManagementLocation: 100% Remote
Work Hours: Must work within Eastern Time business hours
Organization: Cyber Identity & Access Management
Position Overview
Client s Cyber / Identity & Access Management organization is building a new application and engineering capability focused on agentic technology and risk identification.
We are seeking a Senior Data Engineer / Data & Backend Engineer who can help build the application from the ground up. This is not a traditional data engineering position. The ideal candidate will combine strong data engineering, AWS cloud, API development, application performance, and production troubleshooting skills.
The engineer will help build data pipelines and a low-latency GraphQL API that will make data available to Client employees and support critical runtime developer workflows.
This will be a small team consisting of two full-time engineers and this senior contractor, providing an opportunity to have significant technical ownership and influence.
Key Responsibilities- Design, build, and optimize high-volume data pipelines supporting the new IAM application.
- Develop and maintain scalable data engineering solutions using AWS and modern data technologies.
- Build and support a lightweight, low-latency GraphQL API that exposes data to internal applications and users.
- Design data models and data-processing workflows to efficiently present data through APIs.
- Develop and maintain data pipelines using technologies such as PySpark, Apache Spark, AWS Glue, and related data platforms.
- Work with AWS services including Lambda, ECS, DynamoDB, PostgreSQL, S3, and AWS Glue.
- Troubleshoot application performance, latency, scalability, and reliability issues in production.
- Implement monitoring and observability solutions for data pipelines and APIs.
- Optimize cloud infrastructure and applications for performance, scalability, and reliability.
- Collaborate with engineering, cybersecurity, IAM, and other stakeholders to define technical solutions.
- Participate in architecture, design, development, testing, deployment, and production support.
- Help establish engineering practices and technical standards for the newly formed team.
- Translate complex data into reliable, accessible APIs and services.
- Support the development of systems designed to identify and assess risks associated with emerging agentic technologies.
Required Qualifications- Bachelor's degree in Computer Science, Engineering, Information Technology, or a related field.
- 7+ years of IT/technology experience.
- 5+ years of hands-on software/data engineering experience.
- Strong hands-on AWS experience.
- Strong data engineering experience with large-scale data pipelines.
- Experience with PySpark, Apache Spark, AWS Glue, or similar technologies.
- Strong API development experience.
- Experience developing GraphQL or REST APIs.
- Experience building and troubleshooting low-latency applications/APIs.
- Strong experience with production monitoring and troubleshooting.
- Experience with cloud-based databases and data stores.
- Strong programming experience with Python, Scala languages.
- Strong analytical, troubleshooting, and problem-solving skills.
Required AWS Experience
Candidates should have hands-on experience with several of the following, with the following considered particularly important:
- AWS Lambda
- Amazon ECS
- DynamoDB
- PostgreSQL
- Amazon S3
- AWS Glue
Experience with additional AWS services and serverless technologies is a plus.
Data Engineering Skills
Experience with one or more of the following:
- PySpark
- Apache Spark
- AWS Glue
- Data pipelines
- Batch processing
- Distributed data processing
- Data modeling
- Data integration
- Data quality
- Large-scale data processing
- Performance optimization
API & Application Development- GraphQL API development
- REST API development
- Low-latency API design
- API performance optimization
- API integration
- Application troubleshooting
- Distributed application architecture
- Monitoring and observability
Preferred Qualifications- Experience building applications from the ground up.
- Experience working in cybersecurity or Identity & Access Management.
- Experience with agentic AI or AI-enabled applications.
- Experience supporting critical runtime applications.
- Experience with cloud performance and latency optimization.
- Experience with production monitoring and observability.
- Experience with serverless AWS architectures.
- Experience with Snowflake, Batch, or similar data platforms.
- Experience working in a small, highly collaborative engineering team.
- Client experience is highly desirable.
Work Environment- 100% remote opportunity.
- Candidate must be able to work during Eastern Time Zone business hours.
- This is a new application and team build-out within Client's Cyber / Identity & Access Management organization.
- The candidate will work closely with two full-time engineers and will be expected to provide senior-level technical guidance and help accelerate the team's development.