Big Data/Machine Learning Engineer - Sr

Job Title: Data Engineer 
Location: McLean, VA (Onsite Preferred – Other Capital One Locations Acceptable)
Interview Process: 30-minute Zoom video interview

Job Description

Capital One is looking for an experienced Senior Data Engineer with strong expertise in Big Data technologies, distributed data processing, and cloud-based data engineering solutions. The ideal candidate will have hands-on experience developing scalable data pipelines, working with AWS services, building REST APIs, and implementing real-time streaming solutions.

Required Technical Skills

• Strong hands-on experience with Python and Scala programming.

• Extensive experience with AWS cloud services, particularly AWS EMR and AWS Glue.

• Strong knowledge of Big Data technologies and distributed data processing.

• Experience developing and integrating REST APIs.

• Hands-on experience with Apache Kafka and real-time data streaming.

• Strong SQL skills, including complex queries and database optimization.

• Experience designing, developing, and maintaining scalable ETL/ELT data pipelines.

• Ability to troubleshoot, optimize, and maintain high-performance data engineering solutions.

Preferred Skills

• Exposure to Artificial Intelligence (AI) and Machine Learning (ML) technologies.

• Experience integrating AI/ML capabilities into data engineering workflows.

• Familiarity with modern cloud-based data platforms and scalable data architectures.