Hadoop Python Data Engineer

Job Title: Hadoop Data Engineer
Location: Chicago, IL/Denver, CO/Washington, DC
Work Arrangement: Fully Onsite
Client Industry: Enterprise BFSI client
Duration: 18+ Months Contract
Schedule: Monday to Friday, Standard working hours

About the Role:

Seeking a highly skilled Data Engineer (hadoop plus python) to join the client in Chicago or Denver or Washington. This is a 100% onsite role supporting critical data ingestion, pipeline development, and performance optimization initiatives in a secure banking environment.

Top Three skills:

• Python-Based Data Pipeline Engineering

  • Building production-grade pipelines

  • Performance tuning, memory management, error handling

  • Batch & near-real-time processing

• Hadoop Ecosystem Expertise

  • Strong understanding of HDFS, YARN, MapReduce

  • Distributed processing with Spark/Hive

  • Scalable and reliable data workflows

• Custom Data Ingestion & Integration

  • Designing ingestion from APIs, queues, DBs, files

  • Kafka & message-driven architectures

  • PHP-based data services & integration endpoints

What We’re Looking For:

· Design, develop, and maintain data pipelines primarily using Python, writing production-grade code to ingest, process, and move large-scale datasets across distributed environments.

· Build and enhance data processing workflows on Hadoop-based platforms, leveraging a strong understanding of Hadoop architecture (HDFS, YARN, MapReduce) to ensure scalability, reliability, and performance.

· Develop custom data ingestion and transformation logic, rather than relying solely on prebuilt tools, to support batch and near-real-time processing requirements.

· Write, maintain, and optimize Python code for distributed data processing, including performance tuning, memory management, and error handling in large data environments.

· Contribute hands-on code in PHP to support data services, ingestion endpoints, or integration layers that interact with data pipelines or upstream/downstream system

Compensation:
Hourly Rate: $63 – $64 per hour
This range reflects base compensation and may vary based on location, market conditions, experience, and candidate qualifications.

Benefits:
The Company offers the following benefits for this position, subject to applicable eligibility requirements: medical insurance, dental insurance, vision insurance, 401(k) retirement plan, life insurance, long-term disability insurance, short-term disability insurance, paid parking/public transportation, (paid time , paid sick and safe time , hours of paid vacation time, weeks of paid parental leave, paid holidays annually - AS Applicable)

About Us:

At Collabera, we don’t just offer jobs—we build careers. As a global leader in talent solutions, we provide opportunities to work with top organizations, cutting-edge technologies, and dynamic teams. Our culture thrives on innovation, collaboration, and a commitment to excellence. With continuous learning, career growth, and a people-first approach, we empower you to achieve your full potential. Join us and be part of a company that values passion, integrity, and making an impact.

Ready to Apply?

Apply now on shivani.soni@collabera.com/973-841-2468

Note: we are looking for python programming with data integration rather than ETL Tooling.