Role: Hadoop Developer
Location: Charlotte, NC (Hybrid)
Job Description:-
Primary Skill: Hadoop ecosystem (HDFS, Hive, Spark), PySpark, Python, Apache Kafka
Roles & Responsibilities
Architectural Leadership:
- Define end-to-end architecture for data platforms, streaming systems, and web applications.
- Ensure alignment with enterprise standards, security, and compliance requirements.
- Evaluate emerging technologies and recommend adoption strategies.
Data Engineering:
- Design and implement data ingestion, transformation, and processing pipelines using Hadoop, PySpark, and related tools.
- Optimize ETL workflows for large-scale datasets and real-time streaming.
- Integrate Apache Kafka for event-driven architectures and messaging.
Collaboration & Leadership:
- Work closely with product owners, business analysts, and DevOps teams.
- Mentor junior developers and data engineers.
- Participate in agile ceremonies, code reviews, and design discussions.
Required Skills & Qualifications:
Technical Expertise:
- Strong experience with Hadoop ecosystem (HDFS, Hive, Spark).
- Proficiency in PySpark for distributed data processing.
- Advanced programming skills in Python.
- Hands-on experience with Apache Kafka for real-time streaming.
Architectural Skills:
- Expertise in designing scalable, secure, and high-performance systems.
- Familiarity with microservices, API design, and cloud-native architectures.
Additional Skills:
- Knowledge of CI/CD pipelines, containerization (Docker/Kubernetes).
- Exposure to cloud platforms (AWS, Azure, GCP). Soft Skills: Strong analytical and problem-solving abilities.
- Excellent communication and leadership skills.
- Ability to thrive in a fast-paced, agile environment.
Please send your response to Rudreshwar.G@fixitytech.com