Job Title: Hadoop/Big Data Platform Engineer / SME
Location: Charlotte, NC / Chicago, IL
Duration: Contract - 4 months
Pay Range: $73.67/hr (W2)
Job ID: 408208
About BCforward
BCforward is a leading global IT consulting and workforce solutions firm providing services and support to Fortune 500 and government clients. Founded in 1998, BCforward has grown with our customers needs into a full-service business solutions provider. With delivery centers and offices across North America and India, we take pride in building long-term relationships and delivering excellence through innovation, collaboration, and integrity.
Job Description
We are seeking a Hadoop Engineer (SME) to join our dynamic team. The ideal candidate will have strong experience in Big Data platform engineering and administration across Cloudera, Spark, Kafka, Hive, Impala, HBase, and containerized environments and a proven ability to operate and optimize enterprise data platforms, integrate solutions, and resolve complex production issues across environments.
Responsibilities:
- Provide subject matter expertise for Cloudera Hadoop and Data Science platforms, including Jupyter, OpenShift, and Docker cluster administration.
- Manage platform operations across environments, including upgrades, patches, deployments, monitoring, forecasting, and disaster recovery.
- Own incident, problem, and capacity management for Hadoop and associated services.
- Debug and troubleshoot YARN, Spark, and Impala jobs, including resource utilization and query performance tuning.
- Address NameNode, HDFS space, file and folder permissions, and backup issues.
- Integrate platform solutions with external applications and enterprise platforms.
- Analyze Hadoop logs, compression, encoding, and file formats to resolve production issues and improve stability.
- Collaborate with clients, development teams, vendors, and partners to deliver technical solutions that meet user needs.
- Support L1, L2, and L3 operations and establish runbooks and automation for repeatable tasks.
- Implement monitoring, alerting, and job scheduling using enterprise tools.
Required Skills & Qualifications:
- Expertise in Cloudera Hadoop components: HDFS, YARN, Hive, Impala, HBase, Kafka, Sentry, Solr, Hue, Zookeeper, and Postgres.
- Hands-on experience with Spark, Kafka, Hive, Impala, Ozone, and Hadoop ecosystem tooling.
- Strong Hadoop architecture knowledge, HDFS operations, and cluster administration with AD/Kerberos integration.
- Proficiency in Unix/Linux, SQL, and relational/data warehouse concepts across Sybase, Oracle, or similar databases.
- Scripting and development skills in Java, Python, Perl, and Shell for automation and tooling.
- Experience with monitoring, alerting, and job scheduling systems, including Autosys.
- Comfort with frequent, incremental testing and deployment in agile environments.
- Automation and DevOps tooling experience with Ansible, Jenkins, SVN, and Bitbucket.
- Experience supporting enterprise users and platforms at L1, L2, and L3 levels.
Preferred Skills:
- Cloudera Administrator or Developer certification.
- Certification or experience with Cloud, Docker, and OpenShift technologies.
- Experience with Tableau, including dashboards connected to Hadoop/Hive tables.
Why BCforward?
At BCforward, we believe in advancing lives and careers. When you join our team, you gain access to:
- Competitive compensation and benefits.
- Opportunities for growth with global clients.
- A supportive, inclusive culture that values innovation and people.
- Exposure to cutting-edge technologies and projects.
Role Logistics
- Shift options: 8:00 AM - 5:00 PM ET or 12:30 PM - 9:30 PM ET.
- Hours per day: 8. Labor type: Technical.
About Our Commitment
BCforward is an equal opportunity employer. We value diversity and are committed to creating an inclusive environment for all employees. All qualified applicants will receive consideration for employment without regard to race, color, religion, gender, sexual orientation, gender identity, national origin, age, disability, or veteran status.
Interested? Apply Now!
If this sounds like the right opportunity for you, please apply with your most recent resume.