Systems Operation Engineer

Mindlance

Union, NJ

JOB DETAILS
SALARY
SKILLS
Analysis Skills, Apache Hadoop, Apache Spark, Apiary/Beekeeping, Big Data, Caching, Capacity Utilization, Cloud Computing, Cloudera, Computer Science, Computer Security, Data Analysis, Data Quality, Data Science, DevOps, Documentation, HortonWorks, Identify Issues, Information Technology & Information Systems, Performance Metrics, Private Cloud, Proof of Concept, Reporting Skills, Root Cause Analysis, Scripting (Scripting Languages), Simulation, System Operations, Systems Engineering, Test Plan/Schedule, Testing, Virtualization, Willing to Travel
LOCATION
Union, NJ
POSTED
21 days ago
Systems Operation Engineer,  Mindlance Inc.      (Union, NJ)
  1. Administer and support tools on the Data Private Cloud, including CDP, HWX, and MapR.
  2. Install, configure, and maintain data analytical and virtualization tools such as Dremio, JupyterHub, and At Scale across multiple clusters.
  3. Develop proof-of-concepts solutions leveraging CDP and OCP technologies.
  4. Deploy tools, troubleshoot issues, perform root cause analysis, and remediate vulnerabilities.
  5. Develop automation scripts for configuration and maintenance of data virtualization tools.
  6. Drive advanced modeling, simulation, and analysis initiatives.
  7. Maintain comprehensive documentation of Hadoop cluster configurations, processes, and procedures.
  8. Generate reports on cluster usage, performance metrics, and capacity utilization.
  9. Work closely with data engineers, data scientists, and other stakeholders to understand their requirements and provide necessary support.
  10. Collaborate with IT infrastructure teams for integrating Dremio Tool, Hadoop clusters with existing systems and services.
  11. Support programming staff during development, testing and implementation phases and lead complex platform design, coding and testing efforts.
  12. Work with big data platforms: MapR, Hortonworks, Cloudera Data Platform.
  13. Hands-on expertise with data virtualization tools: Dremio, JupyterHub, AtScale.
  14. Deploy and manage tools in cloud and containerized environments (CDP, OCP).
  15. Understand platform engineering, automation scripting, and DevOps practices.
  16. Troubleshoot complex issues and perform root cause analysis.
 
JOB REQUIREMENTS:
  • Bachelor’s degree in Computer Science, Information Technology or related field of study.
  • 5 years' experience in position offered or related position with similar duties.
 
Special Skills:
  • 5 years’ experience required with:
    • Designing big data solutions using Hive and Spark;
    • Development of automated data quality framework, complex hive queries and deployment on spark cluster;
    • Optimization of job flows, caching techniques;
    • YARN resource configuration,
Where all such experience can be acquired concurrently.
Travel required to unanticipated client locations all over the United States
 
SALARY: $150,550/per year including benefits
 
WORK SCHEDULE: 40 hours per week, M-F (9:00 a.m. to 6:00 p.m.)
Email Resumes to: usjobs@mindlance.com, No calls, EOE

About the Company

M

Mindlance