Data Engineer

A bachelor’s degree in computer science or information technology is required. Equivalent work experience may be accepted in lieu of formal education. Assist in design, development, and practical implementation of networking systems based on the company’s needs. Maintenance and repair of existing networks and network infrastructure to ensure minimum downtime. Provide input for deciding specifications of new IT equipment to be bought and any replacements/upgrades for current infrastructure. Working knowledge of switching and routing is required. Monitor network health and recommend solutions in advance to prevent faults and increase capacity based on upcoming needs. Maintain the technical documentation needed for IT support technicians and team members.

Research, design, and develop computer and network software or specialized utility programs. Analyze user needs and develop software solutions, applying principles and techniques of computer science, engineering, and mathematical analysis. Update software or enhance existing software capabilities. May work with computer hardware engineers to integrate hardware and software systems, and develop specifications and performance requirements. May maintain databases within an application area, working individually or coordinating database development as part of a team.

Computer: Use hardware and software expertise to configure, install, and maintain computer networks. May require troubleshooting and repairing technical issues, providing end-user support, and applying best practices for data backups and system security. Mathematical: Develop software to model random or selective hypothetical and real-world problems and generate solutions. Typically requires use of programming language and coordination with researchers and other subject matter experts.

Provide technical assistance to computer users. Answer questions or resolve computer problems for clients in person, via telephone, or electronically. May provide assistance concerning the use of computer hardware and software, including printing, installation, word processing, electronic mail, and operating systems.

Use management and technical knowledge to design, develop, distribute, maintain, and monitor software designed to simplify big data management using Apache Hadoop automation tools. Requires extensive knowledge of programming languages, application of information security best practices, workflow design strategies, and collection of customer feedback to continually enhance user experience.

Utilize training in analytics and coding to draw conclusions. Build and maintain a company’s database by identifying and implementing both installation and structural solutions. Conduct needs identification. Create database solutions, evaluating requirements, and developing and preparing design reports. Create an effective blueprint for developing, testing, and maintaining a database system that is accessible, useful and secure. Streamline data flow. Optimize database activity across company needs while monitoring and eliminating unnecessary costs.

Install, configure, and maintain an organization's local area network (LAN), wide area network (WAN), data communications network, operating systems, and physical and virtual servers. Perform system monitoring and verify the integrity and availability of hardware, network, and server resources and systems. Review system and application logs and verify completion of scheduled jobs, including system backups. Analyze network and server resource consumption and control user access. Install and upgrade software and maintain software licenses. May assist in network modeling, analysis, planning, and coordination between network and data communications hardware and software.

Design, develop, automate, and support complex applications to load, transform and extract substantial amounts of data. Extract and duplicate business data to load into warehouse environment. Conduct testing and resolve performance problems before system is live. Determine, design and test appropriate data warehousing environment tailored to meet a company/organization’s specific needs. Extract and transfer existing data and test new storage environment once transfer has occurred. Provide maintenance support. Requires both advanced programming and design skills

Analyze and coordinate the schedule, timeline, procurement, staffing, and budget of a product or service on a per project basis. Lead and guide the work of technical staff. May serve as a point of contact for the client or customer.