Data Warehouse Engineer

Use management and technical knowledge to design, develop, distribute, maintain, and monitor software designed to simplify big data management using Apache Hadoop automation tools. Requires extensive knowledge of programming languages, application of information security best practices, workflow design strategies, and collection of customer feedback to continually enhance user experience.

Write custom scripts to help clean and validate data. Create custom dashboards that are updated when more data is added to the database. Extract data from multiple sources and perform data integration using ETL (extract, transform and load) to blend the data. Must have a working knowledge of database structure and how to transfer data from one type of data structure to another. Design, maintain and update the existing database. Generate custom reports when needed. Debug and resolve technical issues in the database. Bachelor’s degree in science/engineering or computer science or relevant experience is required.

Research, design, and develop computer and network software or specialized utility programs. Analyze user needs and develop software solutions, applying principles and techniques of computer science, engineering, and mathematical analysis. Update software or enhance existing software capabilities. May work with computer hardware engineers to integrate hardware and software systems, and develop specifications and performance requirements. May maintain databases within an application area, working individually or coordinating database development as part of a team.

Design, develop, automate, and support complex applications to load, transform and extract substantial amounts of data. Extract and duplicate business data to load into warehouse environment. Conduct testing and resolve performance problems before system is live. Determine, design and test appropriate data warehousing environment tailored to meet a company/organization’s specific needs. Extract and transfer existing data and test new storage environment once transfer has occurred. Provide maintenance support. Requires both advanced programming and design skills

Collect, clean, refine and analyze data. Create and test a hypothesis based on different interpretations of data. Develop, maintain, and update the database to ensure accurate reporting of essential data. Build reports and dashboards to ensure smooth monitoring of business and/or process status. Update data collection systems and enable automation of data collection. Work with changing priorities and prioritize based on current business needs. Make ad-hoc reports and identify areas for increased efficiency, profitability, and reliability. Study market trends based on customer data and identify trends.

Use strong knowledge of statistics to process raw data and transform it into a creative format that allows for meaningful analysis. May require design and implementation of relational databases and collaboration with other interested parties to translate business objectives into workflows.