Data Engineer

Job Role: Data Engineer- Consent
Location: Remote
Salary: up to$130k/ annum

Roles and Responsibilities:

• Develop, build, optimize and implement pipeline, data ingestion, storage, wrangling, cataloguing, quality, security features from various data sources on cloud
• Monitor and ensure the smooth operation of data pipelines between OneTrust and external Club platforms (ESPs, CRMs, etc.).

• Automate jobs (ingestion & pipelines), notifications and reports
• Assist in the ongoing data integration tasks (e.g., connectors, APIs) between OT and various business systems.

• Write quality code and participate in code reviews

• Experienced in implementing standardized pipelines with automated testing, Airflow scheduling, Azure DevOps for CI/CD

• Continuously improve systems through performance enhancements and cost reductions in compute and storage

• Prioritize to manage ad-hoc requests in parallel with ongoing sprints

• Participate with the team to execute sound solutions and approaches to meet business expectations in an efficient manner; deliver and execute the technical and product roadmap for data engineering across a variety of technologies.

• Experienced with Scrum and Agile Methodologies to coordinate global delivery teams, run scrum ceremonies, manage backlog items, and handle escalations

Required Skill Sets:

• Experience working in AWS, Redshift, Glue and basic API integrations

• Prior exposure to Data Ingestion and Curation work (such as working with Data Lakehouse)

• Knowledge in SQL for purpose of data analysis/investigation

• Work with the Data Product Owners and Data Analysts to help manage and deliver on the product technical roadmap for the data platform

Preferred Qualifications:

• Degree in computer science, statistics, or related discipline

• 5+ years as a data engineer

• Comfortable making decisions and leading

• Familiar with version control and relational databases
• Familiar with OneTrust or similar consent management platforms

Other Key Attributes / Characteristics:

• Superior communication skills both oral and written

• Positive contributor, strong team member, loves to work with and empower others

• Collaborates with a team

• Time management skills