As a Data Engineer, you will be responsible for designing, developing, and maintaining data solutions for data generation, collection, and processing in Big Data environment using predominantly PySpark/Python. Your typical day will involve creating data pipelines, ensuring data quality, and implementing ETL processes to migrate and deploy data across systems using PySpark.
Roles & Responsibilities:
- Design, develop, and maintain data solutions for data generation, collection, and processing using PySpark.
- Create data pipelines, ensuring data quality, and implementing ETL processes to migrate and deploy data across systems.
- Collaborate with cross-functional teams to identify and resolve data-related issues.
- Stay updated with the latest advancements in data engineering and integrate innovative approaches for sustained competitive advantage.
Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.