Data Engineering Engineer 3

Data Engineer

V2Soft is a global leader in IT services and business solutions, delivering innovative and cost-effective technology solutions worldwide since 1998. We have headquartered in Bloomfield Hills, MI and have 16 offices spread across six countries. We partner with Fortune 500 companies to address complex business challenges. Our services span AI, IT staffing, cloud computing, engineering, mobility, testing, and more. Certified with CMMI Level 3 and ISO standards, V2Soft is committed to quality and security. Beyond our work, we actively support local communities and non-profits, reflecting our core values. Join us to be part of a dynamic and impactful global company!

Position Description

Employees in this job function are responsible for designing, building, and maintaining data solutions including data infrastructure, pipelines, etc. for collecting, storing, processing and analyzing large volumes of data efficiently and accurately. Key Responsibilities:

1. Collaborate with business and technology stakeholders to understand current and future data requirements
2. Design, build and maintain reliable, efficient and scalable data infrastructure for data collection, storage, transformation, and analysis
3. Plan, design, build and maintain scalable data solutions including data pipelines, data models, and applications for efficient and reliable data workflow
4. Design, implement and maintain existing and future data platforms like data warehouses, data lakes, data lakehouse etc. for structured and unstructured data
5. Design and develop analytical tools, algorithms, and programs to support data engineering activities like writing scripts and automating tasks
6. Ensure optimum performance and identify improvement opportunities

Skills Required

GCP Cloud Run, KAFKA, Cloud Architecture, Software Development, SQL, Cloud Computing, Big Data, Big Query, Application Development, Google Cloud Platform, Java, Application Testing, Agile Software Development, Artificial Intelligence & Expert Systems, Python, API

Experience Required

Engineer 3 Exp: 7+ years Data Engineering work experience

Education Required

Bachelor's Degree

Education Preferred

Hybrid Position 4 days a week onsite

Additional Information

Spearhead the design, development, and maintenance of scalable data ingestion and curation pipelines from diverse sources. Ensure data is standardized, high-quality, and optimized for analytical use. Leverage tools and technologies, including Python, SQL, and DBT/Dataform, to build robust and efficient data pipelines. Utilize your full-stack skills to contribute to seamless end-to-end development, ensuring smooth and reliable data flow from source to insight. Leverage your deep expertise in GCP services (BigQuery, Dataflow, Pub/Sub, Cloud Functions, etc.) to build and manage data platforms that not only meet but exceed business needs and expectations. Implement and manage robust data governance policies, access controls, and security best practices to protect sensitive data. Employ efficient data workflow management and cloud infrastructure provisioning, championing best practices in Infrastructure as Code (IaC). Continuously monitor and improve the performance, scalability, and efficiency of data pipelines and storage solutions, ensuring optimal resource utilization and cost-effectiveness. Collaborate effectively with data architects, application architects, and cross-functional teams to define and promote best practices, design patterns, and frameworks for cloud data engineering. Proactively automate data platform processes to enhance reliability, improve data quality, minimize manual intervention, and drive operational efficiency. Clearly and transparently communicate complex technical decisions to both technical and non-technical stakeholders, fostering understanding and alignment. Stay ahead of the curve by continuously learning about industry trends and emerging technologies, proactively identifying opportunities to improve our data platform and enhance our capabilities. Develop comprehensive documentation for data engineering processes, promoting knowledge sharing, facilitating collaboration, and ensuring long-term system maintainability. V2Soft is an Equal Opportunity Employer (EOE). We welcome applicants from all backgrounds, including individuals with disabilities and veterans.