Data Engineering Lead

Lead operational monitoring, performance tuning, and root-cause analysis of production data platforms using observability tools such as CloudWatch to maintain high availability and service reliability. • Lead the solution design and optimization of scalable data pipelines and microservices in Python, enabling both real-time and batch data processing across enterprise platforms.

Join a Global Leader in Workforce Solutions – Net2Source Inc.
Who We Are
Net2Source Inc. isn't just another staffing company, we're a powerhouse of innovation, connecting top talent with the right opportunities. Recognized for 300% growth in the past three years, we operate in 34 countries with a global team of 5,500+. Our mission? To bridge the talent gap with precision—Right Talent. Right Time. Right Place. Right Price.

Role: Data Engineering Lead
Work location: Irving, TX
Duration: 1+ Months.  

• Actively collaborate with Principal Software Engineers and Data Architects to define solution architecture

• Lead the solution design and optimization of scalable data pipelines and microservices in Python, enabling both real-time and batch data processing across enterprise platforms

• Drive the development of cloud-native data ingestion and streaming solutions leveraging AWS services including Kinesis, S3, DynamoDB, EventBridge, and related technologies

• Own the design, implementation, and operational excellence of data integration frameworks and source data pipelines supporting CI Autonomy initiatives

• Partner with business, product, and engineering stakeholders to translate complex requirements into scalable data architectures, workflows, mappings, and system designs

• Establish and enforce automated testing, data quality controls, and validation frameworks to ensure integrity, reliability, and compliance across distributed data ecosystems

• Lead operational monitoring, performance tuning, and root-cause analysis of production data platforms using observability tools such as CloudWatch to maintain high availability and service reliability

• Bachelor's degree in Computer Science, Computer Engineering, or related field

• 8+ years of experience in data engineering or related disciplines with increasing responsibility

• Extensive experience on modern, large scale, complex Caterpillar data platforms such as Helios Data Platform

• Strong foundation developing and deploying Python solutions to a production environment

• Experience leading teams to build high-throughput, scalable data pipelines

• Strong hands-on experience with AWS data services (Kinesis, S3, DynamoDB, EventBridge, etc.) at scale

• Strong in SQL, including data quality and validation practices

• Experience in deploying software using CI/CD tools such as Azure DevOps, Jira, Jenkins, etc.

• Experience developing microservices that support real-time data ingestion

• Experience developing software applications using relational and noSQL databases

• Ability to ensure data integrity across distributed and streaming systems

• Experience with monitoring, testing, and automation in large-scale data environments

**** Must be customer office premises : Irving, TX** **

Why Work With Us?
We believe in more than just jobs—we build careers. At Net2Source, we champion leadership at all levels, celebrate diverse perspectives, and empower you to make an impact. Think work-life balance, professional growth, and a collaborative culture where your ideas matter.
Our Commitment to Inclusion & Equity
Net2Source is an equal opportunity employer, dedicated to fostering a workplace where diverse talents and perspectives are valued. We make all employment decisions based on merit, ensuring a culture of respect, fairness, and opportunity for all, regardless of age, gender, ethnicity, disability, or other protected characteristics.
Awards & Recognition
• America's Most Honored Businesses (Top 10%)
• Fastest-Growing Staffing Firm by Staffing Industry Analysts
• INC 5000 List for Eight Consecutive Years
• Top 100 by Dallas Business Journal
• Spirit of Alliance Award by Agile1
Ready to Level Up Your Career?
Click Apply Now and let's make it happen.

Best regards,
Juan C. Matus 
Sr. Customer Success Manager