Data Engineer Quality Engineer

Tekfortune Inc.

Dallas, TX

JOB DETAILS
SKILLS
AWS Lambda, Amazon Simple Storage Service (S3), Amazon Web Services (AWS), Analysis Skills, Apache Spark, Communication Skills, Consulting, Continuous Deployment/Delivery, Continuous Integration, Data Analysis, Data Management, Data Quality, Data Sets, Database Extract Transform and Load (ETL), Debugging Skills, DevOps, Distributed Computing, Electronic Medical Records, Error Handling, Failover, Incident Response, Information/Data Security (InfoSec), Metrics, Problem Solving Skills, Production Systems, Python Programming/Scripting Language, Quality Assurance, Quality Engineering, Quality Management, Reconciliation, Regression Testing, Root Cause Analysis, SQL (Structured Query Language), Scala Programming Language, Service Level Agreement (SLA), Software Design for Test (SDET), Test Automation, Test Data, Test Fixtures, Test Plan/Schedule, Test Strategy, Traceability, Work From Home, Workflow Analysis
LOCATION
Dallas, TX
POSTED
30+ days ago
Tekfortune is a fast-growing consulting firm specialized in permanent, contract & project-based staffing services for world s leading organizations in a broad range of industries. In this quickly changing economic landscape, virtual recruiting and remote work are critical for the future of work. To support the active project demands and skills gaps, our staffing experts can help you find the best job for you.


Role: Data Engineer Quality Engineer
Location: Dallas, TX
Duration: 6 months
Required Skills: Data Engineer
Job Description:

We are seeking a Data Engineer Quality Engineer to ensure the reliability, accuracy, performance, and scalability of our data platforms and pipelines. This role focuses on validating end-to-end data ingestion, processing, streaming, and analytics workflows built on AWS, Kafka, SQL, Data Bricks and Python.
You will work closely with Data Engineers, Platform Engineers, Analytics teams, and DevOps to embed quality into the data lifecycle ensuring trusted data, resilient pipelines, and production-ready systems.
Key Responsibilities
Validate batch and streaming data pipelines for correctness, completeness, consistency, and timeliness.
Create and maintain data quality checks (nulls, duplicates, schema drift, referential integrity).
Verify business rules and transformations using SQL-based validations.
Design, develop, and execute test strategies for Databricks-based data pipelines and analytics workflows
Establish data reconciliation and end-to-end traceability between source and downstream systems.
Test ETL/ELT pipelines built using AWS services (Glue, Lambda, EMR, Step Functions).
Validate transformations written in SQL and Python.
Ensure correctness across data ingestion, enrichment, aggregation, and publishing layers.
Test reprocessing, backfills, and historical data loads.
Validate ETL/ELT processes built using Apache Spark (PySpark/Scala) in Databricks
Validate Kafka-based streaming pipelines for data integrity, ordering, and exactly-once/at-least-once semantics.
Test producer and consumer logic, serialization formats (Avro, JSON, Protobuf).
Validate topic configurations, partitions, offsets, retention policies, and schema changes.
Simulate and test late arrivals, duplicate events, and consumer failures.
Test data workflows using AWS S3, Glue, Lambda, Redshift, Athena, Kinesis, DynamoDB, or similar services.
Validate IAM roles, permissions, and secure data access.
Verify data lifecycle policies, encryption, and storage optimizations.
Build and maintain automated data testing frameworks using Python.
Develop reusable test utilities, fixtures, and synthetic datasets.
Integrate data tests into CI/CD pipelines for pre-merge, scheduled, and post-deployment validation.
Enable automated alerts for data quality failures.
Validate pipeline performance for large-scale datasets.
Test throughput, latency, and concurrency under peak workloads.
Validate retry logic, error handling, idempotency, and recovery mechanisms.
Perform soak, regression, and failover testing
Validate data pipeline metrics, logs, and alerts using CloudWatch, Prometheus, Grafana, or equivalent tools.
Partner with teams to define data SLAs and SLOs.
Participate in incident response, root-cause analysis, and postmortems related to data quality issues
Required Qualifications
7+ years of experience in QA, SDET, or Data Quality Engineering roles.
Strong hands-on experience with SQL for complex data validation and analysis.
Proficiency in Python for test automation and data validation.
Experience testing data pipelines and ETL/ELT workflows.
Hands-on experience with Kafka or other streaming platforms.
Solid understanding of AWS data services (S3, Glue, Redshift, Lambda, Athena, etc.).
Experience working with large datasets and distributed systems.
Strong debugging, analytical, and problem-solving skills.


Skills:
Need a consultant with 10+ years of over all experience
Need a strong Data Engg with Data Bricks exp
Excellent comm skills are must
Must be willing to face in person interview
Must be able to work 3-4 days from office in Dallas





For more information and other jobs available please contact our recruitment team at

careers@tekfortune.com

. To view all the jobs available in the USA and Asia please visit our website at https://www.tekfortune.com/careers/.

About the Company

T

Tekfortune Inc.

Tekfortune is a software solutions company providing project development and staff augmentation services to companies in various industries including Healthcare, Banking, Finance, Telecommunication and Aviation.

Tekfortune Inc delivers solutions to a wide variety of organizations of various sizes and industries. Our clients include mid-market to Fortune 1000 companies spanning across industries such as: Insurance, Financial, Pharmaceutical, Manufacturing, Retail and many others.

In Tekfortune Inc, we are offering selection of services and solutions at very reasonable rates. With years of experience in the placement and recruitment Industry and over time we have acquired the knowledge essential to comprehend the exact need and dependence on customers. Therefore we provide the customers the best and also the brightest candidates for vacancies. Moreover, by understanding the working interest of customers who is able to place them within the companies where they are able to get maximum opportunity for professional growth.

Tekfortune Inc has a strong emphasis on quality. Its goal would be to achieve client satisfaction by looking into making deliveries satisfaction of customer's business needs. Our ability to quickly identify and effectively employ proven fundamental principles, techniques and resources yields highly desirable results for our clients.

We understand that each industry and organization share a level of uniqueness that requires a tailored approach in order to deliver specific solutions. Such factors as client culture, industry regulations, organizational maturity, financial health and many more items may impact our approach to delivering client solutions.

Having served a wide variety of clients has provided Tekfortune the ability to build subject matter expertise across numerous industries. Our industry expertise combined with our specialized knowledge of Business Process Improvement, Requirements Management and Program & Project Management provides a powerful combination and a tremendous value to our clients.

We are run by a group of industry experts who have decades of experience in delivering custom solutions to our clients.
COMPANY SIZE
20 to 49 employees
INDUSTRY
Computer Software
FOUNDED
2014
WEBSITE
http://www.tekfortune.com/