We are seeking an experienced Data Engineer with strong hands-on expertise in PySpark, SQL, and ETL development to design, develop, and maintain scalable data pipelines. The ideal candidate will have experience in data processing, data transformation, data integration, and building reliable data solutions to support business reporting and analytics.
Numbers & Facts
Location
Freemont, CA
Industry
Computer Software
Company Size
20 to 49 employees
Year Founded
2014
Website
http://www.tekfortune.com/
Description
Job Title: Data Engineer PySpark, SQL & ETL
Location: Fremont, CA
Duration : 12 months + Possible Extension
Job Summary
We are seeking an experienced Data Engineer with strong hands-on expertise in PySpark, SQL, and ETL development to design, develop, and maintain scalable data pipelines. The ideal candidate will have experience in data processing, data transformation, data integration, and building reliable data solutions to support business reporting and analytics. Key Responsibilities
Design, develop, and maintain scalable ETL/ELT pipelines for data extraction, transformation, and loading.
Develop and optimize data processing applications using Python and PySpark.
Write complex SQL queries, perform data transformations, and optimize query performance.
Build and maintain data pipelines to process structured and semi-structured data.
Perform data cleansing, validation, reconciliation, and quality checks.
Troubleshoot data pipeline failures and resolve data processing issues.
Collaborate with business analysts, data architects, and other engineering teams to understand data requirements.
Optimize data workflows for performance, scalability, reliability, and efficiency.
Maintain technical documentation for data pipelines, data models, and ETL processes.
Follow best practices for data security, data governance, and code quality.
Required Skills
Strong hands-on experience with PySpark and Python.
Strong SQL skills, including complex queries, joins, aggregations, and performance optimization.
Experience developing and maintaining ETL/ELT processes.
Understanding of Apache Spark and distributed data processing.
Experience with data integration, transformation, and data quality validation.
Strong analytical, debugging, and problem-solving skills.
Ability to work collaboratively in a team environment.
Preferred Qualifications
Experience with cloud data platforms such as AWS, Azure, or GCP.
Exposure to Databricks, Snowflake, or cloud-based data warehouses.
Familiarity with scheduling and orchestration tools such as Airflow.
Experience with Git, CI/CD, and Agile development methodologies.
About Company
Tekfortune is a software solutions company providing project development and staff augmentation services to companies in various industries including Healthcare, Banking, Finance, Telecommunication and Aviation.
Tekfortune Inc delivers solutions to a wide variety of organizations of various sizes and industries. Our clients include mid-market to Fortune 1000 companies spanning across industries such as: Insurance, Financial, Pharmaceutical, Manufacturing, Retail and many others.
In Tekfortune Inc, we are offering selection of services and solutions at very reasonable rates. With years of experience in the placement and recruitment Industry and over time we have acquired the knowledge essential to comprehend the exact need and dependence on customers. Therefore we provide the customers the best and also the brightest candidates for vacancies. Moreover, by understanding the working interest of customers who is able to place them within the companies where they are able to get maximum opportunity for professional growth.
Tekfortune Inc has a strong emphasis on quality. Its goal would be to achieve client satisfaction by looking into making deliveries satisfaction of customer's business needs. Our ability to quickly identify and effectively employ proven fundamental principles, techniques and resources yields highly desirable results for our clients.
We understand that each industry and organization share a level of uniqueness that requires a tailored approach in order to deliver specific solutions. Such factors as client culture, industry regulations, organizational maturity, financial health and many more items may impact our approach to delivering client solutions.
Having served a wide variety of clients has provided Tekfortune the ability to build subject matter expertise across numerous industries. Our industry expertise combined with our specialized knowledge of Business Process Improvement, Requirements Management and Program & Project Management provides a powerful combination and a tremendous value to our clients.
We are run by a group of industry experts who have decades of experience in delivering custom solutions to our clients.