| Location | San Antonio, TX (Remote) |
| Job Type | Contractor |
Hiring: Data Engineer
Experience: 5–6 Years
Job Type: Full-Time
Work Location: Remote / Hybrid / Onsite
Interview Mode: Webcam / Technical Interview
Job Summary:
We are looking for an experienced Data Engineer with 5–6 years of hands-on experience in designing, developing, and maintaining scalable data pipelines and data integration solutions.
The ideal candidate should have strong expertise in SQL, Python, ETL/ELT, Apache Spark/PySpark, and cloud platforms (AWS, Azure, or GCP). The candidate should have experience working with large datasets, data warehouses, data lakes, and modern data engineering technologies.
Key Responsibilities:
Design, develop, and maintain scalable ETL/ELT data pipelines.
Develop complex SQL queries, stored procedures, and optimize database performance.
Build data processing solutions using Python, PySpark, and Apache Spark.
Implement data integration, transformation, cleansing, and validation processes.
Work with cloud platforms such as AWS, Azure, or GCP.
Develop and maintain data warehouses, data lakes, and lakehouse solutions.
Work with big data technologies such as Spark, Hadoop, Kafka, and Databricks.
Schedule, monitor, and troubleshoot data pipelines using Apache Airflow.
Ensure data quality, security, scalability, and pipeline performance.
Collaborate with Data Analysts, Data Scientists, BI Developers, and business teams.
Required Technical Skills:
5–6 years of experience in Data Engineering.
Strong hands-on experience with SQL and Python.
Experience developing ETL/ELT pipelines.
Good knowledge of Apache Spark and PySpark.
Hands-on experience with at least one cloud platform: AWS, Azure, or GCP.
Understanding of Data Warehousing and Data Modeling.
Experience with data integration and large-scale data processing.
Working knowledge of Git and CI/CD.
Preferred Skills
Apache Airflow
Databricks
Apache Kafka
Snowflake
Azure Synapse Analytics
Amazon Redshift
Google BigQuery
Delta Lake and Lakehouse Architecture
Star Schema and Snowflake Schema
Batch and Real-Time Data Processing
Data Governance and Data Quality Frameworks
Qualifications
Bachelor's degree in Computer Science, Information Technology, or a related field.
Strong analytical and problem-solving skills.
Good communication and collaboration skills.
Understanding of Agile/Scrum and SDLC.
Interested candidates: Please share your updated resume to pujitha@ireshtechnologies.com and chaitra@ireshtechnologies.com along with your current location, contact details, and availability.