Job Title: Data Engineer (DB2 / Hive / Spark)
Location: Jacksonville, FL or Remote EST time zone
Experience: 5–10 Years (flexible based on profile)
Role Summary
We are looking for a strong Data Engineer with hands-on experience in DB2, Hive, and Spark. The ideal candidate should have deep expertise in SQL (especially stored procedures), data cleanup, and handling large-scale batch data processing.
Key Responsibilities
Develop, optimize, and maintain complex SQL queries and stored procedures (DB2 focus)
Perform data cleanup, transformation, and validation on large datasets
Work extensively with DB2 (heavy data environments) and Hive
Design and implement batch data processing pipelines
Use Apache Spark for scalable data processing and performance optimization
Analyze data issues and ensure data quality, consistency, and integrity
Collaborate with cross-functional teams for data requirements and delivery
Troubleshoot performance issues and optimize ETL/data workflows
Required Skills
Strong expertise in SQL and Stored Procedures (DB2 mandatory)
Hands-on experience with DB2 (large-scale data handling)
Working knowledge of Hive and Hadoop ecosystem
Experience with Apache Spark (PySpark/Scala preferred)
Solid understanding of batch processing frameworks
Experience in data cleansing, transformation, and validation
Good problem-solving and performance tuning skills
Nice to Have
Experience with ETL tools (Informatica, DataStage, etc.)
Exposure to cloud platforms (AWS/Azure/GCP)
Knowledge of data warehousing concepts
Role Descriptions: Data Eng
Essential Skills: Data Eng
Desirable Skills:
Keyword:
Skills: Agile Way of Working~Digital : NoSQL Column DB~Digital : PySpark
Experience Required: 8-10