Data Engineer with AI Kubernetes
Cliff Services Inc
Columbus, OH
Data Engineer with AI Kubernetes
Location: Columbus, OH (Onsite 5 days) Locals Only
Interview - F2F
Type: Contract-to-Hire (Visa Independent Candidates Only)
We are hiring a Data Engineer with strong expertise in Python, PySpark, and AWS to build and manage scalable data pipelines. The role involves working with large-scale distributed data systems and supporting modern data platforms.
Key Requirements:
Strong experience in Python and Apache Spark (PySpark)
Hands-on with AWS services (S3, Glue, EMR, Redshift, Lambda, Athena)
Proficiency in SQL and working with relational & NoSQL databases
Knowledge of ETL, data modeling, and data warehousing
Experience with Git and CI/CD pipelines
Preferred Skills:
Experience with Airflow
Knowledge of Kafka/Kinesis (streaming)
Familiarity with Docker & Kubernetes
Exposure to Delta Lake / Iceberg / Hudi