AWS Python Developer with Pyspark

Hello Folks,
Hope you are doing good!

Please find the below requirement and let me know your interest?
Title: Python Developer with AWS & Pyspark(It’s backfill Role)
Location: New Jersey
Mode of work: Hybrid
Visa:GC, GC EAD, USC, H4 EAD only
Looking for Local candidates only with 10+years of experience and final round interview will be In-person interview

Job Summary:
We are seeking an experienced Python Developer with strong expertise in AWS and PySpark to join our data engineering team. The ideal candidate will have hands-on experience developing scalable data pipelines, processing large data sets, and integrating with cloud-based environments. This role requires excellent problem-solving skills and a strong understanding of distributed data processing frameworks.Key Responsibilities:

• Design, develop, and maintain data pipelines and ETL workflows using Python, PySpark, and AWS services.
• Build and optimize large-scale data processing and data transformation solutions.
• Integrate various data sources and ensure data quality, performance, and reliability.
• Collaborate with data engineers, analysts, and architects to deliver end-to-end data solutions.
• Implement best practices for code optimization, error handling, and data validation.
• Participate in code reviews, documentation, and deployment automation.
• Ensure adherence to data security and compliance standards.

Required Skills & Qualifications:

• Bachelor’s degree in Computer Science, Data Engineering, or a related field.
• 10+ years of experience in software development with a strong focus on Python.
• Hands-on experience with PySpark for distributed data processing.
• Solid understanding of AWS cloud services such as S3, Glue, Lambda, EMR, Redshift, and Athena.
• Strong experience in ETL development and data pipeline orchestration.
• Familiarity with SQL and relational/non-relational databases.
• Excellent analytical, debugging, and communication skills.

Preferred Skills:

• Experience with Airflow, Databricks, or other workflow management tools.
• Knowledge of CI/CD pipelines and version control tools like Git.
• Exposure to data lake or data warehouse architectures.
• Familiarity with Docker or Kubernetes for deployment.

Thanks & Regards
Jagdish
Manager – IT Staffing
Email ID:

jagdish@polarits.com

 |  Phone: +1 443 489 4433
 

6095 Marshalee Dr, Suite 250, Elkridge, MD 21075
www.polarits.com          
Consulting | Technology | Development
Offices: Maryland | Georgia | India
 
Note: If you have received this message in error, please notify us immediately by reply e-mail so that we may correct our internal records. Please then delete the original message (including any attachments) in its entirety. Thank you