Sign upLog in

Python PySpark Developer - Willington, DE

Georgia Tek Systems

Willington, DE

Apply
JOB DETAILS
SKILLS
Algorithms, Amazon Web Services (AWS), Analysis Skills, Apache Hadoop, Apache Hive, Apache Spark, Automation, Big Data, Cloud Computing, Communication Skills, Computer Science, Continuous Improvement, Data Analysis, Data Management, Data Processing, Data Quality, Data Science, Data Sets, Detail Oriented, Documentation, Ecosystems, GCP (Good Clinical Practices), HDFS (Hadoop Distributed File System), Identify Issues, Industry/Trade Analysis, Information Technology & Information Systems, Microsoft Windows Azure, Performance Management, Problem Solving Skills, Process Capability, Python Programming/Scripting Language, Relational Databases (RDBMS), SQL (Structured Query Language), Software Engineering, Team Player
LOCATION
Willington, DE
POSTED
2 days ago
Python PySpark Developer
Location: Willington, DE
Job Type: Contract
No third party C2C
Key Responsibilities:
  • Develop, implement, and optimize large-scale data processing pipelines using Python and PySpark.
  • Collaborate with data scientists, data engineers, and other stakeholders to design and enhance data solutions.
  • Perform data analysis and develop algorithms to process and analyze large datasets efficiently.
  • Maintain and improve existing PySpark codebase, ensuring high performance and scalability.
  • Integrate data from various sources, ensuring data quality and consistency.
  • Write and maintain comprehensive documentation for data processing workflows and algorithms.
  • Troubleshoot and resolve issues related to data processing and workflow automation.
  • Stay updated with the latest industry trends and technologies to continuously improve our data processing capabilities.
Qualifications:
  • Bachelor's or Master's degree in Computer Science, Information Technology, or related field.
  • Proven experience as a Python developer, with a strong focus on PySpark.
  • In-depth knowledge of Spark architecture and the Hadoop ecosystem.
  • Experience with big data technologies such as Hive, HDFS, and Kafka is a plus.
  • Strong SQL skills and experience with relational databases.
  • Proficient in writing efficient, scalable, and maintainable code.
  • Experience with cloud platforms (AWS, Azure, GCP) is highly desirable.
  • Excellent problem-solving skills and attention to detail.
  • Strong communication and teamwork abilities.

About the Company

G

Georgia Tek Systems