Job Overview:
We are seeking a skilled professional with strong expertise in SQL, Python, Spark, and leading AI/ML frameworks to design and build scalable, intelligent data solutions. The ideal candidate will have hands-on experience with big data platforms and distributed data processing.
Key Responsibilities:
Extensive experience in SQL and databases
Develop and optimize scalable data pipelines using Apache Spark
Build and deploy AI/ML models leveraging modern frameworks
Work with large datasets using platforms like Delta Lake and other big data technologies
Manage and integrate multiple databases for efficient data processing
Collaborate with cross-functional teams to deliver data-driven solutions
Required Skills:
Strong proficiency in SQL and Spark
Experience with AI/ML frameworks (e.g., TensorFlow, PyTorch, or similar)
Hands-on experience with big data platforms such as Delta Lake
Solid understanding of distributed data processing and database management