Position:Python spark developer
Location: Sunnyvale
Contracting: C2C
JD:
Technical Skills
- Strong experience in Python backend development (FastAPI preferred)
- Proven expertise in Spark (Scala or PySpark) for large-scale data processing
- Experience building data pipelines, ETL, and distributed processing systems
- Hands-on exposure to LLM/Agentic frameworks (LangGraph, Claude Code, or similar)
- Knowledge of API integration and schema transformation techniques
- Strong understanding of data validation, quality frameworks, and testing strategies
- Experience working on AWS-based data platforms
Preferred / Good to Have
- Experience with agentic AI systems, multi-step reasoning workflows, or code generation pipelines
- Exposure to spec-driven development or model-driven architecture
- Familiarity with large enterprise ecosystems and tools (data validation platforms, ingestion frameworks, etc.)
- Experience handling high-volume datasets (1M+ records)
- Knowledge of data onboarding, vendor integration, or marketplace data standardisation
Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.