IT - Lead Consultant | Analytics - Packages | Python - Big Data

Job Title: Lead Consultant | Analytics - Packages | Python - Big Data
Work Location: New YorkNY10004
Vendor Rate: 68.40
Contract duration: 12
Target Start Date: 28 Sep 2026
Does this position require Visa independent candidates only? Yes
** Hybrid (3 days in a week from client office)**

Job Details:

Must Have Skills
Gen AI, AI/ML, RAG, LangChain, Python, Spark, Snowflake

Nice to have skills
Azure

Detailed Job Description
Design and develop scalable AI-powered data platforms and agentic AI solutions that enable autonomous decision-making, intelligent workflow orchestration, and business process automation.
Build and maintain data engineering pipelines using Python, Spark, Databricks, Snowflake, SQL, and cloud-native technologies to support AI/ML, GenAI, and analytics workloads.
Architect and implement multi-agent AI systems with capabilities such as goal decomposition, task planning, reasoning, memory management, self-reflection, tool utilization, and autonomous execution.
Develop and optimize Retrieval-Augmented Generation (RAG) solutions, including document ingestion, chunking, embedding generation, vector database integration, retrieval optimization, and response grounding.
Integrate AI agents with enterprise systems, APIs, databases, knowledge repositories, CI/CD pipelines, and event-driven architectures to create end-to-end intelligent automation frameworks.
Design and implement data governance, security, guardrails, monitoring, and compliance controls to ensure responsible AI adoption and protection of enterprise data assets.
Build reusable AI engineering components using modern frameworks such as LangChain, LangGraph, Semantic Kernel, MCP-based architectures, and agent orchestration platforms.
Evaluate and improve AI system performance through prompt engineering, agent testing frameworks, model benchmarking, retrieval accuracy analysis, latency optimization, and continuous feedback loops.
Collaborate with architects, data scientists, application teams, and business stakeholders to translate complex business requirements into scalable AI-driven data solutions and production-ready platforms.
Provide technical leadership and mentorship by driving AI engineering best practices, conducting architecture reviews, developing reusable accelerators, and enabling engineering teams to leverage AI-assisted software development and agentic SDLC methodologies.
Skills:

Python, PySpark, SQL, Databricks, Snowflake
GenAI, Agentic AI, MCP Architecture, RAG
LangChain, LangGraph, Semantic Kernel

Minimum years of experience
>10 years

Certifications Needed :No

Top 3 responsibilities you would expect the Subcon to shoulder and execute
Coding
Testing
Deployment

Interview Process (Is face to face required?): As per client preference

Any additional information you would like to share about the project specs/ nature of work

Project Code: MORGAN STANLEY SERVICES GROUP INC