Job Title : Senior Generative AI (GenAI) Developer
Location: Quincy, MA- Onsite
Job Summary
We are seeking an experienced Senior Generative AI Developer to join the State Street technology team in Quincy, MA. The ideal candidate will have strong hands-on experience in Generative AI, Large Language Models (LLMs), Python programming, OpenAI, and enterprise AI application development.
The candidate will be responsible for designing, developing, and deploying AI-powered applications using LLMs, Retrieval-Augmented Generation (RAG), prompt engineering, vector databases, and cloud-based AI services.
Experience integrating GenAI solutions with enterprise applications, developing REST APIs using Python/FastAPI, and deploying scalable AI applications on AWS is highly desirable.
Key Responsibilities
- Design, develop, and implement Generative AI-powered applications using OpenAI and Large Language Models (LLMs).
- Build and deploy enterprise AI solutions using GPT models, Azure OpenAI, or AWS Bedrock.
- Develop RAG-based applications using vector databases and embedding models.
- Implement prompt engineering techniques to improve LLM accuracy, relevance, and response quality.
- Develop backend services and REST APIs using Python, FastAPI, and Flask.
- Integrate LLMs with enterprise applications, databases, and external APIs.
- Build intelligent chatbots, conversational AI applications, and AI-powered automation solutions.
- Work with vector databases such as Pinecone, FAISS, ChromaDB, and Weaviate.
- Implement document processing, text extraction, semantic search, and knowledge retrieval solutions.
- Develop AI workflows using LangChain, LangGraph, and LlamaIndex.
- Integrate GenAI applications with AWS services such as Lambda, S3, Bedrock, and API Gateway.
- Implement security, authentication, data privacy, and responsible AI practices.
- Optimize LLM performance, response time, token consumption, and application scalability.
- Collaborate with data scientists, software engineers, architects, and business stakeholders.
- Perform testing, debugging, monitoring, and production support for AI-based applications.
Preferred Qualifications
- Experience developing enterprise GenAI applications in banking or financial services.
- Knowledge of financial services, investment management, banking operations, and financial data.
- Experience implementing RAG pipelines and enterprise knowledge assistants.
- Experience with multi-agent AI systems and agentic workflows.
- Knowledge of AI evaluation, hallucination reduction, guardrails, and responsible AI.
- Experience with AWS Bedrock and enterprise cloud AI architecture.
- Understanding of microservices architecture and distributed systems.
- Experience integrating AI applications with enterprise data sources and APIs.
Required Qualifications
- 8+ years of overall software development experience.
- Strong hands-on experience in Python programming.
- Practical experience building Generative AI applications using OpenAI or other LLM platforms.
- Strong understanding of RAG architecture, embeddings, and vector databases.
- Experience with LangChain, LangGraph, or LlamaIndex.
- Experience developing APIs using FastAPI or Flask.
- Knowledge of AWS or Azure cloud services.
- Strong understanding of REST APIs, databases, and application integration.
- Excellent problem-solving and communication skills