Position Overview
We are seeking a
Staff IT AI Implementation Engineer to lead the architecture, deployment, and operational oversight of our enterprise AI ecosystem. Sitting at the intersection of hands-on technical execution and strategic governance, this role is pivotal in building production-ready AI solutions, automating cross-functional workflows, and shaping responsible AI adoption standards across the organization.
The ideal candidate thrives on delivering scalable AI integrations while acting as a trusted advisor to help business units understand, deploy, and maximize the value of artificial intelligence securely. This position is for
local candidates only (CA - Milpitas / San Jose area) who can report in person. Remote or out-of-area candidates will not be considered
Core Responsibilities
- AI Platform Administration: Manage enterprise AI platforms (including frontier LLMs like Claude Enterprise and ChatGPT Enterprise), ensuring secure access controls and seamless coordination with IT infrastructure.
- Workflow Automation & Agent Development: Design, build, deploy, and maintain custom AI agents and automated workflows to solve business challenges while adhering to IT security standards.
- Cross-Functional Advisory: Serve as the primary point of contact for AI requests across all business units. Partner with stakeholders to assess feasibility, scope technical requirements, and deliver production-ready implementations.
- Governance & Security Compliance: Collaborate with IT Security and leadership to establish, implement, and enforce AI governance frameworks and acceptable use policies.
- Vendor & Tool Evaluation: Review and vet emerging AI tools, services, and platform releases alongside IT Security to provide recommendations for adoption or integration.
- Enablement & Training: Develop cross-departmental guidance, best practices, and training programs to support safe, compliant, and effective AI usage.
- Performance & Cost Optimization: Track platform usage metrics, monitor cost allocations, and present operational insights and optimization strategies to leadership.
- Security Reviews: Ensure all agents, MCP servers, integrations, and data connections undergo rigorous IT Security review before deployment, upholding principles of least-privilege access.
Key Qualifications
- Experience: 3+ years of experience in software engineering, data science, ML engineering, or applied AI (or 2+ years specialized in building production LLM applications).
- AI Model Integration: 1–3 years of hands-on experience working with frontier AI services, LLMs, or agent development.
- Agent Architecture: Proven ability to build AI agents utilizing tool/function calling, API integrations, and Model Context Protocol (MCP) frameworks.
- RAG Pipelines: Technical proficiency in Retrieval-Augmented Generation (RAG) architecture, including embeddings, vector databases, chunking strategies, and retrieval evaluation.
- LLM Evaluation: Hands-on experience evaluating LLM performance using test sets, LLM-as-judge frameworks, and prompt regression testing.
- Prompt & Context Engineering: Advanced expertise in production-grade prompt engineering and context optimization.
- AI Security Standards: Strong knowledge of AI-specific security threats (e.g., prompt injection, data leakage, PII handling) and familiarity with the OWASP Top 10 for LLMs.
- Deployment & Managed Services: Experience containerizing AI applications, managing self-hosted/served models, and utilizing cloud AI services (e.g., AWS Bedrock, Azure OpenAI/AI Foundry, Google Vertex AI).
- Governance Frameworks: Familiarity with responsible-AI practices and governance models (such as NIST AI RMF or ISO/IEC 42001).
- Communication & Collaboration: Demonstrated track record of collaborating across business units and translating complex technical concepts for non-technical stakeholders.
Preferred Qualifications
- Certifications:
- Anthropic Claude Certified Associate / Developer
- AWS Certified AI Practitioner or AWS Certified Generative AI Developer
- Microsoft Azure AI Fundamentals
- CompTIA AI+ or equivalent vendor-neutral credential
- Frameworks & Orchestration: Experience with agent orchestration tools (e.g., LangChain, LangGraph, AutoGen).
- Observability: Experience using LLM observability and cost-tracking platforms (e.g., LangSmith).
- Automation Platforms: Familiarity with workflow automation tools (e.g., Power Automate, n8n, Zapier).
- Model Customization: Hands-on experience with fine-tuning or local deployment frameworks (e.g., Ollama, OpenWebUI).
Company Culture & Benefits
We foster a collaborative, innovative culture centered on continuous growth, cross-functional mentorship, and transformative technology.
We offer a comprehensive benefits package designed to support full employee well-being, including:
- Competitive medical, dental, and vision health coverage
- Retirement savings plans with employer matching
- Short-term and long-term disability protection
- Paid time off, holidays, and parental leave programs
- Wellness programs and dedicated professional development initiatives