AI Systems Engineer

Description:
Diversified Systems is searching for an AI Systems Engineer to design, build, and operate production-grade agentic AI systems. The successful candidate will develop multi-agent orchestration workflows, retrieval-augmented generation (RAG) pipelines, and natural-language interfaces to enterprise data sources, and will own these systems through deployment, monitoring, and ongoing optimization.

This is a hands-on engineering role requiring equal strength in applied AI development and distributed systems engineering. The candidate will work closely with data engineering, security, and product teams to deliver AI capabilities that meet enterprise standards for reliability, security, observability, and cost efficiency.

Responsibilities:

• Design, develop, and deploy agentic AI systems in Python using LangGraph and LangChain, including supervisor and sub-agent architectures, tool routing, and human-in-the-loop workflows.
• Implement agent memory and context management strategies, including conversational state, long-term semantic memory, summarization, and context-window optimization.
• Integrate AI agents with internal and third-party systems using the Model Context Protocol (MCP) and Agent-to-Agent (A2A) protocols.
• Build and optimize RAG pipelines end to end, covering document ingestion, chunking, embedding, hybrid and semantic retrieval, re-ranking, and access-control-aware filtering.
• Develop text-to-SQL and natural-language analytics capabilities over large relational schemas, including semantic catalogs, query validation, and execution guardrails.
• Design and implement scalable backend services and microservices in FastAPI, including RESTful API design, request validation with Pydantic, dependency injection, authentication and authorization, API versioning, and rate limiting.
• Build real-time streaming interfaces using WebSockets and Server-Sent Events to support token-level LLM response streaming and long-running agent executions.
• Model, provision, and optimize application data stores, including relational databases such as PostgreSQL, vector databases for embedding storage and similarity search, document stores such as MongoDB, and caching layers such as Redis.
• Own database lifecycle work including schema migrations, ORM usage, connection pooling, transaction management, and query performance tuning under production load.
• Containerize applications with Docker and deploy to Kubernetes, managing autoscaling, resource allocation, secrets, and progressive rollout strategies.
• Implement and maintain LLM gateway and routing infrastructure, including multi-provider failover, rate limiting, budget enforcement, and usage attribution.
• Establish observability and evaluation practices for non-deterministic systems, including distributed tracing, structured logging, automated evaluations, and cost and latency monitoring.
• Develop and maintain prompt engineering practices, including prompt versioning, regression testing, structured output enforcement, and mitigation of hallucination and prompt-injection risks.
• Diagnose and resolve production incidents across the full stack, and contribute to runbooks, design documentation, and post-incident reviews.
• Collaborate with product, data engineering, and business stakeholders to translate requirements into technical designs, and participate in architecture reviews.
• Follow engineering best practices in code review, automated testing, version control, and CI/CD, and contribute to team technical standards.

Preferred Qualifications:

• Experience implementing MCP servers or clients, or A2A-based agent interoperability highly desired.
• Familiarity with evaluation frameworks for agentic systems, such as LangSmith or Ragas highly desired.
• Experience with workflow orchestration platforms such as Prefect, Temporal, Airflow, or Dagster highly desired.
• Familiarity with enterprise identity and access management, including Okta, Microsoft Entra ID, SSO, SCIM, and OAuth 2.0 highly desired.
• Experience with document processing and ingestion at scale, including OCR, parsing of unstructured formats, and multimodal inputs highly desired.
• Experience mentoring engineers or leading technical design for a delivery team highly desired.

About Diversified Systems
Founded in 1990, Diversified Systems is an award-winning Technology Services corporation providing all levels of IT project consulting services nationwide. DSI is headquartered in Columbus, Ohio with regional offices in the American Midwest and East Coast. We offer our consultants a number of flexible and competitive compensation benefit packages.

Diversified Systems is committed to the principles of equal employment. We are committed to complying with all federal, state, and local laws providing equal employment opportunities, and all other employment laws and regulations.

Diversity, Equity and Inclusion
DSI values authenticity and is committed to making sure our employees and partners are valued and respected. At DSI, we believe building a diverse culture is important because we know when people work together, we can achieve better results as a team. DSI realizes that everyone comes from various backgrounds. We celebrate these differences because our employees are our greatest asset as we strive to best meet the needs of those we serve. As part of our ongoing efforts, DSI is focused on advancing equality, diversity, and inclusion by setting high standards to continually evolve our culture. This includes but is not limited to recruiting, community involvement, client delivery, and career development.