Role: Observability and Evaluation Engineer
Location: Charlotte, North Carolina (Onsite)
Experienced : 12+ Years
Role Description:
Implements telemetry, traces, dashboards, evaluation suites, s, service objectives, runbooks, and readiness evidence for priority agent releases.
Job Description:
• LLM and agent evaluation.
• tracing and telemetry
• metrics and dashboards
• SLOs, ing
• test automation
• prompt and model performance analysis
• Python• production operations.