Highlights
LLM and agent evaluation; tracing and telemetry; metrics and dashboards; ing; SLOs; test automation; prompt and model performance analysis; Python; production operations. Job Description: Implements telemetry, traces, dashboards, evaluation suites, s, service objectives, runbooks, and readiness evidence for priority agent releases.
Numbers & Facts
| Location | Charlotte, NC |
| Industry | Computer/IT Services |
| Salary | $55–$60 Per Hour |
| Company Size | 500 to 999 employees |
| Website | https://www.apolisrises.com/ |
Description
Job Title: Overwatch Observability and Evaluation Engineer
Location: Concord, CA
Job Description:
Implements telemetry, traces, dashboards, evaluation suites, s, service objectives, runbooks, and readiness evidence for priority agent releases.
LLM and agent evaluation; tracing and telemetry; metrics and dashboards; ing; SLOs; test automation; prompt and model performance analysis; Python; production operations.
Location: Concord, CA
Job Description:
Implements telemetry, traces, dashboards, evaluation suites, s, service objectives, runbooks, and readiness evidence for priority agent releases.
LLM and agent evaluation; tracing and telemetry; metrics and dashboards; ing; SLOs; test automation; prompt and model performance analysis; Python; production operations.
Benefits
Paid Sick Days, Employee Referral Program, Employee Events, Retirement / Pension Plans
About Company
Since 1996, RJT has provided successful SAP, Oracle, and IT consulting solutions and staffing services to clients around the world. The new Apolis brings you the same personalized service fortified with a greater array of IT solutions, global expertise, and cost-management strategies.
We are a global IT consultancy that seamlessly integrates experts and leading-edge solutions into your organization so you can focus on what really matters.