Be Structured Technology Group
Symphony Solutions
Observability and Evaluation Engineer
Python
About the opportunity
Role: Observability and Evaluation Engineer
Role Description
Job Description
Location: Charlotte, North Carolina (Onsite)
Minimum requirements
Experienced : 12+ Years
Implements telemetry, traces, dashboards, evaluation suites, s, service objectives, runbooks, and readiness evidence for priority agent releases.
- LLM and agent evaluation.
- tracing and telemetry
- metrics and dashboards
- SLOs, ing
- test automation
- prompt and model performance analysis
- Python• production operations.
