Symphony Solutions

Observability and Evaluation Engineer

Python

About the opportunity

Role: Observability and Evaluation Engineer

Role Description

Job Description

Location: Charlotte, North Carolina (Onsite)

Minimum requirements

Experienced : 12+ Years

Implements telemetry, traces, dashboards, evaluation suites, s, service objectives, runbooks, and readiness evidence for priority agent releases.

  1. LLM and agent evaluation.
  1. tracing and telemetry
  1. metrics and dashboards
  1. SLOs, ing
  1. test automation
  1. prompt and model performance analysis
  1. Python• production operations.

More opportunities with one profile

Want to be considered for more roles without repeating the whole process? Create your profile and be found by companies using Nort.

Create my profile

Show your skills.Get discovered.

Nort

Reverse recruiting platform for developers

LegalTerms of UsePrivacy Policynortjobs © 2026