All jobs → Partner boards

Senior Data Analyst

RightsLine • El Segundo, CA, US • published 2026-09-29 08:55:30.858642

Description

Reporting to the SVP Engineering, the Senior Data Analyst – LLMOps will work with the Application Development team to own the observability, evaluation, and quality measurement of Rightsline’s LLM\-powered features. This is a senior individual\-contributor role in which you will instrument the LLM stack end to end — traces, prompts, tool calls, latency, token spend, and output quality — build the evaluation suites that tell us whether a change made the product better or worse, and turn that telemetry into decisions the engineering and product teams act on. You will work across a SaaS application, a wide range of third\-party tools, an AWS\-hosted infrastructure, and an increasingly agentic development workflow. The position is based in North America, has no direct reports, and partners closely with the wider engineering, product, and data teams. **Mission \& Impact** --------------------- The Senior Data Analyst – LLMOps makes the behavior of Rightsline’s AI features measurable. Quality questions about prompts, retrieval, and agent workflows are too often answered with intuition and spot checks; you will replace that with tracing, offline and online evaluations, regression suites, ...

Get jobs like this daily in Telegram: @careeri_bot