All jobs → Partner boards
Machine Learning Engineer – LLM Evaluations (Evals)
None • New York, NY, US • published 2026-11-17 02:37:47.009379
Apply on source siteDescription
**Job Title:** Machine Learning Engineer – LLM Evaluations (Evals) **Location:** New York, NY (On\-site – 5 days/week) **Compensation:** $220,000 – $300,000/year \+ Competitive Equity **Employment Type:** Full\-Time **Work Authorization:** U.S. Citizens or Green Card holders only (visa sponsorship is not available) **About the Opportunity** We are partnering with a well\-funded, research\-driven AI startup in New York City building the memory and identity layer for autonomous agents. We are looking for a **Machine Learning Engineer (Evals)** to own our end\-to\-end evaluation infrastructure from the ground up. In a complex multi\-agent environment with black\-box behavior, standard benchmarks aren't enough. You will define what "better" looks like for dynamic entity representations that evolve over time—without relying on pre\-existing ground truth—and build the scalable machinery to measure, test, and improve them. If you thrive on designing evaluation frameworks from scratch, digging into execution traces to uncover root causes, and shipping fixes directly, this role is built for you. **Key Responsibilities** * **Design Novel Evaluations:** Define scoring metrics and establish wh...
📬 Get jobs like this delivered daily
Get jobs like this daily in Telegram: @careeri_bot