Skip to main content
Posted 22 July, 2026

Senior Data Science Engineer - Eval Pipelines & LLM Prompts

Jobtailor
Auckland, AUK, NZ Full Time
Reference: 5264afda55a14c0a

Job Description

Jobtailor seeks a Python-driven data professional to build and maintain evaluation datasets and tooling, ensuring robust ground-truth quality and scalable label systems. You will own prompt optimization from selection to deployment, while diagnosing issues between offline evals and production accuracy across multiple AI products. Ideal candidates know Python (pandas, NumPy), SQL, and data science foundations for LLM accuracy, plus hands-on experience with Braintrust or Langfuse for evaluation #J-18808-Ljbffr

Sign up for Job Alerts