Posted 22 July, 2026
Senior Data Science Engineer - Eval Pipelines & LLM Prompts
Jobtailor
Auckland, AUK, NZ
Full Time
Reference: 5264afda55a14c0a
Job Description
Jobtailor seeks a Python-driven data professional to build and maintain evaluation datasets and tooling, ensuring robust ground-truth quality and scalable label systems. You will own prompt optimization from selection to deployment, while diagnosing issues between offline evals and production accuracy across multiple AI products. Ideal candidates know Python (pandas, NumPy), SQL, and data science foundations for LLM accuracy, plus hands-on experience with Braintrust or Langfuse for evaluation #J-18808-Ljbffr