Senior Software Engineer (AI Platform & LLMOps)

Same platform, different brand. Your saved jobs and alerts as well as your log in details have moved with you. What Where Senior Software Engineer (AI Platform & LLMOps) Job Title: Senior Software Engineer (AI Platform & LLMOps) Job Duration: 6 months contract with a possibility to extend or to go perm! Schedule: Monday – Friday, 10:00 AM – 7:00 PM (No Overtime) The Role We are seeking a Senior Software Engineer to own our ACS embedded-evaluation workstream. You will embed with AI product teams to build the infrastructure, automated pipelines, and observability tools that ensure our LLM agents perform accurately, cost-effectively, and reliably at scale. AI Evaluation Infrastructure: Own and scale EvalsHub (backend, SDK, CLI, frontend). Build golden datasets, regression pipelines, and CI/CD model-release integration. Advanced Automation: Convert human review procedures into LLM-as-judge, multi-turn, trajectory, and deterministic evaluators to eliminate manual testing. Observability & Tracing: Instrument distributed agent systems using OpenTelemetry across Go/Python services and Temporal workflows to ensure flawless debugging data. Optimization: Run experiments across model architectures, RAG, and embeddings to balance accuracy, latency, and cloud costs. Enablement: Author technical docs, lead tool migrations, and participate in the LLMOps production operational rotation. Experience: Minimum 2+ years of relevant production experience. AI & Workflow Ecosystem: Hands-on with LangSmith, LangGraph/LangChain, FastAPI, or Temporal . AI Domain Expertise: Proven track record in LLM-as-judge frameworks, agent-trajectory analysis, RAG, semantic retrieval, or Text-to-SQL. Data & Core Tech: Strong analytical skills handling geospatial data . Proficiency in React/TypeScript (for developer tools), Grafana , and Redis . Soft Skills: Metrics-driven problem solver with excellent cross-functional communication skills. By sending us your personal dataandcurriculum vitae (CV), you are deemed to consent to Morgan Mckinley Pte Ltdandits affiliates to collect, useanddisclose your personal data for the purposes set out in the Privacy Policy available athttps://www.morganmckinley.com/sg/privacy-policy. You acknowledge that you have read, understood,andagree with the Privacy Policy. #J-18808-Ljbffr