Location
Paternoster Square, London

Hours
Full Time

Salary
Negotiable

About the Role
As part of the LSEG AI team, you will own the strategy, design and rollout of telemetry systems that monitor, measure and analyse how AI models, MCPs, and AI-enabled features behave across all LSEG products. This role is responsible for defining how we collect, structure, analyse and act on AI-specific telemetry signals—including prompt patterns, model performance, MCP call usage, latency, error conditions, cost metrics, user behaviour signals, and system reliability. You will develop a telemetry foundation that supports AI governance and risk, model performance tracking, cost efficiency, user experience optimisation, operational reliability, auditability, and the long-term evolution of our AI platform.

Key Responsibilities & Accountabilities
Telemetry & Observability Strategy: Define the end-to-end telemetry vision and roadmap for LLMs, MCPs, vector stores, embeddings, inference layers and AI-powered user experiences. Establish a standardised telemetry schema for capturing prompts, tool calls, model responses, durations, errors, confidence signals, and quality indicators across business lines. Partner with platform engineering to ensure instrumentation is consistent, scalable and compliant.
Signal Design & Data Architecture: Identify key signals for quality and reliability, latency and throughput, cost tracking and optimisation, MCP usage patterns, user workflow insights, failure pattern detection, and guardrail and safety event monitoring. Define retention rules, PII considerations, anonymisation and usage policies in partnership with AI Governance and Compliance.
Platform & Tooling: Own requirements for dashboards, monitoring tools, model comparison views, anomaly detection alerts, and performance scorecards. Design systems that allow product and engineering teams to self-serve insights about AI model behaviour and MCP interactions. Partner with engineering to build pipelines that support real-time and batch analytics.
Cross-Functional Collaboration: Collaborate with product owners across LSEG to instrument their AI features consistently. Partner with AI Evaluation PM, Model Risk, GSSR, Legal and Compliance to align telemetry with governance frameworks. Work closely with Engineering and SRE teams to drive observability improvements and reliability engineering for AI systems.
Optimisation & Insights: Identify cost inefficiencies across model and MCP usage, and drive recommendations to improve ROI. Surface workflow-level insights on how customers use AI features—informing product roadmaps. Partner with product leaders across divisions to understand how telemetry can improve customer experience, reliability and performance.
Governance & Standards: Define and maintain AI telemetry standards and best practices across all LSEG divisions. Contribute to LSEG’s AI governance and Responsible AI initiatives by providing data-driven insights on model behaviour and user impact. Ensure telemetry systems support auditability, compliance and explainability requirements.

Experience
Proven product management experience with a strong foundation in observability, telemetry, data platforms, monitoring, or SRE/DevOps-driven products. Deep understanding of LLMs, embeddings, vector search, MCP tools, and AI inference workflows. Familiarity with logging, tracing, metrics, and event-based telemetry systems. Experience defining data schemas, signal taxonomies, aggregation strategies and data contracts. Strong analytical skills with the ability to derive insights from large-scale system telemetry. Experience working with senior engineering, data science, risk and governance stakeholders.
Preferred experience includes exposure to financial data, analytics systems and enterprise-scale data workflows, familiarity with BI tools, metrics stores, distributed tracing and monitoring stacks, and understanding of cloud infrastructure, serverless runtimes, API gateways and model hosting architectures. Ability to drive cross-functional alignment and establish group-wide standards.

About you
You are a strategic thinker with excellent communication skills and the ability to collaborate across diverse teams. You have a passion for AI technology and observability, with a strong focus on governance, compliance and responsible AI. You thrive in a dynamic environment and are motivated to deliver impactful telemetry solutions that improve product reliability, cost efficiency and user experience.

Qualifications
Relevant qualifications in product management, data science, engineering or related fields are desirable but not mandatory. A strong track record of delivering telemetry or observability products in complex environments is essential.