SlipstreamJobs tracks this role from the company's public career site. Apply directly on the employer's site.
Preply is a unicorn edtech platform (Series D, $150M) that connects 100,000+ tutors teaching 90+ languages to learners in 180 countries. The company is integrating AI and GenAI into its core product strategy to enhance personalized learning experiences at scale.
The GenAI Platform team sits within Platform Engineering and builds shared infrastructure enabling product teams to develop, evaluate, deploy, and operate generative AI safely and efficiently. The platform encompasses a GenAI gateway, model and prompt lifecycle management, evaluation frameworks, observability, cost controls, and guardrails. The team collaborates closely with ML Platform (core ML workflows) and Agentic Platform (agent orchestration, state management, tool integration) to provide product teams with a consistent foundation for user-facing AI experiences and autonomous agents.
As a Senior ML Platform Engineer, you will design and build systems powering production GenAI workloads, driving expansion of the GenAI Platform and converting recurring engineering needs into reliable self-service capabilities. This is a hands-on senior role with broad technical influence—you will write production code, shape platform abstractions and operational standards, and partner across Applied Science, Data, Product, Security, and Engineering teams.
Key responsibilities include:
- Architect a unified gateway with automated routing, quota controls, and resilient fallback systems across model vendors
- Drive system efficiency and low latency through dynamic traffic management, response caching, token budgeting, and cost allocation controls
- Establish robust evaluation mechanisms to guarantee high precision, stability, and safety in model outputs
- Deliver system observability with deep tracing, performance telemetry, cost analytics, continuous monitoring, and alerting across GenAI lifecycles
- Standardize prompt engineering workflows with automated versioning, testing, governance, and CI/CD integrations for production delivery
- Embed platform guardrails alongside Security and Privacy experts to enforce policies and safe production defaults automatically
- Maintain sustainable incident response, blameless postmortems, and comprehensive monitoring for GenAI stacks
Preply offers a collaborative, dynamic culture; a generous monthly learning allowance on Preply.com, L&D budget, and self-development time; competitive financial package with equity, leave, and health insurance; relocation support to Barcelona; free mental health support; and Gympass wellness access throughout Spain.
REQUIREMENTS:
- 5+ years proven track record designing, building, and operating backend services or ML infrastructure handling production traffic
- Strong Python skills and experience building developer-facing APIs/SDKs or shared libraries
- Practical experience with GenAI systems, including vector retrieval, external provider APIs, and common issues
- AI Expertise: Forefront user of Agentic AI with hands-on experience influencing beyond code generation; ability to architect, apply business logic, ensure security, use AI as thought partner, and establish quality gates and safety nets; capacity to propose AI-native engineering alternatives
- Sound knowledge of distributed systems (high availability, concurrency, caching, rate limiting)
- Experience with at least one major public cloud and its services/infrastructure (preferably AWS)
- Hands-on experience with distributed tracing, system telemetry, SLOs, and incident triage
- Strong communication skills and C1 English level; willingness to join paid on-call rotation
NICE TO HAVE:
- Experience operating AI gateways or scalable model serving infrastructure
- Familiarity with evaluation suites, prompt management, vector databases, or customized GenAI observability tooling
- Experience with Metaflow, Databricks, or AWS SageMaker
- Knowledge of hosting open-source foundation models, optimizing GPU compute, dynamic scaling, and infrastructure cost controls
- Familiarity with agentic workflows, multi-agent frameworks, and tool-use patterns
