SlipstreamJobs tracks this role from the company's public career site. Apply directly on the employer's site.
Anyscale is commercializing Ray, an open-source distributed computing framework used by OpenAI, Uber, Spotify, Instacart, and Cruise to scale AI applications. The company has raised $250+ million from top-tier VCs including Andreessen Horowitz and NEA.
You will join the ML Developer Experience (MLDevX) team, which owns the user-facing layer of the Anyscale platform. This includes the CLI, SDKs, APIs, UI, Workspaces, MCP, and integrations that allow developers and data scientists to scale ML applications from laptop to cluster without needing distributed systems expertise.
As a Senior Software Engineer, you will have end-to-end ownership of high-impact projects spanning the full AI workload lifecycle: data preparation, fine-tuning, serving, evaluation, and iteration. You'll work across the stack from developer tooling to cloud infrastructure and the Ray runtime, building systems that are scalable, resilient, and intuitive for both human developers and coding agents.
Key responsibilities include: designing next-generation developer tooling and MLOps capabilities; building agent-first CLI and cohesive SDK/API/MCP surfaces with self-discovery and structured errors; improving the Anyscale Workspaces stack for local-to-distributed execution; creating frameworks for the AI development lifecycle including experiment tracking and lineage; building paths from trained models to production endpoints; surfacing observability across all interfaces; designing open integrations using standards like OpenAI-compatible APIs and OpenTelemetry; operating highly available backend services; and working closely with users and field teams to scope, ship, and iterate.
You will work directly with users, field teams, and distributed systems experts to identify high-leverage problems and shape both product and technical design. Strong product judgment, deep understanding of developer needs, and technical depth to build quality software for users ranging from Ray newcomers to AI-native enterprises are essential.
About Anyscale
AI / Data / Infrastructure — distributed computing and AI workload platform built around Ray.
