SlipstreamJobs tracks this role from the company's public career site. Apply directly on the employer's site.
Mirantis is seeking a Senior Software Engineer to design and build LLM serving infrastructure on Kubernetes. You will own the full stack of deployment, GPU scheduling, scaling, and model lifecycle management for production AI workloads.
Key responsibilities include:
- Design and build LLM serving infrastructure on Kubernetes, handling deployment, GPU scheduling, scaling, and model lifecycle management
- Package the platform for enterprise environments using Helm-based installs, upgrades, and support for restricted/offline networks
- Integrate the serving layer with the platform's API gateway, identity, and metering services
- Build observability and monitoring for operating GPU inference in production, including serving metrics and GPU telemetry
- Contribute across a multi-service codebase and help set engineering direction through design documents and code reviews
This is a remote-first role on a small team that values written communication and high autonomy. You'll work with an established Silicon Valley leader in cloud infrastructure, collaborating with talented engineers serving Fortune 500 and Global 2000 customers on next-generation cloud technologies.
Requirements:
- 5+ years of software engineering experience in infrastructure, platform, or distributed systems
- Deep hands-on Kubernetes experience: building and operating production workloads and Helm charts (not just consuming managed clusters)
- Experience with GPU workloads or LLM inference, OR strong adjacent systems experience with a demonstrated track record of learning quickly
- Strong Go programming skills; solid CI/CD and infrastructure-as-code skills
- Fluency with AI-assisted development tools (Claude Code, OpenAI Codex) as part of your daily engineering workflow
- Comfortable with high autonomy on a small, remote-first, written-culture team
Nice to have:
- Inference performance work (quantization, batching, caching) or distributed serving frameworks
- Enterprise deployment experience (air-gapped installs, SSO/OIDC, supply-chain security)
- UI development experience (React/TypeScript)
- Open-source contributions in Kubernetes or ML-infrastructure ecosystems
