SlipstreamJobs tracks this role from the company's public career site. Apply directly on the employer's site.
Salary: EUR 6,500 - 9,000 / monthly
Cast AI's Kimchi is an AI platform enabling companies to run LLMs on their own Kubernetes clusters and providing managed inference capabilities. The platform supports multi-model inference (MiniMax, Kimi, GLM-5, Nemotron, DeepSeek) with intelligent routing, an OpenAI-compatible API, and flexible deployment options from Cast AI's GPUs to customer VPCs.
As a Senior Software Engineer on the API Platform Team, you will own the inference API responsible for delivering AI services globally while ensuring reliability and scalability. You'll also own the analytical platform, billing system, and role-based access controls that enable users—from solo developers to large enterprises—to monitor and control their usage. Your scope includes infrastructure, datastores, analytics, observability, and CI/CD pipelines.
Key responsibilities include:
- Developing with observability in mind, identifying bottlenecks, and optimizing for performance. When p99 latency increases, you diagnose root causes using query profiles and flame graphs rather than raising alert thresholds.
- Designing and maintaining the datastores and distributed systems behind the inference API, ensuring reliability as usage scales from individual developers to enterprise customers.
- Building billing, usage metering, and role-based controls that allow users to monitor and govern consumption, with particular attention to correctness—where errors directly impact customer trust.
You will own features end-to-end: design, implementation, testing, and production rollout. Most projects ship within 1–4 weeks. You'll work directly with product and other engineering teams on problems without textbook solutions, operating in a high-agency environment that minimizes process friction.
Requirements:
- Production experience with Go or TypeScript strongly preferred; candidates without either must demonstrate strong systems programming skills in a comparable language.
- Strong debugging, optimization, and performance-tuning skills, including query profiling, index design, and database performance tuning beyond ORM usage.
- Hands-on experience with cloud platforms (AWS, GCP, or Azure) and Kubernetes is a strong plus.
- Experience with observability tooling (Prometheus, Grafana, OpenTelemetry), CI/CD, and DevOps practices.
- Startup mindset: adaptable, proactive, and comfortable with ambiguity.
- Strong English skills, both verbal and written.
- Demonstrated ability to drive a complex project end-to-end.
