SlipstreamJobs tracks this role from the company's public career site. Apply directly on the employer's site.
Cohere is building the next generation of agentic AI infrastructure, creating a platform that powers autonomous AI agents at scale. This role sits at the intersection of ML systems, distributed infrastructure, and developer experience.
You will work on hard, forward-looking problems with few established patterns, including secure code execution, agent state management, model routing, identity and authentication, and resource management for long-running agent workflows. This is a strong fit for someone who combines systems depth with ML intuition, is comfortable building reliable infrastructure, thinks through distributed systems tradeoffs, and understands how emerging agentic capabilities shape platform design.
Key responsibilities:
- Turn emerging ML research ideas into production-ready infrastructure
- Build core platform capabilities for execution, storage, and state management
- Prototype and evaluate new technologies, then help decide what should move into production
- Partner with research teams to shape infrastructure based on what future agent systems will need
- Design and implement secure execution environments for agent-generated code
- Develop identity, authentication, and trust boundaries for agents
- Build model routing and orchestration across different model types and environments
- Implement rate limiting, quotas, and resource management for agent workflows
- Design state management, memory, and filesystem abstractions for agents
Cohere is a global technology company headquartered in Toronto with offices in London, New York City, San Francisco, Montreal, Paris, Berlin, and Seoul. The company is remote-friendly with a co-working benefit for those not near an office, plus a $500 home office stipend.
QUALIFICATIONS:
Required:
- Experience building production ML infrastructure with strong systems fundamentals
- Hands-on work with agentic systems, multi-agent workflows, or agent development frameworks
- Familiarity with model routing and LLM provider frameworks across different model types and environments
- Experience with scalable, fault-tolerant distributed systems and Kubernetes
- Track record of moving quickly on prototypes and making good decisions about productionization
Bonus:
- Experience across on-prem, private cloud, and public cloud environments
- Familiarity with storage systems, embedded databases, or filesystem abstractions
- Experience with code execution sandboxes such as gVisor, Firecracker, Kata, or WASM runtimes
- Interest in emerging ML infrastructure, edge inference, or browser-native models
- Open-source contributions to LLM or agent infrastructure projects
- Experience with identity, workload auth, or capability-based security systems
About Cohere
AI / Data / Infrastructure — enterprise generative AI models and tooling for businesses.
