SlipstreamJobs tracks this role from the company's public career site. Apply directly on the employer's site.
Salary: USD 320,000 - 485,000 / annual
Anthropic is seeking a Staff or Senior Software Engineer to join the Cloud Inference team, which scales and optimizes Claude across AWS, GCP, Azure, and future cloud service providers. This is a high-leverage role that directly impacts multiple major revenue streams while optimizing compute efficiency—one of Anthropic's most precious resources.
You will design, build, and own backend services and infrastructure that serve Claude across multiple cloud platforms, accounting for differences in compute hardware, networking APIs, and operational models. Key responsibilities include:
- Design and own backend services and infrastructure serving Claude across multiple CSPs, navigating differences in compute hardware, networking, APIs, and operational models
- Work cross-functionally with internal inference, product API, systems, and security teams, as well as CSP partners, to stand up the full serving stack on new cloud platforms, resolve operational issues, and influence provider roadmaps
- Build and evolve CI/CD automation systems, including validation and deployment pipelines, that reliably ship new model versions to millions of users across cloud platforms without regressions
- Design interfaces and tooling abstractions across CSPs that enable cost-effective inference management, scale across providers, and reduce per-platform complexity
- Contribute to capacity planning, autoscaling, and workload routing strategies that match supply with demand and direct requests to the most cost-effective accelerator and region
- Analyze observability data across providers to identify performance bottlenecks, cost anomalies, and regressions, and drive remediation based on real-world production workloads
Your work will increase the scale at which services operate, accelerate the ability to reliably launch new frontier models and innovative features to customers across all platforms, and ensure LLMs meet rigorous safety, performance, and security standards.
ANTHROPIC CONTEXT
Anthropics mission is to create reliable, interpretable, and steerable AI systems. The company is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems. Anthropic is a public benefit corporation headquartered in San Francisco.
REQUIREMENTS
Minimum qualifications:
- Significant software engineering experience with a strong background in high-performance, large-scale distributed systems serving millions of users
- Experience building or operating services on at least one major cloud platform (AWS, GCP, or Azure), with exposure to Kubernetes, Infrastructure as Code, or container orchestration
- Curiosity about LLM serving; prior inference or ML experience is not required
- Ability to thrive in cross-functional collaboration with both internal teams and external partners
- Experience working with external partners to align goals and deliver impact
- Fast learner who can quickly ramp up on new technologies, hardware platforms, and provider ecosystems
- Highly autonomous with ability to take ownership of problems end-to-end, including work that falls outside job description
- Bachelor's degree or equivalent combination of education, training, and/or experience in a field relevant to the role
Preferred qualifications:
- Direct experience working with CSPs to scale infrastructure or products across multiple platforms, navigating differences in networking, security, privacy, billing, and managed service offerings
- Hands-on experience with capacity management, cost optimization, or resource planning at scale across heterogeneous environments
- Solid understanding of multi-region deployments, geographic routing, and global traffic management
- Proficiency in Python or Rust
