SlipstreamJobs tracks this role from the company's public career site. Apply directly on the employer's site.
Salary: USD 216,000 - 324,000 / annual
Klaviyo is seeking a Senior Software Engineer to architect and scale the Core Orchestration platform, a high-traffic, low-latency service supporting over 200,000 customers and billions of consumer profiles. This role sits at the intersection of distributed systems infrastructure and AI-native engineering, driving foundational investments in Marketing AI and Service AI to power next-generation agentic capabilities across the platform.
You will architect Klaviyo's orchestration infrastructure to handle massive scale while maintaining Tier-1 availability and low-latency performance. You'll drive the technical vision for integrating AI-driven agentic workflows and automated decision-making into core customer interactions, lead adoption of AI-native software development practices across the team, and design foundational frameworks and services adopted company-wide. You'll partner closely with product management, data science, design, and executive leadership to shape strategic roadmaps and long-term platform architecture.
The role balances strict reliability and scalability requirements with rapid agility. You'll mentor engineers through design reviews and technical leadership, champion high standards, and translate between customer needs, product goals, and technical constraints. The team operates from the Boston hub with regular in-office collaboration expected.
KLAVIYO CONTEXT
Klaviyo empowers creators and e-commerce businesses to own their destiny by making first-party data accessible and actionable. The company has built infrastructure and applications connecting 200,000+ customers with billions of consumer profiles and hundreds of billions of interaction events. The Orchestrate pillar drives the core platform experience, providing high-throughput capabilities for complex marketing workflows.
REQUIREMENTS
- 8+ years of professional software engineering experience centered on distributed systems, microservices architecture, and high-availability backend platform ownership
- Hands-on experience shipping production LLM workflows, retrieval-augmented generation (RAG) pipelines, or agentic frameworks with solid understanding of evals, prompt architecture, and fine-tuning
- Proven track record architecting event-driven architectures, asynchronous processing pipelines, and message queues (Kafka, Celery, SQS, Redis) for heavy throughput workloads
- Deep proficiency in Python and modern frameworks (FastAPI, Django) with experience in data processing platforms and object-relational mapping tools
- Strong expertise with AWS, Kubernetes, CI/CD automation, and modern observability suites
- Experience establishing automated evaluation frameworks for AI models, balancing latency, accuracy, cost, and safety in production environments
- Technical leadership ability to elevate team performance through architectural direction, collaborative problem-solving, and clear communication across engineering and business domains
- Comfortable collaborating directly with PMs, ML engineers, and customers; ability to translate between customer needs, product goals, and technical constraints
- Active use of AI coding tools and modern agentic development workflows in daily work
NICE TO HAVES
- Experience designing or integrating shared AI/ML platforms consumed by multiple internal engineering teams
- Domain expertise in MarTech, e-commerce platforms, personalization engines, or real-time event streaming
