SlipstreamJobs tracks this role from the company's public career site. Apply directly on the employer's site.
LlamaIndex is seeking a Member of Technical Staff for Infrastructure to join the Infra team in San Francisco. This role focuses on designing, building, and scaling core infrastructure that powers a high-volume data platform for AI applications.
Key responsibilities include collaborating with engineering teams to build foundational systems that empower developers; designing and implementing scalable infrastructure solutions for SaaS, single-tenant, and private deployments; managing and optimizing cloud resources and Kubernetes clusters for cost-effectiveness and performance; enabling customer deployment success through clear infrastructure boundaries; optimizing release and deployment processes; ensuring compliance and security across deployment environments; and building production infrastructure for LLM applications including model integrations, inference workloads, evaluation pipelines, observability, and agentic workflows.
Required qualifications: 8+ years of engineering experience; hands-on work on Platform or Infrastructure teams with significant projects involving Terraform/CDKTF, Kubernetes, Helm, test infrastructure, release management, and observability; experience optimizing cloud resource utilization; proficiency tuning Kubernetes clusters for cost and performance; ability to balance speed and pragmatism across growth stages; hands-on proficiency with modern LLM tooling and production AI systems including model APIs, agent/RAG frameworks, evaluation and tracing tools, and LLM operational characteristics.
Preferred qualifications include building infrastructure from the ground up at fast-growing startups; experience with observability tools (Prometheus, Grafana, New Relic); GitOps tools (ArgoCD, Flux); security compliance and SOC2 audits; familiarity with Python, Postgres, and multi-cloud deployments.
The company offers competitive base salary and equity, comprehensive medical/dental/vision coverage, unlimited PTO, and daily catered lunch/snacks in the San Francisco office. LlamaIndex is a venture-backed AI infrastructure company founded in 2023, headquartered in San Francisco.
About LlamaIndex
AI / Data / Infrastructure — data framework and cloud tools for connecting enterprise data to LLM applications.
