SlipstreamJobs tracks this role from the company's public career site. Apply directly on the employer's site.
Gong is seeking a Software Architect to lead the technical direction of Revenue Harness, an agentic framework powering an AI teammate for revenue professionals. This is a hands-on role with broad influence across the AI Applications group.
You will own the architecture and design of a sophisticated agentic system that understands deals, customers, and pipelines, enabling AI to reason, plan, and act on behalf of users. Key areas include:
**Core Responsibilities:**
- Define and evolve the Revenue Harness reference architecture, establishing contracts between agents, tools, context, and models
- Lead hands-on engineering across teams, embedding directly in design and code contributions
- Set quality and reliability standards for non-deterministic systems, including evaluation methodology and production monitoring
- Mentor engineers and raise the bar on design quality and best practices across the group
- Drive adoption of AI-assisted development tools and agentic workflows
**Technical Scope:**
You will architect and build systems spanning agent orchestration and planning loops, multi-agent coordination, secure tool ecosystems (MCP-based), retrieval pipelines with RAG and hybrid search, quality evaluation frameworks, multi-provider LLM routing, high-concurrency runtime infrastructure, and cloud-native Kubernetes deployments with multi-region rollout capabilities.
**Key Challenges:**
- Making LLM behavior trustworthy through structured outputs, tool validation, and fallbacks
- Efficiently retrieving context at enterprise scale across millions of conversations and accounts
- Enforcing data boundaries, permissions, and tenant isolation while defending against prompt injection
- Balancing quality, cost, and latency through model selection and routing
- Bringing clarity to cross-team architectural problems and steering toward aligned patterns
- Managing speed versus long-term platform evolution as AI models and tooling rapidly change
**Impact:**
Help sales professionals shift time from busywork to selling, build stronger autonomous teams through better design practices, and reduce duplication while accelerating execution without compromising platform health.
**Requirements:**
- 10+ years of backend development with strong expertise in Java and modern frameworks (Spring Boot)
- Proven Staff or Principal-level impact across multiple teams, leading through influence rather than authority
- Hands-on experience shipping production LLM applications (agents, tool calling, RAG, structured generation) with understanding of failure modes
- Deep expertise in large-scale distributed systems design, including asynchronous, event-driven, and streaming architectures
- Versatility in diving into unfamiliar codebases, switching context across teams, and spotting high-impact opportunities
- Passion for mentoring and ability to communicate complex ideas clearly to diverse stakeholders
- Genuine curiosity about the AI landscape and track record of driving AI-assisted development adoption
**Nice to Have:**
- Experience with agent frameworks and protocols (MCP, Spring AI, LangChain/LangGraph)
- Experience with LLM evaluation, observability, and multi-provider routing
- Experience with vector databases, search infrastructure (Elasticsearch/OpenSearch), or knowledge graphs
- Familiarity with AI security concerns (prompt injection, data leakage, agent permissions)
- Working knowledge of Python alongside JVM stack
- Background in B2B SaaS, CRM, or revenue technology
