SlipstreamJobs tracks this role from the company's public career site. Apply directly on the employer's site.
Fieldguide is automating and streamlining assurance and audit work for cybersecurity, privacy, and financial audits. The company is backed by Goldman Sachs Alternatives, Bessemer Venture Partners, 8VC, Floodgate, and Y Combinator, and trusted by over 50 of the top 100 accounting and consulting firms.
As a Senior Software Engineer on the Foundation Agents team, you will own the strategy and practice around measuring and improving agent quality. You'll take responsibility for how the team evaluates long-horizon agents that perform real work in production, and drive platform-level reliability improvements.
Key responsibilities include:
- Owning evals strategy and error-analysis practice, shaping how the team measures and improves agent quality
- Designing and building agent knowledge and evaluation infrastructure for Fieldguide's long-horizon agents
- Leading error analysis on agent behavior and turning findings into concrete platform-level reliability improvements
- Building and hardening backend systems that support agent execution, evaluation, and monitoring at scale
- Driving the AI platform's reliability and quality roadmap forward in collaboration with the broader AI team
- Mentoring engineers on the team and raising the bar on eval rigor and error-analysis practice
You should have built AI products end-to-end with real ownership over agent quality outcomes. You think in evals and error analysis as a discipline, digging into why agents fail and fixing systemic causes. You're strong in backend engineering and comfortable owning platform-level systems. You're motivated by long-horizon agents that do real work in production and multiply the people around you.
REQUIREMENTS
Must-have:
- 1+ years working specifically on agents
- Strong experience working on an AI platform
- Demonstrated experience building evals and performing error analysis
- Backend engineering experience
Nice-to-have:
- Strong platform engineering skills
- Frontend experience
- Distributed systems experience
