SlipstreamJobs tracks this role from the company's public career site. Apply directly on the employer's site.
Handshake is building the infrastructure for AI data at scale. The company powers 25 million job seekers and 1 million+ employers globally. In 2025, Handshake launched Handshake AI, which has grown to ~$1B run rate by working directly with frontier AI labs to create evaluations, publish benchmarks, and push the boundaries of AI model development. The company pays ~$60M monthly to over 30K individuals for high-quality data work.
As a Senior Software Engineer on the Coding team, you will design and build the systems that power coding data and evaluations for next-generation AI models. You'll work on technically complex projects including software engineering benchmarks, code review evaluation, agentic coding workflows, and developer-facing tools.
Key responsibilities:
- Design, build, and operate scalable software systems for coding evaluation, data generation, and agentic development workflows
- Develop tools and services that analyze, validate, and improve AI-generated code
- Build reliable pipelines for code execution, testing, benchmarking, and quality measurement
- Partner with engineering, research, operations, and customer-facing teams to translate complex requirements into practical systems
- Drive technical decisions across architecture, APIs, data models, observability, and operational excellence
- Improve engineering velocity through reusable frameworks, automation, and developer tooling
- Lead projects from ambiguous problem definition through design, implementation, launch, and iteration
- Mentor engineers through design reviews, code reviews, and day-to-day collaboration
- Establish high standards for maintainability, correctness, security, and reliability
You'll operate with significant ownership, collaborate closely with engineers and technical program leaders, and help establish the standards and tools that support Handshake's fastest-growing AI initiatives.
REQUIREMENTS:
- 5+ years of professional software engineering experience
- Strong proficiency in Python, JavaScript/TypeScript, Go, or another modern programming language
- Experience designing and operating production systems with meaningful scale, reliability, and performance requirements
- Strong understanding of software engineering fundamentals, including testing, APIs, data structures, distributed systems, and observability
- Experience building developer tools, infrastructure, data pipelines, evaluation systems, or other technically complex products
- Ability to work effectively in ambiguous environments and break large problems into clear, executable plans
- Excellent written and verbal communication skills, with the ability to explain technical tradeoffs to both technical and non-technical partners
- Track record of taking ownership and delivering high-quality results in collaboration with others
BONUS:
- Experience with AI/ML evaluation, coding agents, LLM applications, or developer productivity tools
- Familiarity with code execution sandboxes, GitHub workflows, CI/CD systems, or benchmark infrastructure
- Experience with containerization, cloud platforms, databases, and distributed job orchestration
- Open-source contributions or demonstrated passion for improving developer tools
- Experience partnering with research teams or customers to deliver technically rigorous solutions
