SlipstreamJobs tracks this role from the company's public career site. Apply directly on the employer's site.
Handshake AI is building the fastest-growing AI data business, working directly with frontier AI labs to create evaluations, benchmarks, and push the boundaries of AI model development. The company has grown from $0 to ~$1B run rate and pays ~$60M monthly to over 30K individuals.
As a Senior Software Engineer focused on Coding, you will design and build scalable systems that power high-quality coding data and evaluations for next-generation AI models. You'll work on technically complex projects including software engineering benchmarks, code review evaluation, agentic coding workflows, and developer-facing tools.
Key responsibilities:
- Design, build, and operate scalable software systems for coding evaluation, data generation, and agentic development workflows
- Develop tools and services that analyze, validate, and improve AI-generated code
- Build reliable pipelines for code execution, testing, benchmarking, and quality measurement
- Partner with engineering, research, operations, and customer-facing teams to translate complex requirements into practical systems
- Drive technical decisions across architecture, APIs, data models, observability, and operational excellence
- Improve engineering velocity through reusable frameworks, automation, and developer tooling
- Lead projects from ambiguous problem definition through design, implementation, launch, and iteration
- Mentor engineers through design reviews, code reviews, and day-to-day collaboration
- Establish high standards for maintainability, correctness, security, and reliability
You'll operate with significant ownership, collaborate closely with engineers and technical program leaders, and help establish standards and tools supporting Handshake's fastest-growing AI initiatives. This role sits at the intersection of software development and AI, shaping foundational infrastructure.
REQUIREMENTS:
- 6+ years of professional software engineering experience
- Strong proficiency in Python, JavaScript/TypeScript, Go, or another modern programming language
- Experience designing and operating production systems with meaningful scale, reliability, and performance requirements
- Strong understanding of software engineering fundamentals: testing, APIs, data structures, distributed systems, observability
- Experience building developer tools, infrastructure, data pipelines, evaluation systems, or other technically complex products
- Ability to work effectively in ambiguous environments and break large problems into clear, executable plans
- Excellent written and verbal communication skills, with ability to explain technical tradeoffs to technical and non-technical partners
- Track record of taking ownership and delivering high-quality results in collaboration
BONUS:
- Experience with AI/ML evaluation, coding agents, LLM applications, or developer productivity tools
- Familiarity with code execution sandboxes, GitHub workflows, CI/CD systems, or benchmark infrastructure
- Experience with containerization, cloud platforms, databases, and distributed job orchestration
- Open-source contributions or demonstrated passion for improving developer tools
- Experience partnering with research teams or customers on technically rigorous solutions
