SlipstreamJobs tracks this role from the company's public career site. Apply directly on the employer's site.
Salary: USD 170,000 - 200,000 / annual
Legion is an AI infrastructure company born from a Department of Defense partnership, trusted by government and enterprise leaders. The company builds secure, reliable AI systems that enhance human workflows rather than replace them, with partnerships including Palantir, Nvidia, HPE, and Oracle.
As a Senior Software Engineer, Machine Learning, you will design, build, and evolve core AI capabilities powering intelligent experiences across Legion's enterprise AI platform. You will integrate modern foundation models into production systems, develop reusable AI capabilities, and continuously improve their quality, reliability, and performance.
Key responsibilities include:
- Design, build, and maintain core AI capabilities across the platform
- Develop reusable capabilities for model integration, reasoning, multimodal understanding, structured generation, and evaluation
- Optimize AI systems through experimentation, quantitative evaluation, context engineering, and iterative refinement
- Build backend services, APIs, and distributed AI systems using production software engineering practices
- Partner with cross-functional teams to deploy scalable AI services enabling rapid product development
- Rapidly prototype emerging AI techniques and translate successful experiments into production-ready capabilities
- Support production systems by debugging failures and improving latency, reliability, observability, and operational performance
- Stay current with advances in AI engineering, foundation models, and applied machine learning
- Contribute to a collaborative engineering culture focused on ownership and continuous learning
IMPORTANT REQUIREMENTS:
- US Citizenship or Greencard (Permanent US Residency) required due to US Government contract requirements
- Must be domiciled in the U.S. (must live permanently and maintain home address in the US)
- Will be required to provide legally authorized identification verification through third-party provider CLEAR ID
- Expert-level proficiency in development and deployment of machine learning models required
QUALIFICATIONS:
Required: Bachelor's or Master's degree in Computer Science, Machine Learning, or related technical field, or equivalent practical experience. 5+ years of experience building production software systems. Strong software engineering skills with Rust, Python, or similar languages. Proven ability to build scalable backend services, distributed systems, APIs, or data-intensive applications. Hands-on experience integrating large language models or other foundation models into production applications. Ability to design, evaluate, and improve AI systems through experimentation and quantitative evaluation. Familiarity with modern AI engineering patterns (structured outputs, tool calling, context engineering, multimodal systems, AI workflows). Strong understanding of software engineering best practices (testing, observability, reliability, maintainability). Demonstrated ability to take ownership of technically ambiguous projects from design through production. Excellent communication and collaboration skills across cross-functional teams. Growth mindset and low ego with willingness to learn and adapt.
Preferred: Experience building reusable AI capabilities or shared AI services. Familiarity with deploying, optimizing, or serving open-source foundation models. Knowledge of evaluation frameworks, benchmarks, or datasets for AI applications. Experience with Kubernetes, cloud-native infrastructure, or distributed systems. Production software development in Rust. Familiarity with RAG, multimodal AI, AI agents, or model orchestration. Domain expertise in complex AI systems such as multimodal reasoning, long-running inference workflows, AI agents, or model orchestration.
