SlipstreamJobs tracks this role from the company's public career site. Apply directly on the employer's site.
Salary: USD 200,000 - 275,000 / annual
General Legal is an AI-powered legal tech company reimagining contract negotiation and legal services by using AI to handle initial analysis, freeing lawyers to focus on human interaction and complex judgment. The company is founded by veterans with prior successful exits and has been working in deep learning for the legal space since before the recent AI boom.
As Senior ML Infrastructure Engineer, you'll own the systems that enable rapid experimentation, evaluation, training, and deployment of increasingly capable AI models. You'll work at the intersection of research and production engineering, directly supporting researchers and product engineers by building reliable, scalable infrastructure.
Key responsibilities include: designing and operating training, evaluation, and inference infrastructure; building systems for large-scale experiments and reproducible evaluations; creating data pipelines for generation, processing, versioning, and management; optimizing model inference for reliability, latency, throughput, and cost; implementing observability and monitoring for production AI systems; developing infrastructure for agentic and long-running asynchronous workloads; and collaborating closely with research scientists and engineers to move AI capabilities from experiment to production.
You'll have substantial autonomy over architecture and tooling decisions, helping shape how the ML stack evolves as the company scales. The role requires 5+ years in software engineering, ML engineering, or infrastructure; strong Python and software fundamentals; production ML infrastructure experience; cloud, distributed systems, and containerization expertise; and the ability to independently design and operate complex technical systems. Nice-to-haves include LLM training/fine-tuning/serving experience, GPU infrastructure expertise, reinforcement learning or post-training systems knowledge, AI agent infrastructure experience, inference optimization at scale, and early-stage startup background.