SlipstreamJobs tracks this role from the company's public career site. Apply directly on the employer's site.
Incredible Health is an AI-powered career marketplace for nurses, serving over one million nurses and 1,500+ hospitals. The company builds matching and search models that power discovery, plus AI products like Lyn, an AI interview agent.
As a Senior AI Engineer, you'll own LLM-powered products end-to-end: prototype capabilities, validate with evaluation suites, deploy to production, monitor performance, and iterate based on real-world usage. You'll take ownership of matching, search, and ranking systems—covering model design, offline validation, shadow-scoring, and A/B experiments across embeddings and ElasticSearch. You'll ship production code across the full stack (Python ML services, Rails, React) and diagnose issues ranging from hallucinations to retrieval misses to ranking regressions.
You'll translate ambiguous questions into production-minded data analysis that informs product decisions, and raise engineering standards through rigorous code review with ML, AI, and product engineers.
You bring 6+ years of software engineering experience, with at least 2 recent years taking ML- and LLM-powered features from concept through deployment and long-term maintenance. You have strong Python skills with the depth to independently run model retrains, embedding pipelines, and evaluation harnesses. You understand evaluation for non-deterministic systems—golden datasets, LLM-as-judge, regression tests—and have core ML foundations in classification, ranking, and model evaluation. You think in systems and tradeoffs, preferring to ship a good feature that helps 10,000 nurses today over a perfect model that stays in a notebook.
