SlipstreamJobs tracks this role from the company's public career site. Apply directly on the employer's site.
Salary: USD 100,000 - 110,000 / annual
Shift Technology is seeking a Data Scientist/Engineer to join its 200+ person Data Science team in Boston. The role combines full-lifecycle data science work with hands-on engineering, focusing on building AI agents that transform insurance operations.
You will contribute to the US insurance roadmap and client solutions, working across structured data, free text, documents, and images. Key responsibilities include:
• Build and productionize data pipelines (structured, text, documents, images) optimized for LLMs and multi-modal models
• Design, develop, and deploy LLM-based solutions (RAG, embeddings, instruction tuning) for subrogation, claims handling, document understanding, and related use cases
• Experiment with agentic AI technologies (Langchain/Langgraph, OpenAI Agent SDK, MCP, A2A) and develop MVPs for next-generation autonomous subrogation solutions
• Develop Chain-of-Thought and ReAct prompting strategies to ensure agents can justify liability percentages based on Comparative Negligence laws across jurisdictions
• Create custom tools for agents to query internal databases, call external APIs, or calculate impact force from telemetry data
• Establish rigorous evaluation frameworks (LLM-as-a-judge) to ensure decisions are unbiased, legally sound, and explainable
• Ensure responsible-AI practices: privacy, hallucination mitigation, explainability, and compliance
• Lead client workshops, present prototypes, gather feedback, and help define roadmap priorities
Shift delivers insurance-grade AI agents that are accurate, explainable, and secure, trusted by hundreds of leading insurers worldwide. The company operates across 50+ countries with a culture built on innovation and transforming the insurance industry through its SaaS platform.
REQUIREMENTS:
• Expert proficiency in production-level object-oriented programming (OOP) for building scalable and reliable systems
• Proven hands-on experience with Large Language Models (LLMs) and generative AI techniques (RAG, embeddings, prompt engineering, model tuning), leveraging frameworks such as OpenAI/Anthropic or open-source variants
• Solid foundation in ML fundamentals with practical experience in the full machine learning lifecycle, including model evaluation, monitoring, versioning, and deployment in production environments
• Experience designing and implementing robust data pipelines for document, OCR, and multi-modal data workflows
• Experience with agentic frameworks: LangChain/LangGraph, OpenAI Agent SDK, CrewAI, A2A/MCP with Databricks or Azure-hosted models (DBRX, OpenAI GPT-5.3, Anthropic Claude, Google Gemini)
• Demonstrated ability to effectively engage with clients, translate complex business needs into clear, actionable technical solutions, and manage stakeholder expectations
HIGHLY DESIRED:
• Deep expertise in Databricks Ecosystem: Mosaic AI (formerly MosaicML), Unity Catalog, Delta Lake; good understanding of Spark data architecture
• Experience using MLflow for full lifecycle: experiment tracking, prompt engineering in AI Playground, model evaluation
