SlipstreamJobs tracks this role from the company's public career site. Apply directly on the employer's site.
AlphaSense is seeking a Senior Engineering Manager to lead the AI Platform team, which builds and operates the core AI Gateway—a critical high-throughput infrastructure serving all Large Language Model (LLM) traffic across the AlphaSense ecosystem. The company is a market intelligence platform trusted by over 6,000 enterprise customers, including a majority of the S&P 500, and operates at significant scale, currently processing up to 1 trillion LLM tokens per week with projected 10x growth.
In this role, you will manage and mentor a team of up to 10 senior and staff software engineers distributed across North America. You'll own the strategy and architecture of the enterprise AI Gateway, ensuring high availability, sub-millisecond routing, intelligent caching, queueing, and robust fallback mechanisms. Key responsibilities include orchestrating integrations with 6+ major LLM vendors and 50+ distinct models, optimizing for latency, cost, and reliability. You'll partner closely with product management, AI research teams, and executive engineering leads to align the gateway's roadmap with core product features and organizational goals.
You'll define and champion software engineering best practices, architectural standards, and cost-tracking telemetry across the AI Platform organization. This is a strategic leadership role requiring deep experience running high-performance teams, strong background in distributed system architecture, and hands-on familiarity with multi-vendor integrations. You'll need superior communication and strategic collaboration skills to manage expectations and align stakeholders across the entire R&D organization.
Ideal candidates have proven track records managing senior and staff engineers, seasoned backgrounds in designing and operating high-throughput, low-latency distributed systems (routing, caching, queueing, rate limiting), and ability to deeply engage in architectural discussions. Experience with LangChain, LangGraph, LiteLLM, OpenRouter, Temporal, Envoy, Python, Java, and distributed caching/queueing systems is a plus. An AI-first mindset and active embrace of AI tools in developer workflows is expected.
