SlipstreamJobs tracks this role from the company's public career site. Apply directly on the employer's site.
Confido is an AI infrastructure platform serving 200+ CPG brands (OLIPOP, Simple Mills, Dr. Squatch, Tropicana) to unify finance, accounting, sales, and operations. The company is growing 5x year-over-year with a small team in NYC.
As an Applied AI Data Analyst, you will bridge unstructured financial and operational datasets with the core R&D team. You'll own the evaluation platform for agentic workflows and forecasting pipelines, and improve customer-facing insights that drive mission-critical decisions.
Key responsibilities:
- Evaluate LLM and AI model performance: analyze edge cases, hallucination rates, and extraction accuracy for document processing and agentic workflows
- Root cause analysis: investigate complex datasets (inconsistent financial documents, fragmented enterprise systems) to understand why models succeed or fail
- Golden dataset curation: define and maintain gold-standard evaluation datasets for automated backtesting of AI agents and demand forecasting models
- Performance monitoring: build dashboards, data transformations, and evaluation harnesses to track system health, model drift, and AI metrics across releases
- Cross-functional collaboration: partner with applied AI engineers, product managers, and business operations to translate real-world problems into quantitative insights
Required qualifications:
- Master's or Ph.D. in Computer Science, Data Science, Statistics, Mathematics, Physics, or related STEM field
- 2–4 years in quantitative data analysis or AI evaluation, working alongside AI/ML R&D teams
- Python proficiency and hands-on experience with AI/ML models
- Strong SQL and enterprise data infrastructure skills (PostgreSQL, Snowflake, dbt, AWS)
- Ability to translate noisy, unstructured data into rigorous evaluation insights
Nice-to-have: LLM observability tools (LangSmith, Arize AI, TruLens), agentic workflows experience, demand forecasting or time-series modeling, startup environment comfort.
The role is part of the Applied AI Research department with advancement paths to senior data science and AI/ML engineering roles. Relocation support provided.
