SlipstreamJobs tracks this role from the company's public career site. Apply directly on the employer's site.
Higgsfield AI is a rapidly scaling generative AI company focused on AI-powered video creation and creative tools. The company has achieved $500M in annual revenue run rate, 25M+ users worldwide, and powers 390 Fortune 500 brands.
As an ML Engineer on the Data Engine team, you will work on the core infrastructure and models that power video understanding and generation. Your responsibilities include:
- Analyzing motion and physical dynamics in video, including optical flow, camera vs. object motion, temporal consistency, and physical plausibility (dynamics, collisions, gravity, deformation).
- Training models for post-training pipelines, including reward models for video quality and coherence.
- Building video classifiers for motion types, shot types, genres, and quality using classical approaches and vision-language models.
- Developing methods for multi-shot video sequences: shot-boundary detection, assembling coherent sequences with consistent characters and scenes, and generating shot captions.
- Working with audio: speech/music/sound-event detection, audio-visual synchronization evaluation (lip-sync and sound-to-action alignment), audio-quality filtering, and audio-track captioning.
- Applying data-curation techniques including near-duplicate detection, heuristic filtering, VLM-based captioning, synthetic data generation, and dataset versioning.
- Building and running large-scale distributed processing pipelines.
You will need strong PyTorch skills and hands-on model training experience, including fine-tuning and deploying classifiers, embedding models, and VLMs. Deep knowledge of video-processing methods is essential, as is experience building and validating classifiers on video data with annotation workflows, active learning, and precision/recall measurement at scale. You should have strong understanding of data-curation techniques and experience processing large-scale unstructured datasets (video, audio, images).
The company offers competitive USD-based salary, equity participation, relocation support to Almaty, a collaborative fast-paced environment, professional growth opportunities, and company-provided equipment and benefits. This is a fully on-site role requiring five days per week in the Almaty office.
