SlipstreamJobs tracks this role from the company's public career site. Apply directly on the employer's site.
VAST Data is building foundational enterprise software for the AI era, engineering platforms that capture, catalog, refine, and protect massive datasets across data centers, edge, and cloud environments. The company is recognized by Forbes as "the future of the market" and is experiencing explosive growth fueled by relentless engineering innovation.
You will design, build, and optimize high-performance distributed systems, core data engines, and backend infrastructure for a next-generation distributed event-streaming and messaging platform. This role requires deep system-level architecture understanding and the ability to handle large-scale clusters processing petabytes of data.
Key responsibilities include:
- Design and develop core components of a Kafka-protocol-compatible broker
- Build scalable and resilient distributed services handling petabytes of data across large clusters
- Design solutions around correctness semantics including ordering guarantees, transactions, exactly-once / idempotence, repartitioning, load balancing, replication, fault tolerance, and scalability
- Investigate and resolve complex production issues across the full produce-to-consume path, from Kafka clients through brokers and all intermediate layers to consumers
- Collaborate closely with architects, researchers, and engineering teams to deliver high-performance data infrastructure powering AI, analytics, and enterprise workloads
REQUIREMENTS:
- Deep expertise in C/C++ and Linux environment internals
- Strong understanding of distributed systems architecture at scale
- Experience with Kafka, event streaming, or similar messaging platforms
- Demonstrated ability to design and implement high-performance, fault-tolerant systems
- Problem-solving skills for complex production issues across distributed systems
