SlipstreamJobs tracks this role from the company's public career site. Apply directly on the employer's site.
Lighthouse is an AI-powered commercial strategy platform for hospitality, processing ~200 million requests daily across 200+ data sources. The company has raised $370M in Series C funding, generates over $100M in ARR, and serves 85,000+ users including all top 15 global hotel chains.
You will join the Crawler Engineering team as a Backend Engineer focused on data acquisition. This is a building role where you'll design and develop high-performance systems—primarily in Rust—that collect billions of data points from the web. The work sits at the intersection of backend engineering and web infrastructure: HTTP stacks, proxies, and browser tooling. When a data source blocks an approach, you'll investigate what's happening on the wire and find alternative solutions. You'll also help make the infrastructure "agent-friendly" so other teams can safely build on it with AI.
Key responsibilities:
- Design, build, and improve backend systems for data acquisition handling close to 200 million requests daily
- Work on the in-house proxy layer and browser tooling: request routing, connection handling, and protocol-level behavior
- Investigate hard crawler problems, test alternative approaches when blocked, and turn working solutions into robust, reusable systems
- Build clear interfaces and guardrails so other teams and AI agents can use your work reliably
- Own code quality including code written with AI assistance: tests, observability, and maintainability
- Work closely with crawler engineers, DevOps, and Security to ship secure, scalable solutions
The Crawler Engineering team ensures customers get fresh, high-quality rates, ranking, and supply data. The team carries responsibility for keeping crawling infrastructure reliable, efficient, and ahead of a rapidly changing web.
Benefits include flexible working (home or global offices), unlimited time off, €160/month food/nursery allowance, health insurance covering you and dependents, subsidized ClassPass (up to 80%), career development workshops, and referral bonuses.
REQUIREMENTS:
- Hands-on experience building, deploying, and running production backend services in a cloud environment
- Experience with a systems language such as Rust or C/C++, OR strong track record in another backend language with genuine drive to go deep in Rust
- Solid grasp of how the web works under the hood: HTTP, TCP/IP, TLS, and proxies
- R&D mindset: curious about how browsers and network stacks work internally, comfortable with ambiguity, prefer proving hypotheses over assumptions
- Strong analytical and debugging skills; comfortable with packet captures, profilers, and reading others' source code
- Clear communication, openness to feedback, strong teamwork
- Fluent in English
Technologies: Rust, TypeScript/Node.js, Python, Google Cloud, Kubernetes, Prometheus, Grafana, Claude Code.
