SlipstreamJobs tracks this role from the company's public career site. Apply directly on the employer's site.
Certivity builds and operates large-scale web crawling and data extraction systems that transform unstructured, dynamic websites into clean, structured, and reliable data. In this role, you will own crawlers end-to-end: from discovery and resilient fetching against real anti-bot defenses, to converting HTML/PDF into trustworthy structured output.
Key responsibilities include:
- Building and scaling crawlers that handle dynamic, large-scale sites while adapting as those sites change and implement anti-bot measures
- Staying ahead of anti-bot defenses: TLS/browser fingerprinting, proxies, session and rate-limit strategies, and change detection
- Converting raw HTML and PDF into clean, correct structured data (including LLM-assisted extraction), with a mindset that silently wrong output is worse than a crash
- Designing and operating pipelines for ingestion, deduplication, versioning, and enrichment
- Shipping and running containerized applications in the cloud with CI/CD
- Shaping technical architecture and engineering culture in a small, fast-moving team
The tech stack includes Python, Docker, GCP (Cloud Run jobs), Azure Blob Storage, and MongoDB, with Go services and React frontend on the periphery. You don't need all technologies on day one, but you must ramp up quickly.
The company offers a vibrant in-office culture in Munich with the option to work from home up to 60% of the time, flexible working hours, 30 vacation days per year (including 4 company rest days), 30 days of workation per year within the EU and selected countries, high autonomy, flat hierarchies, EGYM Wellpass for fitness, and Udemy access.
Requirements:
- 3+ years of professional software development experience
- Strong Python skills: real production code with async experience
- Hands-on web scraping at scale, including firsthand experience with anti-bot defenses and failure modes of large-scale collection
- Data-correctness mindset: you care that extracted data is right, not just that the job finished
- Docker, at least one major cloud platform (GCP, Azure, or AWS), Git, and comfort on the CLI
- Clear communicator who works well in a small, fast-moving team
Nice to have:
- LLM-assisted extraction or other work with LLMs, ML pipelines, or data labeling workflows
- Go or Java/Spring Boot
- Frontend experience with React, or eagerness to learn
- Terraform, Kubernetes, and modern DevOps tooling
