SlipstreamJobs tracks this role from the company's public career site. Apply directly on the employer's site.
Salary: USD 73,000 - 90,000 / annual
YipitData is a market research and analytics firm specializing in alternative data for the disruptive economy. Recently valued at over $1B after raising $475M from The Carlyle Group, the company analyzes billions of data points daily to provide insights on ridesharing, e-commerce, payments, and more. The company operates offices across NYC, Austin, Miami, Denver, Mountain View, Seattle, Hong Kong, Shanghai, Beijing, Guangzhou, and Singapore.
You will lead a web scraping engineering team and own the design, scalability, reliability, and performance of the company's scraping infrastructure. Key responsibilities include leading and mentoring web scraping engineers, owning the architecture and roadmap of scraping systems, guiding development and maintenance of scrapers using tools like Playwright, Puppeteer, and Selenium, and solving complex challenges involving dynamic websites, browser automation, fingerprinting, sessions, cookies, headers, and proxies.
Additionally, you will establish monitoring, logging, alerting, and data-quality practices; drive performance and reliability improvements; partner with cross-functional teams (Engineering, Data, Analytics, Product) to prioritize requirements and deliver high-quality data; and participate in hiring, technical reviews, and engineering planning.
This is a fully remote role based in India with standard work hours from 11am to 8pm IST, though flexibility is available. The ideal candidate has 7+ years of software engineering experience with strong web scraping expertise, previous engineering management or team leadership experience, hands-on proficiency with Playwright, Puppeteer, or Selenium, and deep understanding of HTTP, REST APIs, HTML/DOM, browser rendering, TLS/SSL, fingerprinting, anti-bot challenges, and proxy rotation. Strong production troubleshooting, communication, and mentoring abilities are essential.
