SlipstreamJobs tracks this role from the company's public career site. Apply directly on the employer's site.
YipitData is a market research and analytics firm specializing in alternative data for the disruptive economy. The company recently raised $475M from The Carlyle Group at a $1B+ valuation and analyzes billions of data points daily to provide insights on ridesharing, e-commerce, payments, and more. With offices across NYC, Austin, Miami, Denver, Mountain View, Seattle, Hong Kong, Shanghai, Beijing, Guangzhou, and Singapore, YipitData has been recognized as one of Inc's Best Workplaces for three consecutive years.
As a Web Scraping Engineer, you will own the design, development, and maintenance of robust web scrapers that power critical reports and customer experiences. This is a hands-on role focused on solving complex, high-impact data extraction challenges at scale.
Key responsibilities include: refactoring and maintaining existing scraping scripts to improve reliability and efficiency while implementing best coding practices; implementing advanced scraping techniques including sophisticated fingerprinting methods (cookies, headers, user-agent rotation, proxies) to avoid detection; collaborating with analysts and stakeholders to gather requirements and ensure data quality; developing monitoring solutions and alerting frameworks to identify and address failures; and driving continuous improvement by evaluating new tools, methodologies, and technologies.
You should have 3+ years of experience with web scraping frameworks (Selenium, Playwright, Puppeteer), strong understanding of HTTP, RESTful APIs, HTML parsing, browser rendering, and TLS/SSL mechanics. Expertise in fingerprinting and evasion strategies, cookie/header/session management, and proxy rotation (residential and data center) is essential. Experience with logging, metrics, alerting, and performance optimization is required. Fluent English communication with both technical and non-technical stakeholders is critical.
This is a fully remote role based in India with standard hours 11am–8pm IST, though flexibility is available. You'll be an early member of an expanding Web Scraping Engineering team with significant input on strategies, processes, and culture.
