Web Scraping Developer

Rose Talent Solutions partners with growing businesses to build full-time nearshore teams that function seamlessly as part of their in-house staff. All of our team members work U.S. business hours and integrate directly into existing systems to deliver optimal results.

To Apply, fill out this application form here: https://forms.gle/FzcKSVJ2z1EZt9nG9

Web Scraper / AI Developer — Full-time Remote: We're looking for a Web Scraping developer. You'll architect and build robust web scrapers that pull content from social media, blogs, Reddit, and other public sources, then feed that data into AI workflows. You'll navigate the technical challenges of web scraping (IP blocking, rate limits, dynamic content) and choose the right tool for each job—whether that's a pre-built solution or custom code.

Responsibilities:

- Design, build, and maintain web scrapers across multiple sources (social media platforms, blogs, news sites, Reddit, X, etc.)

- Troubleshoot and overcome technical blockers (IP rotation, rate limiting, JavaScript rendering, CAPTCHAs)

- Evaluate and implement scraping tools (Bright Data, Playwright, Applify, direct APIs) based on cost, reliability, and project requirements

- Build custom scraping solutions when off-the-shelf tools fall short

- Integrate scraped data into AI pipelines and data processing workflows

- Monitor scraper health, optimize performance, and scale solutions as data volume grows

- Document technical decisions and maintain knowledge base for the team

What We Are Looking For:

- 3+ years of hands-on experience building and shipping web scrapers in production

- Proven experience with Bright Data, Playwright, Applify, or similar scraping/automation tools

- Strong understanding of HTTP, APIs, proxies, and common anti-scraping techniques

- Experience integrating scraped data into AI/ML workflows or data processing pipelines

- Problem-solving mindset—you've debugged failing scrapers and found creative solutions

- 3+ years working with U.S. or U.K. businesses (familiarity with English business communication and workflows)

- Clear written and verbal English communication

What the Role Is Not:

- Not just "run a tool and collect data"—you'll own architectural decisions and trade-offs

- Not a data analyst role—we need a developer who can code custom solutions

- Not focused on speed alone—reliability and data quality are what matter

To Apply, fill out this application form here: https://forms.gle/FzcKSVJ2z1EZt9nG9