Senior Python Developer
JTA: The Data ScientistsYou'll take technical ownership of our web scraping platform, its architecture, its reliability, and where it goes next. The system already runs in production at high scale, so you won't be starting from scratch: you'll inherit something that works and decide how it gets better.
The work is hands-on and the problems are hard: anti-bot countermeasures, browser automation, fingerprinting, proxy infrastructure. You'll work primarily in Python, with Go where it fits.
What you'll be doing
- Take technical ownership of the scraping platform: its architecture, its reliability, and its direction;
- Improve and extend extraction pipelines in Python and Go, choosing the right tool for each job;
- Solve anti-bot systems, rate limiting, browser automation, fingerprinting, deduplication and change detection at scale;
- Apply LLMs to extraction and normalisation, with evaluation and guardrails so output stays accurate and costs stay predictable;
- Evolve the supporting infrastructure: scheduling and orchestration, proxy and session management, queuing, storage and observabilit;
- Develop backend services and APIs that deliver structured, well-documented datasets to downstream consumers;
- Shape the platform roadmap by surfacing technical priorities, risks and trade-offs;
- Raise the bar on testing, code review, documentation and monitoring, and mentor less experienced colleagues;
- Bring well-argued recommendations on build-vs-buy and technical direction;
What we're looking for
- Degree in Computer Science, Software Engineering or a related technical field;
- 5+ years of professional software engineering experience, a substantial part of it in data acquisition or backend systems;
- Strong production experience in Python; solid working experience in Go, or deep proficiency in Python plus a demonstrated ability to pick Go up quickly;
- Experience operating scraping systems at scale, not scripts, but systems that stay up;
- Strong grasp of concurrency, distributed systems and API design;
- Experience with SQL and NoSQL databases, including schema design and query performance;
- Comfortable with Docker, CI/CD and cloud infrastructure;
- Ownership mindset: you scope your own work, make decisions and are accountable for what you ship;
- Experience mentoring engineers and influencing technical direction;
- Fluent English, written and spoken;
What we offer
- Flexible hybrid work
- 15th month salary bonus
- 4 extra vacation days
- Work on international projects
- Company-paid certifications
- Training and clear career progression
- Team building activities
- A young, innovative culture
Location
We're based in Porto. Remote is possible, but we're only considering candidates based in Portugal.