Senior Data Engineer with Terraform skills

Shift delivers AI agents that transform insurers' most critical work. By combining deep industry expertise and unmatched data resources, Shift provides proven results that have earned the trust of hundreds of the world's leading insurers. Our insurance-grade AI is accurate, explainable, and secure—empowering human experts to move with unmatched speed, total confidence, and a renewed focus on the people they serve. Your browser does not support the video tag. Our culture is built on innovation, trust, and a drive to transform the insurance industry through our SaaS platform. We come from more than 50 different countries and cultures and together we are creating the future of insurance. Learn more at www.shift-technology.com Our Engineering team lies at the core of the value we offer to our customers. We solve complex problems not only within our squads but also by working collaboratively with other teams across the organization. We’re reshaping the way data drives decision-making by building powerful, scalable software and data platforms. Whether you're passionate about distributed systems, building APIs, or enabling data-driven insights, you'll find exciting opportunities here. Our tech stack includes .NET Core (C#), Python, MS SQL Server, ElasticSearch, Spark, Azure Data Factory (ADF), GoodData, Terraform and more. We are also progressing towards distributed data systems on cloud platforms, with exciting challenges in both bulk and real-time processing. WHAT YOU'LL DO Your technical expertise and autonomy will allow you to design and implement scalable, intuitive features across our platform. Build and maintain high-performance data pipelines, contributing to a robust data and application architecture. Collaborate closely with cross-functional teams including Data Scientists, Engineers, and Product Managers to deliver impactful solutions. Operate and enhance our data infrastructure, ensuring seamless data movement across platforms. Support the evaluation and integration of tools that empower engineering and data science teams. WHAT YOU BRING 5+ years of experience in software development or data engineering in cloud-based environments. Strong programming skills in Python, with a solid grasp of OOP principles - C# programming experience would be nice to have Very good grasp of Infra-as-Code (IaC) and Terraform Proficiency in data transformation and processing tools (e.g. PySpark, dbt). Experience designing scalable and robust data platforms. Familiarity with data modeling techniques (e.g., star schema, data vault). Experience with distributed data systems and Database optimization Comfortable working with NoSQL data stores and SQL Server. Experience in ETL processes and orchestration tools like Apache Airflow etc A passion for continuous learning, mentoring, and solving complex problems. Excellent communication skills in English. HIRING PROCESS HR Screening Hiring manager Screening Technical Screening with an Architect Second Technical Screening with a Tech Lead or Data Engineer Final Round with Hiring Manager #LI-RH1 #LI-HYBRID To support our permanent, full time employees at every stage of their careers and lives, we provide a competitive total rewards and benefits package. Here are the global benefits we’d like to highlight: Flexible remote and hybrid working options Competitive Salary and a variable component tied to personal and company performance Multiple Learning and Development opportunities, including Focus Fridays, a half-day each month to focus on learning and personal growth Generous PTO and paid holidays Mental health benefits 2 MAD Days per year (Make A Difference Days for paid volunteering) Additional benefits may be offered by country, based on your eligibility - ask your recruiter for more information. Intern and Apprentice positions may receive some of these benefits - ask your recruiter for more details. At Shift we strive to be a diverse and inclusive workforce. We welcome applications from and hire people who will contribute to the diversity of our company, without regard to race, color, religion, marital status, age, national or ethnic origin, physical or mental disability, medical condition, pregnancy, genetic information, gender identity or expression, sexual orientation, or other non-merit criteria. Shift Technology is committed to providing reasonable accommodations for qualified individuals with disabilities in our application and employment process. Should you require accommodation, please email [email protected] and we will work with you to meet your accessibility needs. Please be aware of scammers and only trust correspondence that comes from emails ending in "shift-technology.com". We will never do initial outreach to you via Whatsapp/Text/SMS, never ask for banking information or personal identification numbers (ex. Social Security Number) as part of our recruitment process. Shift Technology does not accept unsolicited CVs from recruiters or employment agencies in response to the Shift Technology Careers page or a Shift Technology social media post. Any unsolicited CVs, including those submitted directly to hiring managers, are deemed to be the property of Shift Technology.