Senior Data Engineer

About InMarket Since 2010, InMarket has been the leader in 360-degree consumer intelligence and real-time activation for thousands of today's top brands. Through InMarket's data-driven marketing platform, brands can build targeted audiences, activate media in real time, and measure success in driving return on ad spend. InMarket's proprietary Moments offering outperforms traditional mobile advertising by 6x.* Our LCI attribution platform, which won the MarTech Breakthrough Award for Best Advertising Measurement Platform, was validated by Forrester to drive an average of $40 ROAS for our clients. *Source: Wordstream US Google Display Benchmarks for Mobile Media About the Role We are looking for a talented Senior Data Engineer to join the team that builds the essential data infrastructure at the heart of InMarket's product suite. You should be a quick learner who is enthusiastic about learning new technologies, and a passionate engineer who empowers fellow engineers to write clean and efficient data pipelines. You will implement technical solutions to empower internal and external customers and scale the existing data platform, working closely with end users to define key business questions, leading fellow engineers to define technical solutions, and partnering with Product Managers to build the data sets that answer those questions. You will work with huge datasets and build ETLs that bring data together to answer business questions, drive reporting, and fuel growth. Core Areas of Responsibility Pipeline Development & Architecture Design and implement ETL pipelines in Apache Airflow, BigQuery, Python, and Spark to transform upstream source data into curated data assets used across InMarket's data-driven products Architect and plan projects involving highly distributed, high-performance data platform systems Identify areas for improvement in existing pipelines and processes Understand business requirements and convert them into technical solutions Technical Leadership & Best Practices Stay current with and advocate internally for Data Engineering best practices, technologies, and testing frameworks that shape InMarket's technical future Provide technical guidance to other engineers to help grow their knowledge and technical capabilities Lead fellow engineers in defining technical solutions to business problems Cross-Functional Collaboration Work closely with end users to define key business questions, and with Product Managers to build the data sets that answer them Communicate complex concepts and analysis results clearly and effectively to Product and Engineering Managers Impact & Success Indicators In your first 90 days: Onboard onto InMarket's data stack (Airflow, BigQuery, Python, Spark) and ship your first ETL pipeline improvement or fix Build working relationships with Product Managers and engineering peers across the data team Develop fluency in InMarket's existing data architecture and identify at least one improvement opportunity in current pipelines Actively participate in code reviews and adopt the team's engineering best practices In your first year: Design and deliver end-to-end ETL pipelines that power one or more of InMarket's data-driven products Serve as a technical mentor, raising the skill level and pipeline quality of fellow engineers Lead architecture decisions for a highly distributed, high-performance data platform initiative Establish or improve a testing and data-quality framework adopted across the team We're Looking for Someone With Strong SQL experience Expertise in at least one data pipelining orchestration framework (Airflow, Luigi, etc.) Experience building ETL pipelines Strong software engineering skills in an object-oriented language such as Java or Python Experience building and optimizing a data warehouse on a major cloud platform (BigQuery preferred but not required) Deep understanding of Big Data technologies such as Hadoop and Spark Experience building and optimizing large-scale, high-performance systems Extensive knowledge of data-related tools and architecture concepts on a major cloud platform Knowledge of Kubernetes, Docker, Airflow, Git, and CI/CD best practices Strong collaboration and communication skills within and across teams B.S. or M.S. in Computer Science or a related technical field At least 4 years of software engineering experience, ideally in data engineering Nice to have: Experience optimizing BigQuery performance Experience building a data governance platform in a regulated environment Experience with various data testing frameworks and technologies Familiarity with the digital media/advertising industry Compensation & Benefits For candidates in California, Colorado, New York City, Illinois, Minnesota, New Jersey, Vermont, Washington, and Massachusetts, the Targeted Base Salary Range for this role is $140,000 to $175,000. Actual salaries will vary depending on factors including, but not limited to, work experience, specialized skills and training, performance in the role, business needs, and job requirements. Base salary is subject to change and may be modified in the future. Base salary is just one component of InMarket's total rewards package, which may also include bonuses, equity, and benefits. Ask your recruiter for more information! Additional perks and benefits: Competitive salary and stock options Flexible vacation / Unlimited PTO (within reason) Medical, dental, and Flexible Spending Account (FSA) Company-matched 401(k) Paid Paternity & Maternity Leave Agile Development Program for continued learning and professional development Equal Opportunity Employer At InMarket, diversity is not just a value; it's the very essence of who we are. It's about recognizing and celebrating the unique perspectives each of us brings, from our colleagues to the communities we serve. We are committed to embracing the full spectrum of backgrounds, beliefs, abilities, and life experiences, knowing that this diversity strengthens us. At InMarket, our commitment to Diversity, Equity, and Inclusion means valuing each individual's unique contributions. Together, we thrive. InMarket is an Equal Opportunity Employer (EOE). Qualified applicants are considered for employment without regard to age, race, color, religion, sex, national origin, sexual orientation, disability, or veteran status. Privacy Notice for California Job Applicants: https://inmarket.com/ca-notice-for-job-applicants/ All applicants must be authorized to work for any employer in the U.S. We are unable to sponsor or take over sponsorship of an employment visa at this time. #LI-Remote