Data Engineer
- Hiring from
- United States
- Work type
- Remote
- Posted
513,132 remote jobs, straight from company career pages
100% free · New jobs every hour
Show job descriptionHide job description
Shift4 (NYSE: FOUR) is boldly redefining commerce by simplifying complex payments ecosystems across the world. As the leader in commerce-enabling technology, Shift4 powers billions of transactions annually for hundreds of thousands of businesses in virtually every industry. For more information, visit www.shift4.com.
Shift4 is looking for a Data Engineer to join the Shift4 data team and build the SQL and Python based jobs that turn raw payments data in Snowflake into reconciled, reliable datasets and reports. We currently have a library of containerized Python scripts that run SQL against Snowflake on a schedule. You will extend and improve this platform, making it more reliable, scalable and maintainable as we continue to evolve it.
This is a hands-on build role: you write the queries, wrap them in clean, testable Python, package them to run in containers, and make sure they produce correct numbers every time. Pipeline infrastructure (ingestion into Snowflake) is owned by the Data Platform team; you own what happens once the data is there, while embracing the Shift4 way.
Responsibilities
- Design, write, and maintain Python jobs that execute SQL over Snowflake to produce transaction, settlement, fee, and reconciliation datasets for internal and merchant-facing consumers
- Write performant, readable SQL: window functions, CTEs, incremental logic, and semi-structured (JSON/VARIANT) handling on large transaction tables
- Package jobs as Docker containers and run them on the existing scheduler; make every job idempotent, rerunnable, parameterized, and observable (logging, alerting on failure or bad output)
- Implement data-quality checks and reconciliation controls to ensure data is accurate and totals consistently align across sources and reporting periods.
- Keep an eye on Snowflake cost: warehouse sizing, clustering, query profiling, and avoiding wasteful scans
- Work with finance, operations, and product stakeholders to translate payments questions into correct, maintainable queries
- Apply security controls appropriate for a payments environment: secrets handling, least-privilege access, PII masking, audit trails
- Document the job library and contribute to code review, testing, and CI practices for the team
- Proactively explore and apply AI tools to improve efficiency across the development lifecycle (query authoring, testing, documentation)
Qualifications
- 1 - 3 years experience in data engineering, analytics engineering, or backend roles building SQL-heavy data workloads in production
- Strong SQL: window functions, CTEs, aggregation and joins over large tables, query tuning and reading execution plans
- Hands-on Snowflake experience: warehouses and credit/cost awareness, stages and COPY INTO, streams and tasks, time travel, VARIANT/semi-structured data; Snowpark or the Snowflake Python connector
- Solid Python for data work: pandas or Polars, parameterized SQL, configuration and secrets management, structured logging, error handling, unit tests
- Docker fundamentals: building images, running scheduled batch jobs in containers, debugging container failures
- Git and basic CI/CD habits; comfortable with code review and writing testable, rerunnable jobs
- Attention to numerical correctness: you notice when totals do not tie out and you dig until you know why
Nice to have
- Payments domain knowledge: authorization, capture, settlement, refunds, chargebacks, interchange and scheme fees, merchant and acquirer data models, reconciliation
- Orchestration and transformation tooling: Airflow, Prefect, Dagster, dbt
- AWS from the developer side: S3, IAM, Secrets Manager, ECS/Fargate scheduled tasks
- Data-quality frameworks (Great Expectations, dbt tests, Soda) and pipeline monitoring/alerting
- Experience in a PCI or otherwise regulated environment
- Exposure to BI tools consuming the outputs (Sigma, Tableau, Power BI, Looker)
We are an Equal Opportunity Employer and do not discriminate against any employee or applicant for employment because of race, color, sex, age, national origin, religion, sexual orientation, gender identity and/or expression, status as a veteran, and basis of disability or any other federal, state or local protected class.
About Us
WELCOME TO THE FUTURE OF COMMERCE
About Shift4
Shift4 (NYSE: FOUR) powers the experience economy, enabling businesses to deliver the moments that matter. Transforming how people shop, dine, stay, and play, Shift4’s commerce technology allows for a seamless experience at any scale. From your neighborhood restaurant to the world’s largest event venues, Shift4 handles billions of transactions annually for hundreds of thousands of businesses around the world. For more information, visit shift4.com.
About Global Blue
Global Blue by Shift4 is the industry leader in Tax Free Shopping solutions, simplifying the tax refund process for international travelers and driving revenue for retailers through a fully integrated commerce experience. As a business partner for the shopping journey, we seamlessly connect shoppers and brands worldwide, powering over 40 million transactions each year. For more information, please visit globalblue.com and shift4.com.
A Global Leader in Financial Technology
75+
Countries
$300+
Billion Processed Annually
300,000+
Customers
1,200+
Technology Integrations
5+ Billion
Annual Transactions
100+
Payment Methods
Our Executive Team
Shift4's experienced senior leadership team helps us push the boundaries of commerce innovation.
Social Responsibility
Shift4Cares
We take corporate social responsibility seriously and strive to make a positive impact on the world around us. The Shift4 team is committed to making a difference in our local communities through volunteerism and other charitable contributions.
Join the Shift4 Family
Our people are our greatest asset, and we’re always looking for driven and innovative individuals to join our fast-growing team.
Click on the link above to learn more about our company culture and view open positions.