Senior Data Engineer
- Hiring from
- Malaysia
- Work type
- Hybrid
- Posted
627,050 remote jobs, straight from company career pages
100% free · New jobs every minute
Show job descriptionHide job description
Billennium is a Polish IT Company that has been developing innovative services and products for over 20 years and provides the best outsourcing specialists.
We implement IT projects and services in Poland, APAC and other European Union countries. We currently hire over 1600 Specialists in the field of the latest business support solutions and have offices in Poland, Malaysia, India, Germany, Switzerland, Netherlands and Canada.
Join a constantly growing team that works on projects for clients in many industries, including a global leader in the pharmaceuticals industry.
You will work in an international, innovative, and engaging environment. You will be part of a highly motivated, dynamic, and fun-loving team that is never afraid of taking on new challenges.
Summary:
We build and operate Supply Chain data products on Snowflake, covering warehouse management (outbound delivery fulfilment, handling units, warehouse tasks, storage bins and stock) and transport (volume, cost, inbound, quality). Our pipelines ingest data from a mix of enterprise ERP, warehouse (WMS / EWM) and transport (TMS) systems, third-party logistics and carrier feeds, and operational spreadsheets, vault it (Data Vault 2.0), shape it into business marts, and expose it to analysts and BI dashboards.
Responsibilities:
- Design and maintain dbt transformations end-to-end: raw → vault → business vault → data marts.
- Own Snowflake objects: tables, views, streams, tasks, dynamic tables, stored procedures, warehouses.
- Build and evolve CI/CD pipelines (DataOps-style) and Airflow orchestration for ingestion, testing, deployment and observability.
- Write Python loaders, validators and small services (file / API / email / spreadsheet integrations).
- Apply data quality & observability practices: dbt tests, Monte Carlo monitors, audit logs, alerting.
- Manage schema evolution with Liquibase.
- Work directly with SMEs and analysts to translate fuzzy business questions into trustworthy data assets — and to call out gaps honestly when the data isn't there yet.
Requirements:
Must-have
- Analytical mindset & gap-analysis ability — the differentiator. You can take a vague business question, map it to the data that exists, and either deliver an answer or articulate clearly what is missing and what it would take to get it.
- Strong SQL (Snowflake preferred; solid ANSI SQL transfers fine). Comfortable with window functions, MERGE, QUALIFY, semi-structured data (VARIANT, LATERAL FLATTEN), and reading query profiles to tune performance.
Mid-to-senior Python:
- Pandas, snowflake-connector / SQLAlchemy, file & API integrations, packaging.
DBT:
- Models, tests, macros, seeds, snapshots, incremental strategies, common packages (dbt_utils, dbt_expectations, dbt_artifacts).
Git + CI/CD
- Confident reading and editing pipeline definitions; understands stages, artifacts, variables, runners. Any mainstream platform is fine (GitHub Actions, GitLab CI, Azure DevOps, etc.).
- Data modeling fundamentals for modern cloud warehouses (Snowflake, BigQuery, Redshift, etc.) — dimensional / mart design, grain, slowly changing dimensions, trade-offs around denormalization and clustering. Data Vault 2.0 is a plus, not required.
Benefits:
- Hybrid working arrangement.
- Flexible working hours
- Work-life balance
- Health insurance coverage (including spouse and children)
- Transport allowance
- Integration activity
- Opportunities for promotion (reviewed every year)
- Professional development
- Optical coverage reimbursement
- 14 annual leaves and additional 2 days of annual leave upon completion of every 1 year in Billennium.
If you're looking to advance your career in Data Engineer, don't miss out on applying for this role!