Data Engineer

Data Engineer Our goal is to democratize data by building a self-service data platform. We strive to empower our internal teams with the ability to access, understand, and generate valuable insights from data. Apply now! At SWAG Live's data team, our goal is to democratize data by building a self-service data platform. We strive to empower our internal teams with the ability to access, understand, and generate valuable insights from data. In this role, you'll help develop data-driven decision-making tools for various stakeholders. These stakeholders may include software engineers, data analysts, and data scientists, among others. Your work will focus on building a unified data platform, aligning with SWAG Live's data mesh vision. Responsibilities Design, develop, and support pipelines and reporting warehouses to solve business, operations, and product problems. Query optimization, schema design, and ELT/ETL pipelining. Stream processing in event-driven architectures. Collaborate with product and business stakeholders to ensure our data infrastructure meets the constantly evolving requirements. Build developer tools to better support data scientists and data analysts. Requirements Proficient in Python and SQL. In-depth knowledge for transactional DB and data warehouses. Hands-on experience in query optimization and schema design. Fundamental understanding of analytical data modeling (dbt). Sufficient experience with one of the popular orchestration frameworks (airflow , kubeflow , dagster , prefect, argo). Experience in stream processing (apache spark, apache beam, kafka , flink). A self-directed learning mentality. Comfortable working in an English-speaking environment. Good to have Basic knowledge (or interest) in common machine learning algorithms. Have hands-on DevOps experience and value DevEx, especially focusing on GitOps. Proficiency in the software development lifecycle and system design, particularly pertaining to data architecture. 部門 Engineering - Data 職位 Data Engineer 地點 臺北 遠端狀態 混合 關於SWAG SWAG 創立於 2016 年 8 月，最初的產品構想，是要打造一個能串連網紅創作者及用戶的 PGC 流量變現的平台，讓粉絲可以無時無刻的與心儀的網紅互動、讓網紅可以透過人氣實現獲利。 透過豐富多元的內容及強大的行銷推廣，目前平台有超過 400 萬註冊用戶及數千位內容提供者，用戶遍及臺灣、香港、澳門、新加坡、馬來西亞及歐美等，並獲得數十位 YouTuber 網紅大力推薦；成為亞洲最大的影音串流平台。 號 官方在 2018 上半年開啟了 swag.live ，使用者可以透過網頁直接開啟 SWAG，並陸續加入了直播、一對一私訊聊天以及影片解鎖等新功能。 如今 SWAG 定位為亞洲最大的影音串流社交平台，並且持續的拓展國際市場。