Company Description
VinSmart Future (VSF) is the leading technology company within the Vingroup Corporation, formed by the merger of the group's entire technology ecosystem, including VinApp, VinIT, VinBigdata, and other tech units. As a core driver of Vingroup's future growth, VSF is at the forefront of technological development, with artificial intelligence (AI) as its foundation. With a talented team of nearly 4,000 local and international technology experts, VSF focuses on creating high-utility technologies that enhance lives and connect data, models, and infrastructure to unlock new possibilities.
Role Overview
The Senior Data Engineer is responsible for leading the technical design and implementation of complex streaming pipelines while establishing the foundation of the data platform, including graph databases and vector databases, to support AI and detection products.
Key Responsibilities
• Design and implement end-to-end streaming pipelines (Kafka → Flink → sink) for real-time use cases such as URL Phishing Detection and Phone Scam Detection.
• Design Change Data Capture (CDC) mechanisms from database sources (Debezium or equivalent) to ensure data accuracy, completeness, and low latency.
• Design schemas and data models for graph databases to support fraud detection through relationship networks (e.g., user–device–scammer relationships and social graphs).
• Design and optimize vector databases, including embedding storage and similarity search, to support ML/NLP models such as rule matching, ONNX serving, and semantic search.
• Lead the design of the data platform architecture, including Lambda/Kappa hybrid architecture and Medallion Architecture (raw → clean → serving).
• Review architecture and ensure data pipelines meet SLA requirements for throughput and latency, while solving complex technical challenges such as Flink state management, exactly-once processing, and backpressure handling.
• Mentor Middle Data Engineers and establish best practices for code quality and pipeline development.
• Work closely with the Team Lead to define the technical roadmap for the Data Engineering domain.
Key Requirements
• 6+ years of experience in Data Engineering, including hands-on experience with streaming technologies such as Kafka, Flink, or Spark Streaming.
• Experience designing and operating CDC pipelines using Debezium, Kafka Connect, or equivalent technologies.
• Hands-on experience with at least one graph database (Neo4j, JanusGraph, TigerGraph, or equivalent), with a strong understanding of graph data modeling.
• Experience working with vector databases (Milvus, Qdrant, Weaviate, pgvector, or equivalent) and embedding pipelines.
• Strong proficiency in SQL and Python or Scala, with deep knowledge of data partitioning and large-scale data processing optimization.
• Experience designing data platform architectures, not limited to developing individual data pipelines.
Preferred Qualifications
• Experience with ONNX Runtime serving or model serving pipelines.
• Experience building fraud detection, phishing detection, or spam detection systems.
• Familiarity with StarRocks, ClickHouse, dbt, and MinIO (object storage for data lakes).
Benefits
• Attractive compensation and bonus packages, highly competitive in the market.
• Exclusive employee benefits across the Group’s ecosystem in accordance with company policies.
• Opportunity to work on large-scale and strategic technology projects.
• Professional technology environment with leading scientists, experts, and engineers from top technology companies in Vietnam and around the world.
• Free access to learning platforms such as Udemy, Coursera, and O’Reilly; internal workshops; sponsorship for professional certifications; and exclusive mentoring programs from the Group and Company leadership team.
• Full statutory insurance coverage in accordance with Vietnamese Labor Law (Social Insurance, Health Insurance, Unemployment Insurance), along with private healthcare insurance based on job grade and annual health check-ups at reputable hospitals and healthcare centers nationwide.
• Participation in internal activities, team-building programs, and annual company events.
Working hours Flexible check-in 8:30 AM - 9:30 AM & check-out 5:45 PM - 6:45 PM (Monday - Friday & 2 remote Saturdays/month.)
Vehicle Data Analysis Senior Engineer
VinFast
Singapore Client - Senior Data Engineer - Remote Job
Talex - Talent Pool
Senior Data Engineer
LEAD Consulting
Senior Software Engineer - Backend, Data Platform & Financial Systems
Qode
Data Engineer (Databricks)
Legacy
VN Technology Software Engineer for CAD/3D Data
Caddi