Senior Python Data Engineer (Streaming & IoT) - Fluent in English & Vietnamese

Senior Python Data Engineer | Remote | Longterm project | Global client

Overview: We are looking for a Senior Python Data Engineer to join our team for a long-term engagement with an international client. You will join an AI platform project that collects real-time data from sensors and PLCs at industrial and water-treatment plants, then uses AI to detect anomalies, predict maintenance, optimise chemical dosing and prove the cost savings to plant owners. You will own the backend & data platform behind it, from the first PLC signal to the prediction an operator acts on.

• Working hours: Monday - Friday, 8:30am - 5:30pm (1-hour lunch break included) - GMT+7 (Vietnam time)
• Location: Remote - Vietnam
• Expected starting date: ASAP

I. What You'll Do

• Backend services and APIs: design and build Python services and APIs that take in plant data and serve predictions, insights and actions to the product
• Streaming pipelines: build and run pipelines on Kafka and Flink, with event-time processing, late and out-of-order data, and joins across data that arrives at very different rates (every second, every 30 minutes, every 2 hours, days later)
• Data quality: set up data contracts and a schema registry. Build sensor validation from basic checks (range, flatline, rate of change) to physics-based checks (mass and flow balances). Quarantine bad data instead of deleting it
• Storage: design TimescaleDB hypertables, continuous aggregates, compression and retention; Redis for real-time views; Parquet object storage for training data, replay and audits
• Data for AI/ML: make plant data reliable for physics models, optimisation and ML. Build incident replay and data lineage so every AI recommendation can be reproduced (MLflow, Airflow, OpenLineage)
• Observability and scale: monitor data freshness, completeness and drift; keep queries and schemas fast as data volumes and sites grow
• Testing: write contract tests, replay tests and outage tests
• AI-first engineering: use AI coding tools and agents every day to design, write, test and review code. Write machine-readable specs (schemas, templates, rule catalogues) that agents can build from
• Team: join design and code reviews, including AI-generated code, and mentor other engineers

II. Requirements

Background & Experience

• Degree in Computer Science or a related field, or equivalent experience
• Fluent in English & Vietnamese, both verbal & written form
• 6+ years building backend systems in a business environment, including 3+ years building & running production streaming or event-driven data pipelines (not only batch ETL)
• Experience modelling and querying time-series data
• A habit of building data-quality checks and tests into every pipeline
• Works well semi-autonomously in a fast-moving, distributed team

Technical skills

• Python (strong) and SQL (strong)
• PostgreSQL: schema design, query analysis and optimisation
• Kafka: topics and partitioning, consumer groups, delivery guarantees, schema evolution
• Flink or an equivalent (Kafka Streams, Spark Structured Streaming): event time, watermarks, state, late-arriving data
• Optional: Java or another JVM language, or able to become productive in it quickly (Flink jobs and the OPC UA stack use it)
• API design (REST), Redis, Docker, Git
• AI coding tools used daily (Cursor, Claude Code, GitHub Copilot or similar), with real examples of how they changed your work, and good judgement on when to trust, check or throw away AI output

Preferred

• TimescaleDB or other time-series databases
• Industrial / IoT data: OPC UA, MQTT, Sparkplug B, Eclipse Milo or Tahu, PLCs, SCADA
• Software for air-gapped or regulated environments (semiconductor, critical infrastructure, defence)
• ML models in production, or building with LLMs and agents
• Feeding data to dashboards and visualisation tools

Apply Now:

• You can submit your application either on this job post or on our company website: https://gct-solutions.net/career/recruitment/sr-python-de 🔗
• Please carefully review the JD above. If the opportunity is a good fit for your skills & experience, kindly share your most up-to-date CV, clearly highlighting the relevant experience that aligns with the requirements

Contact point: Ms Trang - HR https://www.linkedin.com/in/trangphk/ 🔗

Thank you for your interest!