ITtude logo

Sr ML Engineer - Remote

Hiring from
North Macedonia
Work type
Remote
Posted
Is this job info correct?

551,506 remote jobs, straight from company career pages

100% free · New jobs every hour

Show job description

We are looking for a senior-level AI/ML professional to lead the productionization, deployment, and continuous optimization of ML systems in mission-critical environments. This role requires strong technical leadership, deep hands-on experience shipping models to production, and the ability to drive reliability, scalability, and cost/performance trade-offs end-to-end. The ideal candidate combines strong ML depth with MLOps and production engineering excellence, and can operate autonomously while influencing architecture and best practices across teams.

Key Qualifications

● Master’s, PhD, or equivalent experience in Computer Science, Engineering, Data Science (or related), with strong foundations in mathematics, statistics, and ML.

● 6+ years (or equivalent) experience across ML engineering and MLOps /production ML, with a proven track record delivering high-impact systems in production.

● Demonstrated expertise deploying models to production: scalable serving patterns, model packaging, inference optimization, observability, and safe rollout strategies.

● Strong experience with model performance and efficiency optimization: latency/throughput tuning, batching, quantization, ONNX/TensorRT, GPU/CPU optimization, memory and cost tuning.

● Strong proficiency in Python.

● Hands-on experience with ML frameworks such as PyTorch, scikit-learn, and optimization/runtime stacks like ONNX, TensorRT.

● Strong grasp of CI/CD for ML (e.g., GitLab CI), containerization (Docker), and reproducible workflows.

● Experience with monitoring and reliability: metrics/logging/tracing, model/data drift, alerting, SLOs, incident response practices.

● Kubernetes, AWS, FastAPI (and/or similar Python serving frameworks), SageMaker, service meshes, feature stores, model registries.

Key Responsibilities

● Handle the production lifecycle of ML systems: training, packaging, deployment, monitoring and controlled rollouts.

● Design, build, and continuously improve training and retraining pipelines (data ingestion, labeling/QA loops, feature generation, experiment tracking,

reproducibility).

● Build and improve high-performance inference services and deployment patterns.

● Drive inference optimization (ONNX/TensorRT, quantization, batching, GPU/CPU tuning) with measurable latency/cost improvements.

● Partner with DevOps/SRE to ensure operational excellence: scaling, reliability, incident readiness, observability, and alerting.

● Own model versioning, CI/CD, and release workflows ensuring reproducibility and safe delivery to production.

● Strengthen data & model monitoring (performance, drift, quality) and implement feedback loops for continuous improvement.

● Communicate results and trade-offs to stakeholders, turning technical outcomes into business value.

● Ensure model quality through rigorous evaluation and production-grade validation aligned with evolving data and business needs.

Similar jobs