Machine Learning Engineer (LLM Product Development & MLOps) | Fully Remote in Japan | ¥6M–¥15M

Machine Learning Engineer – LLM Product Development & MLOps

Location: Japan (Fully Remote Available)

Salary: JPY 6,000,000 – 15,000,000 per year

Employment Type: Full-time, Permanent

Work Style: Fully Remote / Flexible Working Hours

About the Opportunity

We are recruiting a Machine Learning Engineer for a rapidly growing AI technology company in Japan specializing in Large Language Models (LLMs), generative AI, and enterprise AI solutions.

In this role, you will develop cutting-edge AI-powered products, integrate advanced machine learning models into production systems, and design scalable MLOps infrastructure.

You will work closely with product managers and software engineers to turn emerging AI technologies into practical, high-impact solutions.

Key Responsibilities

LLM Product Development

• Design, develop, and deploy AI-powered features using LLMs and machine learning technologies.
• Integrate and optimize proprietary and open-source models.
• Improve model inference speed, accuracy, and efficiency.
• Develop new features based on user feedback and product performance metrics.

Machine Learning Engineering

• Build internal libraries and tools for ML-powered product development.
• Develop efficient workflows for deploying machine learning models into production.
• Optimize existing codebases and improve system architecture.
• Provide technical guidance to engineering teams.

MLOps & Infrastructure

• Design and maintain scalable, highly available LLM inference infrastructure.
• Implement model monitoring and performance evaluation systems.
• Establish best practices for production ML operations.
• Improve the reliability, scalability, and efficiency of ML systems.

Technical Environment

• Programming: Python
• Cloud: Google Cloud, AWS, Azure
• Infrastructure: Terraform
• CI/CD: GitHub Actions, Argo CD
• Middleware: OpenSearch
• AI Development Tools: Claude Code, Devin
• Collaboration: GitHub, Slack, Notion

Required Qualifications

• At least 2 years of professional experience developing and operating machine learning services as part of a team.
• Experience developing and operating applications on cloud platforms such as AWS or GCP.
• Technical expertise in at least one of the following:
• Machine Learning
• Natural Language Processing (NLP)
• Computer Vision
• Speech Recognition
• Business-level to native-level Japanese communication skills, including the ability to evaluate the quality and naturalness of AI-generated Japanese text.

Preferred Qualifications

• Experience developing ML-driven SaaS products.
• Experience building AI products from the ground up (0-to-1 development).
• Experience using LLM APIs, including OpenAI.
• Contributions to open-source projects such as PyTorch or Transformers.
• Strong performance in machine learning competitions such as Kaggle.
• Experience building high-performance computing infrastructure.

Compensation & Benefits

• Annual salary: JPY 6,000,000 – 15,000,000, depending on experience and qualifications.
• Stock option program.
• Fully remote work from anywhere in Japan.
• Super-flexible working hours with no core hours.
• Side jobs and freelance work permitted with prior approval.
• Access to advanced AI development tools.
• Professional development and learning opportunities.
• Company-sponsored technical books and learning resources.
• Full social insurance coverage.
• Paid annual leave and parental leave.
• Weekends and Japanese national holidays off.
• Approximately 120 annual holidays.

Why Join?

• Work on cutting-edge LLM and generative AI technologies.
• Build real-world AI products used by enterprise customers.
• Take ownership of the entire ML development lifecycle, from research and experimentation to deployment and operation.
• Work in an engineering environment that actively adopts advanced AI development tools.
• Enjoy a highly flexible working environment with opportunities for technical growth and innovation.

Application

If you are passionate about machine learning, LLMs, and building scalable AI products, we would love to hear from you.

Please apply with your updated resume and, if available, a GitHub profile or technical portfolio.

Recruitment Partner: United World Inc.