Machine Learning Engineer | LLM / AI Agents / MLOps | Business-Level English Required
Location: Tokyo, Japan
Working Style: Hybrid / Remote Available
Employment Type: Full-time
Annual Salary: ¥7,000,000 – ¥15,000,000
We are currently recruiting an experienced Machine Learning Engineer for a global technology company developing AI-powered products and services.
This position involves working with engineering teams in Japan, the US, and Europe to design and implement machine learning systems, LLM applications, and autonomous AI agents.
⚠️ IMPORTANT: Please carefully review the mandatory requirements below before applying. Candidates who do not meet the required qualifications may not be considered.
REQUIRED QUALIFICATIONS — MUST HAVE:
1. Professional Experience
- 3+ years of professional experience in Machine Learning and/or Backend Development
- Must be able to independently understand and develop within a large-scale Python codebase
2. Strong Technical Experience — At Least ONE Required
You must have practical, hands-on experience in at least one of the following areas:
A. LLM / AI Agent Development
- LLM orchestration
- Structured Outputs
- Tool Use
- Agent Workflows
- AI Agent development
OR
B. Machine Learning Pipelines
- ML pipelines using tabular data
- Feature engineering
- Ranking models / Learning-to-Rank (LTR)
- Model evaluation
OR
C. DevOps / MLOps
- Modern DevOps / MLOps environments
- Docker
- pytest
- CI/CD pipelines
- Model development / deployment / monitoring
3. Academic Background
Bachelor's or Master's degree in one of the following:
- Computer Science
- Data Science
- Mathematics
- Statistics
OR equivalent knowledge and professional experience.
4. English — REQUIRED
Business-level English is mandatory.
You must be able to communicate effectively in:
- Speaking
- Reading
- Writing
The position requires regular collaboration with English-speaking engineering teams in the US and Europe, so English communication is an essential requirement.
Japanese — NOT MANDATORY:
Japanese ability is preferred but not required.
Conversational-level Japanese in speaking, reading, and writing is considered a plus.
MAIN RESPONSIBILITIES:
As a Machine Learning Engineer, you will:
- Design and implement autonomous AI agents using predictive and generative models
- Develop AI/ML products together with international engineering teams
- Select, design, and evaluate LLM solutions using multiple providers such as OpenAI, Anthropic, and Google
- Develop LLM orchestration and AI Agent workflows
- Build and improve MLOps pipelines, including CI/CD, model training, monitoring, and version management
- Optimize ML inference performance and system scalability
- Design and implement LLM fine-tuning and training processes
- Research new technologies and approaches in Machine Learning, LLMs, and MLOps
- Work on Japanese-language NLP, including preprocessing, text chunking, data quality evaluation, and accuracy improvement
- Contribute to search, recommendation, matching, and AI-powered research automation
The exact scope of responsibility will be determined according to your experience and interests.
TECHNOLOGY STACK:
Programming:
Python, SQL
AI / ML / LLM:
Azure OpenAI, Gemini, Anthropic, LangChain, LangGraph, Scikit-learn, Transformers
Backend:
FastAPI, Streamlit, SQLAlchemy
Data / Search:
Azure Cognitive Search, Elasticsearch, Redis, Cosmos DB, PostgreSQL
Infrastructure / DevOps:
Docker, Kubernetes, Azure Functions, Azure DevOps
GLOBAL WORKING ENVIRONMENT:
You will work closely with engineering teams based in Japan, the US, and Europe.
Because this is a cross-border development environment, approximately 2–3 early-morning or evening online meetings per week may be required to accommodate international time zones.
SALARY:
¥7,000,000 – ¥15,000,000 per year
Monthly salary:
¥538,000 – ¥993,000
Final compensation will be determined based on skills, experience, and capabilities.
Salary is reviewed twice a year.
WORKING STYLE:
Remote work is available.
- Hybrid / remote working
- At least 1 day per week of office attendance is required
- Tokyo office
- Office and remote frequency may change according to company policy
WORKING HOURS:
Depending on experience, skills, responsibilities, and the applicable company system:
Standard working hours:
10:00–19:00
8 hours working time + 1 hour break
or
Discretionary Working System:
8-hour deemed working time + 1-hour break
BENEFITS:
- 127 annual holidays
- Saturdays, Sundays and public holidays off
- Year-end / New Year holidays
- Paid annual leave from 3 months after joining
- Up to 5 consecutive days of self-development leave once per year
- Commuting allowance
- Relocation support for candidates moving from outside the area
- Company housing support
- External seminar support
- Book purchase support
- Learning and development support
- Health checkup support
- Employee activity / club support
- Side jobs permitted with prior approval
- Casual dress
IDEAL CANDIDATE:
We are particularly looking for candidates who:
- Have strong professional experience in Machine Learning and/or Backend Engineering
- Can independently work with a large-scale Python codebase
- Have hands-on experience with LLM/AI Agents, ML pipelines, or MLOps/DevOps
- Have strong business-level English communication skills
- Are comfortable working with international engineering teams
- Have a strong interest in rapidly evolving AI/ML technologies
- Can take ownership from technical problem definition through implementation and improvement
⚠️ BEFORE APPLYING:
Please apply only if you meet the mandatory requirements, particularly:
✅ 3+ years professional ML / Backend experience
✅ Strong Python development experience
✅ Hands-on experience in at least ONE of:
• LLM orchestration / AI Agents
• ML pipelines / ranking / model evaluation
• DevOps / MLOps / CI/CD
✅ Bachelor's / Master's degree in a relevant field or equivalent knowledge/experience
✅ Business-level English — Speaking, Reading & Writing
Japanese is not mandatory, basic conversation is OK
If you meet the above requirements, please submit your CV/resume for consideration.