Bilingual AI Architect – GenAI & Machine Learning
Bilingual AI Architect – GenAI & Machine Learning
Job type:
Permanent
Specialization:
IT Consulting & Strategy
Language Level:
English Level - High Intermediate (TOEIC 730), Japanese Level - Advanced (JLPT Level 1)
Location:
Akasaka
Salary:
¥14,000,000.00 - ¥18,000,000.00 Yearly
Job Reference:
504600
A Global IT Service firm is looking for an experienced AI Architect to lead the design and delivery of enterprise AI solutions across Generative AI and traditional Machine Learning. This is a senior, hands-on architecture role combining technical leadership, solution design, engineering support, and client engagement. The successful candidate will work directly with customers to understand business challenges, translate requirements into scalable AI architectures, and guide engineering teams from PoC through to production deployment.
Responsibilities:
- Design end-to-end enterprise AI solutions using Generative AI, RAG, Agentic AI, and traditional Machine Learning
- Lead the architecture and production deployment of AI applications with a focus on scalability, performance, reliability, and cost
- Work directly with customers to understand business requirements and translate them into practical technical roadmaps
- Act as the technical lead for engineering teams, providing architecture guidance, code reviews, troubleshooting, and hands-on support
- Design and implement RAG architectures, AI agents, prompt workflows, context management, and memory strategies
- Establish evaluation frameworks to measure hallucination, relevance, faithfulness, accuracy, and overall AI performance
- Define guardrails and governance standards covering AI safety, data privacy, bias, security, and compliance
- Support technical presentations, solution proposals, and discussions with senior customer stakeholders
- Mentor engineers and help teams adopt AI engineering and MLOps / LLMOps best practices
Required skills:
- 13+ years of experience across software engineering, data science, machine learning, or related technical roles
- At least 3 years of hands-on Generative AI experience
- Proven experience deploying at least two GenAI applications into production environments
- Strong expertise with LLMs such as GPT, Claude, Llama, Gemini, or similar models
- Strong experience with RAG, prompt engineering, AI agents, context engineering, and fine-tuning approaches
- Hands-on experience with frameworks such as LangChain, LlamaIndex, CrewAI, LangGraph, or similar technologies
- Strong foundation in traditional Machine Learning including supervised / unsupervised learning, NLP, computer vision, or statistical modelling
- Experience with Vector Databases such as Pinecone, Weaviate, Milvus, FAISS, or similar
- Experience designing and operating MLOps / LLMOps pipelines
- Strong hands-on coding ability and willingness to support engineering teams directly
- Experience designing scalable enterprise applications and cloud-based AI solutions
- Strong client-facing and stakeholder-management skills
- Comfortable presenting complex AI solutions to both technical stakeholders and senior executives
Why should you apply:
- Join the company during its business expansion phase in Japan, with significant autonomy and the opportunity to make a meaningful impact on business and organizational development
- As an early member of the Japan organization, have the opportunity to help build the team and establish processes and governance from the ground up
- Work in a truly international environment, collaborating regularly not only with Japanese clients but also with global teams overseas
- Work on large-scale projects leveraging cutting-edge technologies, including AI, cloud, and digital transformation
- As the organization grows, enjoy broad career opportunities, from team management to business development and expansion
- Benefit from a flexible and highly autonomous working environment
- Full remote work may be considered, depending on the position and business requirements
Company Details:
A US-headquartered global IT services and digital engineering company that helps leading enterprises transform and modernize their technology environments. The company provides a broad range of technology solutions and services across AI and Generative AI, Cloud, Data & Analytics, Software & Product Engineering, Application Modernization, and Digital Transformation. With a strong global presence and an established international client base, the company is continuing to grow rapidly and expand its footprint in key markets.
As part of its continued international growth, our client is establishing and expanding its presence in the Japanese market. Japan represents a significant growth opportunity, particularly as local enterprises accelerate investment in AI, cloud, digital transformation, and technology modernization.
This expansion creates an exciting opportunity to join the organization at an early stage of its Japan growth journey. The current working environment is flexible and entrepreneurial, offering considerable scope for ownership, decision-making, and personal growth. Full work-from-home arrangements can also be considered, depending on the role and business requirements. This is an excellent opportunity for an experienced technology professional who is looking to take on broader responsibility, build and grow a team, work in a truly international environment, and play a key role in establishing and scaling a growing business in Japan.
Working Hours: 9:00 – 18:00 (Mon-Fri)
Working Style: One day per week in office
Holidays: Two days off per week (Saturdays, Sundays, and holidays), Paid vacation, New Year's holiday, special leave, summer vacation
Services/Benefits: Social insurance, Transportation Fee, No smoking indoors allowed (Designated smoking area), etc.



