Senior Data Platform Engineer (Databricks: 8173)
Senior Data Platform Engineer (Databricks: 8173)
Job type:
Haken
Specialization:
Infrastructure
Language Level:
Japanese Level - None,English Level - Advanced (TOEIC 860)
Location:
Setagaya-ku
Salary:
0.00
Job Reference:
501319
A Global IT Service firm is seeking an experienced Senior Data Platform Engineer to join the Analytics Division
This role is responsible for building, operating, and evolving the Databricks-based data platform that supports hundreds of analysts, data scientists, and product teams across the company.
Beyond day-to-day operations, this individual will help define platform standards, drive infrastructure automation, establish governance frameworks, and enable self-service capabilities across a multi-tenant data environment.
Responsibilities:
- Manage and operate Databricks at scale across multiple workspaces and environments on GCP, ensuring high availability, performance, and cost efficiency
- Design and implement multi-tenant Databricks architectures, defining workspace isolation strategies, access controls, and resource governance policies that serve diverse teams without compromising security or performance
- Automate platform operations using Infrastructure-as-Code (Terraform or equivalent) and CI/CD pipelines — from workspace provisioning and configuration to cluster lifecycle management and policy enforcement
- Own the workspace creation and onboarding process, building self-service workflows that allow teams to spin up compliant, production-ready environments with minimal friction
- Define and enforce platform best practices covering cluster configuration, Unity Catalog governance, cost tagging, compute policies, and data access patterns
- Drive SRE principles across the platform: define SLOs/SLAs, build observability stacks (logging, alerting, dashboards), conduct incident response, and lead post-mortems to continuously improve reliability
- Collaborate with stakeholders from data science, analytics, security, and product engineering teams — acting as the go-to platform expert and translating technical constraints into business-friendly guidance
- Communicate status and roadmap to senior management through clear written reports, dashboards, and regular syncs — presenting platform health, risk areas, and upcoming initiatives in a concise and actionable way
- Leverage AI tools actively in day-to-day engineering work — using code generation, documentation assistance, and intelligent automation to move faster and reduce toil
Required skills:
- 5+ years of experience in data engineering or platform/infrastructure engineering, with at least 1 year in a role with SRE or DevOps responsibilities
- Hands-on Databricks expertise: workspace management, cluster policies, job orchestration, Unity Catalog, and Databricks administration at a multi-team or enterprise scale
- Cloud platform proficiency on GCP (or AWS/Azure with clear willingness to transition) — including IAM, VPC/networking, GCS, BigQuery, and cloud cost management
- Infrastructure-as-Code experience with Terraform or equivalent tools applied to Databricks and cloud resource provisioning
- Strong scripting and automation skills in Python and/or Bash/Shell — ability to build robust automation pipelines and operational tooling from scratch
- CI/CD pipeline experience with tools such as GitHub Actions, GitLab CI, or Cloud Build — with the ability to integrate IaC deployments into automated workflows
- Solid understanding of data platform security: workspace isolation, network policies, secrets management, RBAC, and audit logging
- Proven ability to communicate technical topics to non-technical stakeholders, including written status updates and incident summaries
- Comfortable using AI-assisted development tools (e.g. GitHub Copilot, ChatGPT, Claude) as a standard part of the engineering workflow — not just occasionally, but as a productivity multiplier
Why should you apply:
- This is a long-term opportunity with a chance to become a permanent employee
- You will be working with international team members
- Free breakfast, lunch and dinner at the cafeteria
Company Details:
A global company with a strong presence in multiple business areas. It has achieved sustained growth both domestically and internationally, including in the U.S. and Europe. The company boasts a diverse and international environment and is committed to equal opportunity, offering a wealth of career opportunities. Due to the diverse nature of our business, we handle a wide range of technologies! You can also choose the environment you are most comfortable with, such as Windows/Mac! Meals in the company cafeteria are also free. Our chefs are always coming up with new menu items, so you can enjoy your meal without getting bored!
Working hours: 9:00 - 17:30 (Mon-Fri)
Working Style: Hybrid (4 days in office, 1 day work from home)
Holidays: Saturday, Sunday, and National Holidays, Year-end and New Year Holidays, Paid Holidays, Other Special Holidays
Services/Benefits: Social insurance, DC Pension Plan, Transportation Fee, Skillhouse University, Test payback system, and more
Share this job
