スキルハウスの採用情報
DataOps Engineer （ PSR-8406)
役職：
DataOps Engineer （ PSR-8406)
雇用形態:
Haken
給与:
勤務時間:
English Level - Advanced (TOEIC 860), Japanese Level - None
職務内容
A Global IT Service firm is looking for DataOps Engineer for The Data Platform Department.
This department develops and maintains a comprehensive data platform, empowering over 70 services with solutions for data ingestion, discovery, governance, analytics, and querying.
In this role you will work closely with BU data engineering teams, platform leads, and governance stakeholders to define engineering standards, build reusable CI/CD templates, and drive the self-service data platform adoption across 70+ business units.
Responsibilities:
- Lead the design and implementation of standardised pipeline templates for multi-cloud data ingestion, transformation, and delivery (GCP BigQuery / Dataflow and Azure Databricks)
- Build and maintain CI/CD standards and tooling (GitHub Actions / Cloud Build) used across BU data engineering teams
- Implement automated testing, validation, and rollback frameworks to enforce SLA and quality gates at the pipeline level
- Lead BU onboarding to the data platform (target: 8-week SLA), providing technical guidance and runbook documentation
- Drive adoption of Open Table Format (OTF / Apache Iceberg) as the group-wide storage standard across BU workloads
- Operate and improve Apache Airflow orchestration environments; define DAG standards, dependency graphs, and alerting
- Partner with the Data Governance team to enforce metadata and lineage capture at pipeline runtime
- Mentor junior DataOps Engineers and contribute to the team engineering knowledge base — runbooks, ADRs, and onboarding guides
Required Skills:
- Proficient in DataOps or data platform engineering, including CI/CD for data pipelines
- Proficient with GCP data services including BigQuery, Dataflow, Cloud Composer, and Pub/Sub
- Proficient with Azure data services including Databricks, Azure Data Factory, and Azure Data Lake Storage
- Proficient with Apache Spark for large-scale distributed data processing
- Proficient in Python for pipeline scripting, data transformation, and automation
- Proficient with Apache Airflow — DAG design, scheduling, backfill strategy, and SLA monitoring
- Proficient with CI/CD automation tools such as GitHub Actions, Cloud Build, or Jenkins
- Proficient with infrastructure-as-code tools such as Terraform
- Proficient in SQL (BigQuery SQL / SparkSQL / ANSI SQL)
Why should you apply:
- Global business
- You will be working with international team members
- Free breakfast, lunch and dinner at the cafeteria
Company Overview:
This is a global company with a strong presence in multiple business sectors. It has achieved sustained growth both domestically and internationally, including in the U.S. and Europe. The company prides itself on its diverse and international environment, providing ample career opportunities and a commitment to equal opportunity. With a wide range of business activities, the company also works with various technologies. You can choose your preferred working environment, whether Windows or Mac! Meals at the employee cafeteria are free, and the chef regularly comes up with new menus, ensuring you never get bored of the meals!
Work Hours : 9:00 AM – 5:30 PM (Flextime or staggered working hours possible)
Work Style : Hybrid (Typically 4 days in the office, 1 day working from home)
Holidays : Saturdays, Sundays, public holidays, New Year holidays, paid leave, bereavement leave, and other special leave
Benefits: Full social insurance (employee pension insurance, health insurance, worker’s accident compensation insurance, unemployment insurance), DC pension plan, transportation allowance, childcare and caregiving support, cafeteria, retirement benefit system, welfare services (Relo Club), health counseling services, relocation support (visa support, moving), employee discounts (moving, language classes, etc.), and more
Interview Process: 3~4 times
