Hadoop Data Engineer (2 open positions)

Job ID 21446
Job Type
Skillhouse Contract
Salary
JPY 650,000 - JPY 750,000 per month
Japanese Level
None
English Level
Advanced (TOEIC 860)
Start Date
ASAP
Location
Tokyo
Job Type
Skillhouse Contract
Salary
JPY 650,000 - JPY 750,000 per month
Japanese Level
None
English Level
Advanced (TOEIC 860)
Start Date
ASAP
Location
Tokyo

Description

A Fortune 500 Global Insurance company is looking for two (2) talented Hadoop Data Engineers with good experience working with Python or Java language, and large-scale data analytics—understanding of distributed computing systems.

 

Responsibilities

- Collaborate with users and project team on requirements and expectations

- Analyze business requirements, create proper data solutions that meets functional and non-functional requirements

- Design and implement highly scalable and robust data pipelines in Python/Java for processing of extreme large amount of data

- Create and maintain reusable frameworks for data ingestion, validation, normalization, and transformation

- Create scripts for test automation, CI/CD, data migrations, data validations

- Provide technical support for incident recovery

 

 

【Company Details】
A U.S.-headquartered insurance company with offices in major cities around the world and a 40+ year history in Japan. The company focuses on creating a diverse environment, including the promotion of women, and supports their career development in Japan and abroad.

 

【Working Hours】
9:00 - 18:00(Mon - Fri)

*Hybrid (2 days Work from Home per week)

 

【Holidays】
Saturday, Sunday, and National Holidays, Year-end and New Year Holidays, Paid Holidays, and Other Special Holidays

 

【Services / Benefits】
Social insurance, Transportation Fee, No smoking indoors allowed (Designated smoking area), etc.

Required Skills

- 3 years of working experience as a developer or data engineer

- Strong programming skills and software development experience in Java or Python

- Deep understanding of distributed systems (Hadoop) and its optimization

- Experience in public cloud technologies, preferably Azure

- Good knowledge of Oracle database, MS-SQL Server, Linux, and networking

- Proficient in SQL, shell scripting, git, unit testing, CI/CD tools

- Understanding of design principles, coding standards and best practices

- Excellent communication, presentation, and interpersonal skills