Spark Data Engineer (2 open positions)

Job ID 21445
Job Type
Skillhouse Contract
Salary
JPY 650,000 - JPY 750,000 per month
Japanese Level
None
English Level
Advanced (TOEIC 860)
Start Date
ASAP
Location
Tokyo
Job Type
Skillhouse Contract
Salary
JPY 650,000 - JPY 750,000 per month
Japanese Level
None
English Level
Advanced (TOEIC 860)
Start Date
ASAP
Location
Tokyo

Description

Fortune 500 Global Insurance company is looking for two (2) talented Spark Data Engineers with good experience working with Spark language, and large-scale data analytics.

 

Responsibilities

- Collaborate with users and project team on requirements and expectations

- Analyze business requirements, create proper data solutions that meets functional and non-functional requirements

- Design and implement highly scalable and robust data pipelines in Spark/Java for processing of extreme large amount of data

- Create and maintain reusable frameworks for data ingestion, validation, normalization, and transformation

- Create scripts for test automation, CI/CD, data migrations, data validations

- Provide technical support for incident recovery

 

 

【Company Details】
A U.S.-headquartered insurance company with offices in major cities around the world and a 40+ year history in Japan. The company focuses on creating a diverse environment, including the promotion of women, and supports their career development in Japan and abroad.

 

【Working Hours】
9:00 - 18:00(Mon - Fri)

*Hybrid (2 days Work from Home per week)

 

【Holidays】
Saturday, Sunday, and National Holidays, Year-end and New Year Holidays, Paid Holidays, and Other Special Holidays

 

【Services / Benefits】
Social insurance, Transportation Fee, No smoking indoors allowed (Designated smoking area), etc.

Required Skills

- 3 years of working experience as a developer or data engineer

- Strong programming skills and software development experience in Java or Python

- Deep understanding of distributed systems (Spark) and its optimization

- Experience in public cloud technologies, preferably Azure

- Good knowledge of Oracle database, MS-SQL Server, Linux, networking

- Proficient in SQL, shell scripting, git, unit testing, CI/CD tools

- Understanding of design principles, coding standards and best practices

- Strong learning ability and problem-solving skills