Data Engineer (Scala/Spark/Java) (2 positions)

Job ID 21113
Job Type
Skillhouse Contract
Salary
650,000 ~ 800,000 JPY
Japanese Level
Intermediate (JLPT Level 3)
English Level
Advanced (TOEIC 860)
Start Date
ASAP
Location
Tokyo
Job Type
Skillhouse Contract
Salary
650,000 ~ 800,000 JPY
Japanese Level
Intermediate (JLPT Level 3)
English Level
Advanced (TOEIC 860)
Start Date
ASAP
Location
Tokyo

Description

A Fortune 500 Global Insurance company is looking for a talented Data Engineer (Scala/Spark/Java).

 

Responsibilities

-Collaborate with users and project team on requirements and expectations

-Analyze business requirements, and create proper data solutions that meet functional and non-functional requirements

-Define the data architecture, structure, storage, and security model of data in HDFS, Hive, HBase, Solr, RestAPI

-Design and implement highly scalable data pipelines in Scala/Spark/Java for processing extremely large amounts of data

-Create and maintain reusable frameworks for data ingestion, validation, normalization, and transformation

 

 

【Company Details】
A U.S.-headquartered insurance company with offices in major cities around the world and a 40+ year history in Japan. The company focuses on creating a diverse environment, including the promotion of women, and supports their career development in Japan and abroad.

 

【Working Hours】
9:00 - 18:00(Mon - Fri)

*Hybrid (3days Work from Office / 2days Work from Home)

 

【Holidays】
Saturday, Sunday, and National Holidays, Year-end and New Year Holidays, Paid Holidays, and Other Special Holidays

 

【Services / Benefits】
Social insurance, Transportation Fee, No smoking indoors allowed (Designated smoking area), etc.

 

Required Skills

-Working experience as developer or data engineer

-Solid knowledge and experience of Hadoop ecosystem: HDFS, Hive, HBase, Phoenix, Solr, Oozie, Impala, Knox,

-Zookeeper, YARN, Spark, Livy, HUE, Zeppelin

-Strong programming skills in Scala and Spark

-Strong capabilities in designing Database schemas on data platform