IT Data Engineer

Job Type
Permanent
Salary
7,000,000 JPY - 8,000,000 JPY per year (negotiable based on experience)
Japanese Level
None
English Level
Advanced (TOEIC 860)
Start Date
ASAP
Location
Tokyo

Description

A famous global insurance firm has embarked on an exciting journey of Digital Transformation to meet their aggressive business ambitions, are currently hiring an IT Data Engineer. Within the IT Data Lake team, the data engineers will work closely with other IT teams, data scientists and business users to ensure the realization of data driven applications.

【Main Responsibilities】
‐Design solutions to collect data (batch/real time) from various sources
‐Design and develop ETL-like processes to clean raw data and prepare “big data” sets
‐Data modeling into the data lake
‐Ensure the integration of workflows in the current eco-system
‐Build effective working relationship with key business users and other IT team members
‐Own and keep the system design and operations documents up to date
‐Provide technical support for production issues when needed and resolve them with minimum business impact

Required Skills

‐Knowledge of Agile project development life cycle
‐Experience of functional programming
‐Experience of ETL flows development and data warehousing
‐SQL
‐Python

Preferred Skills

‐Experience of Hadoop eco system
‐Experience with Cloud storage capabilities and processing
‐Knowledge of Guidewire solutions
‐Spark