Leading IT service Group continues to expand its business and various projects are underway to ensure stable operation of platform services in order to support future growth.
They are looking for talented Hadoop engineers who can enjoy and participate in many projects underway all over the world, but at the same time, we want someone who can move things forward with new perspectives and new technologies without being bound by existing mechanisms.
Their Hadoop system is part of the platform managed by Cloud Platform Department (CPD), their service produces a large amount of data every second, and it is required to process it quickly. Hadoop is used for this process and contributes to its business.
This Hadoop is composed of hundreds of nodes, stores petabytes of data, and uses services not only in Japan but also in overseas subsidiary companies.
- Hadoop job design, scheduling and tuning based on communications with all Hadoop users.
- Design and development of data pipeline.
- Information sharing and collaboration with Hadoop admins
- Facilitate user training
- Monitoring and incident handling
【会社概要 | Company Details】
Our client is a large global Internet service company that has enjoyed sustained growth as they continue to expand their business in various new areas and industries. This is a great opportunity to work in a diverse and international environment in Japan. Our client actively strives to be an equal opportunity employer, and they have many female and foreign nationals in upper management positions. Their brand has also gained global recognition as they sponsor some of the world's most famous sports teams. Our client prides themselves in providing a comfortable working environment for their employees. Engineers are welcome to choose their own setup (Windows/Mac, etc.); whatever makes them comfortable! Free meals are also provided at the company cafeteria. Their chefs work to create exciting new menus and dishes, so employees never get tired of the food!
【就業時間 | Working Hours】
Flex (7.5 hours a day with core time 11:00-15:00)
*When there is Asakai (usually Monday morning), the core time is 8:00-12:00
【休日休暇 | Holidays】
Saturday, Sunday, and National Holidays, Year-end and New Year Holidays, Paid Holidays, Other Special Holidays
【待遇・福利厚生 | Services / Benefits】
各種社会保険完備（厚生年金保険、健康保険、労災保険、雇用保険）、 屋内原則禁煙（屋外に喫煙所あり）、 通勤交通費支給等
Social insurance, Transportation Fee, No smoking indoors allowed (Designated smoking area), etc.
- Experience with Linux
- Experience from any of the following list. Java, Scala, Python, Bash
- Experience using Hadoop ecosystem components such as yarn, hive, hbase, spark and hdfs.
- Experience as project manager or product manager
- Experience as Hadoop administrator