Big Data Engineer (090631)

Job Type
3,700 JPY - 4,000 JPY per hour
Japanese Level
English Level
Advanced (TOEIC 860)
Start Date


A leading Internet service company is hiring a Big Data Engineer . They have more than 70 businesses worldwide spanning e-commerce, digital content, communications and fintech, bringing together more than 1.2 billion members across the world. They have a diversified workforce made up of talented employees from more than 70 countries and regions. 



- As a core member of the team, you will be responsible for design, documentation, implementation and testing of the new Big Data analysis platform and algorithms.

- Improve users’ experience by creating novel technologies of Big data and ML/AI

- Analyze and understand service specific requirements

- Evaluate and improve the performance of new features and algorithms





- チームの中核メンバーとして、新しいビッグデータ分析プラットフォームとアルゴリズムの設計、ドキュメント化、実装、テストを担当していただきます。

- ビッグデータとML/AIの斬新な技術を生み出し、ユーザー体験を向上させる

- サービス固有の要件を分析し、理解する

- 新しい機能やアルゴリズムの性能を評価し、改善する


【会社概要 | Company Details】

Our client is a large global Internet service company that has enjoyed sustained growth as they continue to expand their business in various new areas and industries. This is a great opportunity to work in a diverse and international environment in Japan. Our client actively strives to be an equal opportunity employer, and they have many female and foreign nationals in upper management positions. Their brand has also gained global recognition as they sponsor some of the world's most famous sports teams. Our client prides themselves in providing a comfortable working environment for their employees. Engineers are welcome to choose their own setup (Windows/Mac, etc.); whatever makes them comfortable! Free meals are also provided at the company cafeteria. Their chefs work to create exciting new menus and dishes, so employees never get tired of the food!
【就業時間 | Working Hours】
9:00 - 17:30(Mon - Fri)
【休日休暇 | Holidays】
Saturday, Sunday, and National Holidays, Year-end and New Year Holidays, Paid Holidays, Other Special Holidays
【待遇・福利厚生 | Services / Benefits】
各種社会保険完備(厚生年金保険、健康保険、労災保険、雇用保険)、 屋内原則禁煙(屋外に喫煙所あり)、 通勤交通費支給等
Social insurance, No smoking indoors allowed (Designated smoking area), Commutation Fee covered up to 20,000 JPY per month, Free breakfast, lunch and dinner, Casual clothes is acceptable

Required Skills

- Linux Operation / Administration experience - Linux users who have good experience in trouble shooting and tuning at level of OS also when application is failed

- Streaming Framework experience - Spark Streaming, Flink, Kafka Stream, etc.

- Hadoop experience

- Hive / Hive LLAP


- Linux運用・管理経験 - Linuxユーザーでアプリケーション障害時のトラブルシューティングやOSレベルでのチューニング経験をお持ちの方。

- ストリーミングフレームワークの経験 - Spark Streaming、Flink、Kafka Streamなど

- Hadoopの経験

- ハイブ/ハイブLLAP

Preferred Skills

- Docker

- Presto


- Machine Learning/Deep Learning