Hadoop Administrator (Operation Engineer)

Job Type
Permanent
Salary
6,000,000 JPY - 9,000,000 JPY per year
Japanese Level
None
English Level
Advanced (TOEIC 860)
Start Date
ASAP
Location
Tokyo

Description

Global IT service company is hiring a Hadoop Administrator. Their Big Data platform captures and generates terabytes of data every day. This data needs to be streamed, processed, curated and accessed by hundreds of services and business people. They are looking for excellent engineers who have the strong passion and competence to solve technical challenges, deploy and administer Hadoop Clusters around the world for various services.

【Responsibilities】
‐ Troubleshooting and performance tuning
‐ Solve issue of Hadoop components by investigating and finding the solution, workarounds, or creating and applying patches
‐ Support Hadoop users by solving their complex issues
‐ Help and train Hadoop users to use our Hadoop ecosystem


上場インターネットサービス企業では、Hadoopアドミニストレーターを募集しております。同社のBig Data Platformは毎日数テラバイト規模のデータの生成及び取得を行っています。このデータに様々な処理を加え、事業を支える数百に登るサービスやビジネスに展開されています。様々な問題解決や改善のために情熱を持ちかつ、Hadoop、Cassandraなどの高度な散並列処理システムの展開、運用に対して日々誠実に取り組める人材を求めています。

【主な業務内容】
‐ ユーザサポート
‐ データサイエンティストやアプリケーションエンジニアに対するHadoopエコシステム利用等に関連するサポート業務
‐ システム管理
‐ HadoopエコシステムおよびCassandra,Kafkaその他のBigDataプラットフォームの構築、拡張等の管理業務


【会社概要 | Company Details】
グローバルに展開する一部上場インターネットサービス企業です。様々な事業を展開し、成長を続けています。日本にいながら異文化コミュニケーションができる国際的な環境かつ、女性や外国籍の管理職登用にも積極的なダイバーシティな環境でもあります。世界的にも知名度アップを図り、スポーツチームのスポンサーなども積極的に行っています。
エンジニアの方には嬉しい、WindowかMacを自分で選択することができます!社内カフェテリアは明るく、毎日食べても飽きないほど、メニューが豊富です!
Our client is a large global Internet service company that has enjoyed sustained growth as they continue to expand their business in various new areas and industries. This is a great opportunity to work in a diverse and international environment in Japan. Our client actively strives to be an equal opportunity employer, and they have many female and foreign nationals in upper management positions. Their brand has also gained global recognition as they sponsor some of the world's most famous sports teams. Our client prides themselves in providing a comfortable working environment for their employees. Engineers are welcome to choose their own setup (Windows/Mac, etc.); whatever makes them comfortable! Free meals are also provided at the company cafeteria. Their chefs work to create exciting new menus and dishes, so employees never get tired of the food!

【就業時間 | Working Hours】
9:00 - 17:30(Mon - Fri)

【休日休暇 | Holidays】
完全週休2日制(土日祝休み)、年末年始、年次有給休暇、その他特別休暇など
Saturday, Sunday, and National Holidays, Year-end and New Year Holidays, Paid Holidays, Other Special Holidays

【待遇・福利厚生 | Services / Benefits】
各種社会保険完備(厚生年金保険、健康保険、労災保険、雇用保険)、通勤交通費支給等
Social insurance, Transportation Fee

Required Skills

‐ Recognized contributions to any open source projects in the Hadoop ecosystem
‐ Deep understanding of the Hadoop ecosystem and strong conceptual knowledge in Hadoop architecture components
‐ Strong hands-on experience and knowledge of Hadoop core components, such as HDFS, YARN, Hive, etc.
‐ Experience in open source development and knowledge of Git, JIRA and Jenkins, etc.
‐ Experience and interest in writing production quality code
‐ Strong analytical mind to help solve complicated problems
‐ Desire to resolve issues and dive into potential issues
‐ Self-starter who works with minimal supervision, and the ability to work in a team of diverse skill sets
‐ Ability to comprehend customer requests and provide the correct solution


‐ C言語/Java/Shellスクリプトのコーディングスキル
‐ Linuxに関する経験及び知識
‐ Hadoopに関する経験及び知識   
‐ コミュニケーションスキル

Preferred Skills

‐ Experience with low level system functionality, using multi-tenancy systems features, such as Linux containers, cgroups, and Docker
‐ Experience and knowledge of automation tools for server provisioning, such as Chef (Ruby), Puppet, and Ansible
‐ Development experience for operational automation
‐ Experience in end to end design and build process of Near-Real time and Batch Data Pipelines
‐ Strong hands-on experience and knowledge of Linux and Hardware
‐ Experience with cloud infrastructure


‐ 自動構成ツールの経験及び知識
‐ Chef/Puppet
‐ Python/SQL/Rubyのコーディングスキル
‐ 監視ソリューションの経験及び知識
‐ Splunk/Ganglia
‐ オープンソースソリューション導入の経験及び知識