Hadoop Administrator (Operation Engineer)

Job Type
6,000,000 JPY - 9,000,000 JPY per year
Japanese Level
English Level
Advanced (TOEIC 860)
Start Date


Global IT service company is hiring a Hadoop Administrator. Their Big Data platform captures and generates terabytes of data every day. This data needs to be streamed, processed, curated and accessed by hundreds of services and business people. They are looking for excellent engineers who have the strong passion and competence to solve technical challenges, deploy and administer Hadoop Clusters around the world for various services.

‐ Troubleshooting and performance tuning
‐ Solve issue of Hadoop components by investigating and finding the solution, workarounds, or creating and applying patches
‐ Support Hadoop users by solving their complex issues
‐ Help and train Hadoop users to use our Hadoop ecosystem

上場インターネットサービス企業では、Hadoopアドミニストレーターを募集しております。同社のBig Data Platformは毎日数テラバイト規模のデータの生成及び取得を行っています。このデータに様々な処理を加え、事業を支える数百に登るサービスやビジネスに展開されています。様々な問題解決や改善のために情熱を持ちかつ、Hadoop、Cassandraなどの高度な散並列処理システムの展開、運用に対して日々誠実に取り組める人材を求めています。

‐ ユーザサポート
‐ データサイエンティストやアプリケーションエンジニアに対するHadoopエコシステム利用等に関連するサポート業務
‐ システム管理
‐ HadoopエコシステムおよびCassandra,Kafkaその他のBigDataプラットフォームの構築、拡張等の管理業務

【会社概要 | Company Details】
Our client is a large global Internet service company that has enjoyed sustained growth as they continue to expand their business in various new areas and industries. This is a great opportunity to work in a diverse and international environment in Japan. Our client actively strives to be an equal opportunity employer, and they have many female and foreign nationals in upper management positions. Their brand has also gained global recognition as they sponsor some of the world's most famous sports teams. Our client prides themselves in providing a comfortable working environment for their employees. Engineers are welcome to choose their own setup (Windows/Mac, etc.); whatever makes them comfortable! Free meals are also provided at the company cafeteria. Their chefs work to create exciting new menus and dishes, so employees never get tired of the food!

【就業時間 | Working Hours】
9:00 - 17:30(Mon - Fri)

【休日休暇 | Holidays】
Saturday, Sunday, and National Holidays, Year-end and New Year Holidays, Paid Holidays, Other Special Holidays

【待遇・福利厚生 | Services / Benefits】
Social insurance, Transportation Fee

Required Skills

‐ Recognized contributions to any open source projects in the Hadoop ecosystem
‐ Deep understanding of the Hadoop ecosystem and strong conceptual knowledge in Hadoop architecture components
‐ Strong hands-on experience and knowledge of Hadoop core components, such as HDFS, YARN, Hive, etc.
‐ Experience in open source development and knowledge of Git, JIRA and Jenkins, etc.
‐ Experience and interest in writing production quality code
‐ Strong analytical mind to help solve complicated problems
‐ Desire to resolve issues and dive into potential issues
‐ Self-starter who works with minimal supervision, and the ability to work in a team of diverse skill sets
‐ Ability to comprehend customer requests and provide the correct solution

‐ C言語/Java/Shellスクリプトのコーディングスキル
‐ Linuxに関する経験及び知識
‐ Hadoopに関する経験及び知識   
‐ コミュニケーションスキル

Preferred Skills

‐ Experience with low level system functionality, using multi-tenancy systems features, such as Linux containers, cgroups, and Docker
‐ Experience and knowledge of automation tools for server provisioning, such as Chef (Ruby), Puppet, and Ansible
‐ Development experience for operational automation
‐ Experience in end to end design and build process of Near-Real time and Batch Data Pipelines
‐ Strong hands-on experience and knowledge of Linux and Hardware
‐ Experience with cloud infrastructure

‐ 自動構成ツールの経験及び知識
‐ Chef/Puppet
‐ Python/SQL/Rubyのコーディングスキル
‐ 監視ソリューションの経験及び知識
‐ Splunk/Ganglia
‐ オープンソースソリューション導入の経験及び知識