Global IT service company is looking for talented and creative DevOps engineers to join their team. The Data Engineering Group offers a relaxed but fast environment where creative and collaborative talent are rewarded. The team is very active and passionate about catching up and introducing cutting-edge technology from OSS (Open Source Software). Their Solution for Data Engineering are being used for various services in the company and continue to grow, following up needs of system for data-driven strategy. Users' requirements and needs are changing continuously and their Solution for Data Engineering are also evolving fast to catch up to their needs and support.
You will play a core role in administrating, monitoring and problem resolution on the current data engineering platform, and the cutting-edge data engineering technology R&D.
‐ Design and development of the New Data Collection System, which will be the standard system
‐ Development & maintenance of the Data Pipeline System, that transfer and wrangle terabytes of data from various services using ELK, Apache Kafka, and Apache NiFi
‐ R&D for new Data Engineering Technology
‐ Collaboration with Dev/Ops Team and Implement Automated Operation System
Our client is a large global Internet service company that has enjoyed sustained growth as they continue to expand their business in various new areas and industries. This is a great opportunity to work in a diverse and international environment in Japan. Our client actively strives to be an equal opportunity employer, and they have many female and foreign nationals in upper management positions. Their brand has also gained global recognition as they sponsor some of the world's most famous sports teams. Our client prides themselves in providing a comfortable working environment for their employees. Engineers are welcome to choose their own setup (Windows/Mac, etc.); whatever makes them comfortable! Free meals are also provided at the company cafeteria. Their chefs work to create exciting new menus and dishes, so employees never get tired of the food!
Skillhouse has placed many candidates here, and we currently boast the highest number of contracts annually out of any vendor. Due to our great working relationship, the interview process is smooth and easy. Our account managers individually work with each candidate to make sure everyone is fully prepped and well-informed beforehand, so candidates feel confident during every step of the application process. We also offer advice and consultation on how to write successful and effective resumes in both Japanese and English. Skillhouse can even set up a company tour (depending on the situation).
9:00 - 17:30（Mon - Fri）
Saturday, Sunday, and National Holidays, Year-end and New Year Holidays, Paid Holidays, Other Special Holidays
【Services / Benefits】
Social insurance, Transportation Fee, No smoking indoors allowed (Designated smoking area), etc.
‐ Hands-on experience with Linux
‐ Experience, excellent programming skills in Java, Scala, or Python
‐ Experience in designing and building large-scale data application and pipeline in production
‐ Experience with DevOps tools and technology, such as Gradle, Maven, Jenkins, Git, IntelliJ, or Eclipse
‐ Must be self-organized and gritty on continuous improvements of the platform
‐ Must be a self-starter and good collaborator with good communication skills
‐ Hands-on experience with one of the following: ELK, Apache Kafka, and Apache NiFi
‐ Hands-on experience or great knowledge with Docker and/or Kubernetes
‐ Hands-on experience with Streaming framework, such as SparkStreaming and/or Flink
‐ Hands-on experience with Hadoop (HDFS, Hive/HiveLLAP, MapReduce, Spark on Yarn)
‐ Hands-on experience with BI Platform
‐ Hands-on experience with KVS, such as Couchbase, Cassandra, Redis