Global internet service company is looking for a Data Engineer to join their growing team of analytics experts. The team is responsible for building their biggest data pipeline – collecting and processing billions of events daily. You will be responsible for scaling their data architecture, as well as optimizing data flow and collection for cross functional teams. You are an experienced data pipeline builder and data wrangler who enjoys optimizing data systems and building them from the ground up.
‐ Build and maintain large-scale batch and real-time data pipelines with data processing frameworks and technologies like Spark, Flink, Kafka, Druid, Hadoop, etc.
‐ Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency and other key business performance metrics.
‐ Improve data quality through testing, tooling and continuously evaluating performance.
‐ Work in cross functional agile teams to continuously experiment, iterate and deliver on new product objectives.
‐ Work with data and analytics experts to strive for greater functionality in our data systems.
Our client is a large global Internet service company that has enjoyed sustained growth as they continue to expand their business in various new areas and industries. This is a great opportunity to work in a diverse and international environment in Japan. Our client actively strives to be an equal opportunity employer, and they have many female and foreign nationals in upper management positions. Their brand has also gained global recognition as they sponsor some of the world's most famous sports teams. Our client prides themselves in providing a comfortable working environment for their employees. Engineers are welcome to choose their own setup (Windows/Mac, etc.); whatever makes them comfortable! Free meals are also provided at the company cafeteria. Their chefs work to create exciting new menus and dishes, so employees never get tired of the food!
9:00 - 17:30（Mon - Fri）
Saturday, Sunday, and National Holidays, Year-end and New Year Holidays, Paid Holidays, Other Special Holidays
【Services / Benefits】
Social insurance, Transportation Fee
Experience in data engineer experience
‐ You know how to work with high volume heterogeneous data tools such as Spark, Hive, Pandas, Hadoop, etc.
‐ You are an expert in one or more of the following programming languages: Scala, Python, Java
‐ You are knowledgeable about stream-processing frameworks or platforms such as Flink, Spark Streaming, Kafka, etc.
‐ You care about agile software processes, data-driven development, reliability, and responsible experimentation.
‐ You have experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement