Software Engineer (Data Platform)

Job Type
Permanent
Salary
11,000,000 JPY - 14,000,000 JPY per year
Japanese Level
None
English Level
Advanced (TOEIC 860)
Start Date
ASAP
Location
Tokyo

Description

A leading mobile app of news aggregation services is looking for a data platform software engineer in who plays a key role in accelerating the products/business developments.

 

Great efforts are paid on building a highly efficient and flexible data service for analytical and operational purposes.

To serve the internal users from analytics and product-dev teams, the goal and mission of data engineers is to create high-level, easy-to-use data services for simplifying the accessing, integration and consolidation of various data sets, and also building the platforms for executing tasks processing massive data in terms of TB per day.

Technology drives the growth and thus eagerly adopting cutting-edge technologies from the industry and academia especially, the open-source community.

【Responsibilities】
 - Design and develop new services, libraries, tools, frameworks for data processing or management, and investigate new algorithms to increase efficiency for Data Processing, such as ETL, Data Pipelines, OLAP DBMS, real-time messages and streams processing, data-sync between systems, etc.
 - Do performance evaluation, monitoring and tuning of the data processing procedures or platforms, get insights of efficiency and stabilizability and make continuously improvement, such as optimizing distributed query engines, computing resource management and isolation, multi-tier storage systems, etc.
 - Own and maintain the key data processing portfolios such as building and taking care of the environment, trouble-shooting and being responsible to the on-call of incidents.
 - Work closely with data architecting/modeling roles to understand ways to implement the data service, and interact with Site Reliability Engineering (SRE) team to deploy the environments and drive production excellence.
 - Diagnose and resolve complex technical challenges for data accessing or processing. Using elegant and systematic rather than ad-hoc methods to help other teams tuning the performance and improving stability.

 

【会社概要 | Company Details】
スマートフォンアプリケーションの開発・運営を手掛ける大手インターネットサービス企業です。

A major internet service company that develops and operates smartphone applications.

【就業時間 | Working Hours】

10:00 - 18:45 (Mon - Fri) (Flextime available)

【休日休暇 | Holidays】
完全週休2日制(土日祝休み)、年末年始、年次有給休暇、産前産後休暇、育児休業、その他特別休暇 など
Saturday, Sunday, and National Holidays, Year-end and New Year Holidays, Paid Holidays, Other Special Holidays

【待遇・福利厚生 | Services / Benefits】
各種社会保険完備(厚生年金保険、健康保険、労災保険、雇用保険)、屋内原則禁煙(屋外に喫煙所あり)、通勤交通費支給等、確定拠出年金制度、各種研修制度 など
Social insurance, Transportation Fee, Defined contribution pension system, training programs, no smoking indoors allowed (Designated smoking area), etc.

Free Lunch, Housing Allowance, In-house Massage, Gym, Stock Options, Global Environment, Language learning support, Barista prepared coffee, Event space for free use for meet ups, Transportation, Social Insurance (Health, Employment, Pension & Compensation), Company Contribution plan, Maternity/Paternity Leave, Flexible work hours, open office plan

 

 

Required Skills

 - Strong Programming skills and experiences with deep understanding of data structures and algorithms are required for building efficient and stable solutions
 - Rich experiences with one or more programming languages such as Java, Scala, C++ or Python; familiar with agile development and manage testing skills
 - Need certain knowledge on shell scripts and operating systems, especially on Linux
 - Good understanding of modern BigData technologies and ecosystems
 - Familiar with Hadoop, Spark, Hive, Presto, Storm or Flink, be able to develop data processing programs with them in batch or streaming manner
 - Familiar with modern data stores either RDBMS or NoSQL stores (such as HBase, Cassandra or Druid, etc); have experiences on developing application or function-extensions on such data stores
 - Be able to implement and tune complicated heavy-lifting data flows (ETLs or pipelines), familiar with certain toolings
 - Capability of system design with good modularity and extensibility
 - Familiar with system/module design methods and toolings such as UML
 - Be able to draft the user-understandable blueprint and precise, detailed designs
 - Experience of building highly scalable distributed systems
 - Able to design and implement distributed services with scalability and performance in mind
 - Able to debug and troubleshooting performance and reliability problems