Data Engineer（7490）
Data Engineer（7490）
Job type:
Haken
Specialization:
Data and Analytics
Language Level:
English Level - Intermediate (TOEIC 600),Japanese Level - High Intermediate (JLPT Level 2)
Location:
Setagaya-ku
Salary:
¥4,000.00 - ¥4,300.00 Hourly
Job Reference:
489095
A Global IT Service is looking for a Data Engineer .
Responsibilities:
- Build large-scale batch data pipelines using data processing frameworks and technologies such as Spark, Hive, Kafka, Spark-Streaming, Hadoop, and Google Cloud Platform. Utilize the data pipelines to provide critical decision-making data for data validation, customer acquisition, and other key business performance indicators in accordance with Rakuten Ichiba guidelines.
- Data Pipeline Management: Build and maintain data pipelines for a large-scale e-commerce platform.
- Automation: Automate data ingestion processes and reduce manual data processing.
- Cloud Migration: Migrate on-premises data infrastructure to Google Cloud Platform.
- Application Management: Manage platform applications that ingest and process large amounts of data.
- Resolving Complex Data Storage and Retrieval Problems: Resolve and clearly explain complex data storage and retrieval problems in big data pipelines.
- Debugging and Maintaining Applications in Production: Debug and maintain applications in production environments using logging, alerting, and monitoring tools.
- Effective Collaboration with Teams and Cross-Team Members: Collaborate effectively with other teams and cross-team members.
- Team Leadership: Lead a team of software engineers to achieve project goals.
Required Skills:
- Experience developing and operating Spark and Kafka applications
- Experience developing in Python or Java/Scala
- 5+ years of experience as a data engineer
- Experience developing and operating Google Cloud Platform and BigQuery
- Advanced SQL knowledge and relational database experience
- Experience building data pipelines, datasets, and performance optimization
- Experience with data modeling
- Experience developing in Linux
- Data Analysis: Strong analytical skills for data processing and transformation
- Project Management: Ability to manage projects and deliver high-quality solutions
- Business-level Japanese literacy
Why should you apply:
- Free lunch when you come to the office
- Potential for future permanent employment (many proven)
Company Details:
A global company with a strong presence in multiple business areas. It has achieved sustained growth both domestically and internationally, including in the U.S. and Europe. The company boasts a diverse and international environment and is committed to equal opportunity, offering a wealth of career opportunities. Due to the diverse nature of our business, we handle a wide range of technologies! You can also choose the environment you are most comfortable with, such as Windows/Mac! Meals in the company cafeteria are also free. Our chefs are always coming up with new menu items, so you can enjoy your meal without getting bored!
Working hours: 9:00 - 17:30 (Mon-Fri)
Working Style: Hybrid (4 days in office, 1 day work from home)
Holidays: Saturday, Sunday, and National Holidays, Year-end and New Year Holidays, Paid Holidays, Other Special Holidays
Services/Benefits: Social insurance, DC Pension Plan, Transportation Fee, Skillhouse University, Test payback system, and more
Share this job
