Skillhouse Internal Career Opportunity
Data Engineer (Analytics & Metrics)
Position Title:
Data Engineer (Analytics & Metrics)
Employment Type:
Permanent
Working Hours:
English Level - Advanced (TOEIC 860),Japanese Level - None
Salary
Description
A Global IT Service firm is looking for a Data Engineer who can contribute to business growth by strengthening data analysis pipeline and enhancing data processing through the utilization of new technologies, including AI.
Responsibilities:
- Build and maintain high-throughput data pipelines that process terabytes of data per hour
- Enable rapid data access for users
- Contribute to the entire data pipeline lifecycle, including: Development, Deployment, Incident response, Data quality management
- Collaborate with the SRE team to improve pipeline performance and reliability using tools such as Prometheus and Grafana
- Work with customer service and product teams to deliver data access solutions that meet diverse customer needs
Required Skills:
- 5+ years of hands-on Data Engineering experience in enterprise products (e.g., e-commerce, financial services, telecommunications)
- Proven experience in designing, developing, and deploying streaming and/or batch applications using big data technologies such as Spark, Flink, Kafka, Cloud Pub/Sub, Dataproc, SQL, BigQuery, Cloud Dataflow, Cloud Storage, and Cloud Composer
- Proficiency in developing Spark applications from the ground up and deploying them to production
- Ability to understand and modify existing Spark applications to implement new features and resolve bugs
- Experience in troubleshooting and optimizing Spark application performance through configuration adjustments, JVM tuning, and code refactoring
- Ability to perform data quality assurance (QA) and investigate data discrepancies using SQL or Spark
- Strong ownership and a proactive approach to improving our product
- Logical problem-solving skills and a systematic approach to execution
- Proven ability to drive initiatives from concept to completion
- Excellent collaboration and communication skills
- Ability to work productively and reliably in an asynchronous environment
Why You Should Apply:
- A rewarding role at global company, where you'll help transform cutting-edge AI technologies into business value and drive their expansion into global markets
- Diverse and international environment committed to equal opportunity, offering a wealth of career opportunities
- Chance to handle a wide range of technologies
- Meals in the company cafeteria are free. Our chefs are always coming up with new menu items!
Company Details:
A global company with a strong presence in multiple business areas. It has achieved sustained growth both domestically and internationally, including in the U.S. and Europe. The company boasts a diverse and international environment and is committed to equal opportunity, offering a wealth of career opportunities. Due to the diverse nature of our business, we handle a wide range of technologies! You can also choose the environment you are most comfortable with, such as Windows/Mac! Meals in the company cafeteria are also free. Our chefs are always coming up with new menu items, so you can enjoy your meal without getting bored!
Working hours : 9:00 - 17:30 (Mon-Fri)
Working Style: Hybrid (4 days in office, 1 day work from home)
Holidays: Saturday, Sunday, and National Holidays, Year-end and New Year Holidays, Paid Holidays, Other Special Holidays
Services/Benefits: Social insurance, Pension Plan, Transportation Fee, Free Cantine, Casual clothes and more
