スキルハウスの採用情報
Data Platform Engineer (Search & Large-scale Data Pipelines)
役職：
Data Platform Engineer (Search & Large-scale Data Pipelines)
雇用形態:
正社員
給与:
12000000.00
勤務時間:
Japanese Level - None,English Level - Advanced (TOEIC 860)
職務内容
A Global IT Service is looking for a Data Engineer who will be an integral part of our Search Data Platform team. Your primary responsibility will be to design, develop, and maintain scalable data pipelines and systems that support our search functionality.
You will work closely with data scientists, analysts, and other stakeholders to ensure data is accessible, reliable, and optimized for improving search quality, relevance, and overall user experience.
Your expertise in modern data technologies will be crucial in driving our data strategy forward and enhancing the performance of our search platform.
Responsibilities:
- Design, develop, and maintain scalable and efficient data pipelines using modern data technologies
- Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions that meet their needs
- Implement and manage ETL (Extract, Transform, Load) processes to ensure data is accurately and efficiently processed
- Optimize and maintain data storage solutions, including data lakes, data warehouses, and databases
- Ensure data quality, integrity, and security across all data systems
- Monitor and troubleshoot data pipeline performance and reliability issues
- Stay up-to-date with the latest trends and best practices in data engineering and modern data technologies
- Document data processes, systems, and workflows to ensure knowledge sharing and continuity
- Contribute to the continuous improvement of search quality and relevance by providing reliable and well-structured data
Required skills:
- Proven experience as a Data Engineer or in a similar role
- Strong proficiency in SQL
- Experience with modern data technologies such as Apache Spark, Apache Kafka, Apache Flink, Hadoop, and cloud-based data platforms (e.g., AWS, GCP, Azure)
- Proficiency in programming languages such as Python, Java, or Scala
- Experience with ETL tools and frameworks (e.g., Apache NiFi, Talend, Airflow)
- Familiarity with data warehousing solutions (e.g., Snowflake, Redshift, BigQuery)
- Knowledge of data modeling, data architecture, and data governance principles
- Strong problem-solving skills and attention to detail
- Excellent communication and collaboration skills
Why should you apply:
- Great opportunity to be able to work for well-established company
- Cross-departmental communication is possible in an international environment
- Drive innovation and maintain high standards for products utilized on a huge scale
Company Overview: This is a global company with a strong presence in multiple business sectors. It has achieved sustained growth both domestically and internationally, including in the U.S. and Europe. The company prides itself on its diverse and international environment, providing ample career opportunities and a commitment to equal opportunity. With a wide range of business activities, the company also works with various technologies. You can choose your preferred working environment, whether Windows or Mac! Meals at the employee cafeteria are free, and the chef regularly comes up with new menus, ensuring you never get bored of the meals!
Work Hours: 9:00 AM – 5:30 PM (Flextime or staggered working hours possible)
Work Style: Hybrid (Typically 4 days in the office, 1 day working from home)
Holidays: Saturdays, Sundays, public holidays, New Year holidays, paid leave, bereavement leave, and other special leave
Benefits: Full social insurance (employee pension insurance, health insurance, worker’s accident compensation insurance, unemployment insurance), DC pension plan, transportation allowance, childcare and caregiving support, cafeteria, retirement benefit system, welfare services (Relo Club), health counseling services, relocation support (visa support, moving), employee discounts (moving, language classes, etc.), and more
Interview Process: 3~4 times
