Distributed System Engineer / Data Platform Department

求人概要 / Role and Responsibility
About the department:
LINE Corporation is a provider of a renowned messaging service and a wide range of other services, including finance, content and AI, to our hundreds of millions of global users. These services generate large amounts of data every day, resulting in LINE accumulating over 250 petabytes of data. As stated in our code of conduct “LINE STYLE,” we take an “always data-driven” approach and value data as an asset that is shared and used across the company.
The Data Platform Department aims to democratize data and develop robust machine learning pipelines. To this end, the department offers a platform that can leverage an enormous amount of data efficiently to drive service growth while also helping engineers, service planners and marketers to capitalize on it.

About this position:
We are currently looking for distributed system engineers who will be responsible for the development and operation of a data platform that acts as an integrated analytic environment offered to various LINE services.
This position offers the chance to develop and improve the Hadoop ecosystem and optimize overall platform performance.
There will also be many opportunities to engage in projects that will be relevant to the underlying operations of our large-scale data platform used by teams in various counties.

Responsibilities:
・ Develop and improve the Hadoop ecosystem among others
・ Tune Hadoop to ensure the stable performance of the data platform
・ Troubleshoot issues in the Hadoop ecosystem
・ Contribute to OSS for better system performance
・ Improve the overall performance of the data platform
・ Automate routine tasks
・ Lead large-scale projects for migration, cost reduction, etc.
・ Monitor systems and conduct capacity planning
・Collaborate with stakeholders from other departments (to identify requirements and design architectures of the data platform)

Tools/development environments:
・Platform: On-premise/AWS
・AWS services: Athena/S3/S3 Glacier/Lambda/StepFunction/CDK
・Hadoop ecosystems: HDFS/YARN/Hive/Trino/Spark
・Distributed environments: Kubernetes/Kafka/Elasticsearch
・Streaming tools: Flink/Fluentd
・Operating/monitoring tools: Ansible/Grafana/Prometheus/Promgen
・Job management tools: Airflow/Azkaban
・BI tools: Tableau/Yanagishima/OASIS (internal BI tool)
・Development environments: IntelliJ/Github/Jenkins/CircleCI/Drone
・Development languages/frameworks: Java/Scala/Python/Shell Script

■Reference(Japanese content)
https://speakerdeck.com/line_developers/the-future-of-line-data-platform-we-are-aiming-for

https://linecorp.com/ja/career/lp/media/dataplatform
応募資格 / Qualifications
Required experience/skills:
・Business level Japanese (JLPT N3 or above)
In addition, one or more of the following experiences (at least one year) or equivalent knowledge is required:
・Experience using Linux/Unix OS at work
・Experience in developing with Python, Java, Scala, Shell Script and others
・Experience in ELT and data processing in the Hadoop environment (Hive/Presto/Spark) or other data environments
・Strong fundamental knowledge of computer science, such as data structures, OS, and networks

Preferred experience/skills:
・Experience building and managing large-scale Hadoop clusters as an administrator
・Extensive knowledge and experience in Hadoop ecosystems (e.g. HDFS/YARN/Hive/Presto/Spark/HBase)
・Extensive knowledge and experience in Kubernetes, Docker and other container technologies
・Experience leading long-term projects (one year or longer) to improve operations of large-scale systems
・Ability to use English and/or Korean to discuss technical issues with overseas office staff and other stakeholders
・Experience undertaking the entire process for system architecture—design, development, and operation—in cloud environments (e.g. AWS/GCP)
・Experience making commits/contributions to OSS (particularly, the Hadoop community)
勤務地 / Location
四谷オフィス
〒160-0004 東京都新宿区四谷1-6-1四谷タワー23F
雇用形態 / Employment type
正社員
勤務時間 / Working hours
専門業務型裁量労働制(1日の労働時間に関わらず1日9.5時間労働したものとみなします。)、フレックスタイム制(コアタイム 11:00~16:00)、10:00~18:30(実働7時間30分)のいずれか適用 ※面接後に決定
待遇・福利厚生 / Benefits
■休日/休暇
・完全週休2日制(土・日)、祝日、年次有給休暇、年末年始休暇、慶弔休暇、リフレッシュ休暇制度(勤続5年で10日間)

■給与
・年俸制(保有されるスキル・経験・能力により優遇、相談の上で決定)
 ・年俸の12分の1を毎月支給。
 ・別途、インセンティブプラン有(※1)
・給与改定:年2回
・諸手当:交通費支給(会社規定による)、LINE Pay Card Benefit Plan(※2)

(※1)年俸額の他に、会社・本人の業績、評価に応じ、年2回インセンティブを支給することがあります。
(必ず支給されるものではありません。また、支給日に在籍している場合に限り支給対象となります。)
(※2)社員の「健康維持増進」「自己啓発」「次世代育成」を目的として給与とは別に支給する手当です。

■各種保険
・雇用保険、労災保険、健康保険、厚生年金保険

■福利厚生
・定期健康診断
・各種社内イベント他

■受動喫煙防止措置の実施
・屋内原則禁煙(屋内に喫煙室あり)
 ・四谷オフィス、南新宿オフィス、大崎オフィス

※当社はオフィス勤務と在宅勤務を組み合わせた、より効率的に高いパフォーマンスを発揮し続ける新しい働き方「LINE Hybrid Working Style」を採用しています。
https://linecorp.com/ja/pr/news/ja/2021/3912

その他詳細は面談の際にお伝えします。

■LINEに興味がある/マッチする職種があれば提案してほしい方はこちら
→キャリア登録について