Data Engineer

Responsibilities

Data Warehousing and Management

• Communicate with system developers to design and develop data collection and data modeling

• Connect with data analysts and scientists to transform data to actionable insights, features and models

• Maintain and improve data warehouse architecture and big data platform

• Build, automate and maintain real-time and batch data ingestion and transformation ELT pipeline

• Build, monitor and improve metadata, data quality and data governance Solution and Technology Enabler

• Administrator, integrate and manage end-to-end data systems such as Tableau & Talend

• Stay abreast of emerging technologies, open source projects and best practices in the field

• Propose fundamental data tools development or enhancement requirements

• Design and build data products and analytics applications that meet business needs

• Be keen on understanding areas of business, analytics and mobile applications

Qualification:

Essential skills:

• Minimum of 1 year relevant work-experience as a data engineer; Fresh graduate are welcome

• Deep knowledge of relational and non-relational database; Hands on experience in data warehouse

• Understanding of Hadoop ecosystem such as Hive, Impala, HDFS, Cloudera, Spark, Kakfa, Flink

• Experience with data pipeline and workflow tools such as Talend, Azkaban, Airflow, Nifi

• Experience with data visualization tools such as Tableau, Grafana

• Good coding skill in at least one of Python, Java, Scala, shell scripting and/or similar languages

• Familiar with APIs, JSON, REST and other relevant W3C open standards

• Proficient in English

Essential attributes:

• Can-do attitude and excited to learn new technologies

• Open-minded and able to communicate your ideas effectively

• Work-smart and Problem-solving mindset

• Start-up working spirit and Agile

Please note that we will get in touch with shortlisted candidates only.