The Head of Data Engineering is first and foremost a leader within the department overseeing the activities related to data ingestion, data transformation, data extraction and data operations for internal and external client needs.
The Head of Data Engineering is responsible for setting the department vision and culture and brings technical know-how and operational excellence to the team.
The Head of Data Engineering takes responsibility for the accessibility, retrievability, security, quality, retention, and ethical handling of datasets. As such the Head of Data Engineering designs, implements, and operationalize data pipelines to achieve those objectives.
As the company is currently starting a cloud migration journey, the Head of Data Engineering brings cloud expertise and help support design and migration activities to transition existing services into the cloud.
MAIN TASKS / RESPONSIBILITIES: DESCRIPTION OF MAIN TASKS / RESPONSIBILITIES
The Head of Data Engineering is a team leader who manages his/her team towards the following activities:
Data extraction services Execute ad-hoc, monthly and quarterly data extraction services as required by company's internal/external clients and in accordance with services SLA
Perform QA activities related to client data services
Execute data analysis to provide insight for internal/external needs
Automate recurrent data related activities
Investigate data to answer customer complaints related to comoany's services (for example score complain, credit report complaint etc)
Data pipeline development and operationalization Design data pipelines to ingest data from multiple sources and implement quality processes
Design processes to create data insight, data features and operationalize analytics models
Develop and implement those data pipelines
Operationalize data pipelines for automated and semi-automated execution
Implement reporting of data universe, data quality across the organization
Data platform innovation Own the Data Platform, suggest, specify, and implement enhancements to the platform
Suggest and implement technology components relevant to the data platform
Support key initiatives including migration of CTOS data services to the cloud
EDUCATION /CERTIFICATION: Bachelor's Degree, Post Graduate Diploma, Professional Degree in Computer Science / Information Technology or equivalent
Professional Experience required:-
Minimum 10 years experience in product / software development
Minimum 5 years experience working with a data platform
Experience working within financial industry is a plus
Competencies:-
Strong knowledge of data platforms, data pipelines, data related development including platforms such as Hadoop, Spark, Jupyter, cloud native services
Proficient with cloud services and knowledge of data related cloud native services (Azure and/or AWS)
Proficient with tools and programming languages required to implement data pipelines: SQL, Python / Pandas
Proficient with tools required to implement automation and monitoring: Shell scripts, scheduling tools such as AirFlow
Experience with ETL tools such as Talend and/or cloud native services
Experience implementing reporting using a data platform or reporting software
Excellent written and verbal communication skills including English
Able to multi-task and prioritize activities efficiently
Understanding of financial industry and related data (CCRIS, SSM, Angkasa, Idaman) is a plus
Leadership Experience:-
Excellent organizational, operational and leadership skills
Strong analytical and problem-solving capabilities
Strong strategic and business mindset
