Important Information
Location: Kuala Lumpur Malaysia
Experience: 10-15 years
Job Mode: Full-time Contract
Work Mode: On-Site
Job Summary
- The Data Engineering Manager is first and foremost a leader within the department overseeing the activities related to data ingestion, data transformation, data extraction and data operations for internal and external client needs
- He/ She is responsible for setting the department vision and culture and brings technical know-how and operational excellence to the team.
- Data Engineering Manager takes responsibility for the accessibility, retrievability, security, quality, retention, and ethical handling of datasets. He/she designs, implements, and operationalize data pipelines to achieve those objectives.
Responsibilities and Duties
The Data Engineering Manager is a team leader who manages his/her team towards the following activities:
Data extraction services
- Execute ad-hoc, monthly and quarterly data extraction services as required by CTOS internal/external clients and in accordance with services SLA
- Perform QA activities related to client data services
- Execute data analysis to provide insight for internal/external needs
- Automate recurrent data related activities
- Investigate data to answer customer complaints related to CTOS services (for example score complain, credit report complaint etc)
Data pipeline development and operationalization
- Design data pipelines to ingest data from multiple sources and implement quality processes
- Design processes to create data insight, data features and operationalize analytics models
- Develop and implement those data pipelines
- Operationalize data pipelines for automated and semi-automated execution
- Implement reporting of data universe, data quality across the organization
Data platform innovation
- Own the Data Platform, suggest, specify, and implement enhancements to the platform
- Suggest and implement technology components relevant to the data platform
- Support key initiatives including migration of CTOS data services to the cloud
Qualifications And Skills
- Hands on working experience on Data Strong knowledge of data platforms, data pipelines, data related development including platforms such as Hadoop, Spark, Jupyter, cloud native services
- Hands on experience on cloud services and knowledge of data related cloud native services (AWS)
- tools and programming languages required to implement data pipelines: SQL, Python / Pandas
- tools required to implement automation and monitoring: Shell scripts, scheduling tools such as AirFlow
- ETL tools such as Talend and/or cloud native services
- Experience implementing reporting using a data platform or reporting software
About Encora
Encora is the preferred digital engineering and modernization partner of some of the world's leading enterprises and digital native companies. With over 9,000 experts in 47+ offices and innovation labs worldwide, Encora's technology practices include Product Engineering & Development, Cloud Services, Quality Engineering, DevSecOps, Data & Analytics, Digital Experience, Cybersecurity, and AI & LLM Engineering.
At Encora, we hire professionals based solely on their skills and qualifications, and do not discriminate based on age, disability, religion, gender, sexual orientation, socioeconomic status, or nationality.
