A qualified Data Engineer needs to be responsible for designing, building, testing and maintaining performance-optimised data architectures and cost-optimised infrastructure to make data accessible and ready for business analysis.
The ideal candidate must have proven experience in creating business value through data management, transfer and preperation. The data engineer lead is required to collaborate with and manage the expectations of management and other business units to meet the project objectives and companys goals.
Job Responsibilities: -
- Data Management, Transfer and Preparation
1) Making large and/or complex data more accessible, understandable and usable
2) Transforming, improving and integrating data, depending on the business requirements
3) Delivering the data in a useful and appealing way to users
4) Work with noisy, dirty, and unstructured data, data cleansing, scraping unstructured data, and converting into structured data
5) Build and maintain data pipelines, ETL, databases and applications to acquire, store and manage data
6) Choose, design, test and implement data software and solutions for projects and enterprise
7) Selecting and integrating any Big Data tools and frameworks required to provide requested capabilities
8) Monitoring performance and advising necessary infrastructure changes to optimize performance and cost
9) Architect, develop and implement end-to-end automated data flows for data and analytical needs
10) Perform data profiling, data quality assessment, data cleansing and data transformation
11) Recommend appropriate solutions architecture that is highly scalable based on business requirement
12) Create date tools for data scientists and data visualization team members
13) Builds the infrastructure required for optimal extraction, transformation, and loading for data from a wide variety of data sources using SQL, noSQL and cloud (AWS / Azure / Google / Alibaba / DigitalOcean) technologies
14) Benchmark, evaluate and improve the scalability, robustness, efficiency and performance of big data platforms and applications
- Create Business value through data management, transfer and preparation
1) Engage in the delivery of analytics assignments for business users involving, amongst others; data preparation, data visualization, creating business insights etc
2) Contribute and facilitate workshops/interviews bridging the gap between data analytics and business outcomes
3) Provide strategic and tactical advice to business units by translating analytical solutions into out-of-the-box execution recommendations addressing business objectives and impacting bottom line results
4) Combine your technical expertise with the ability to architect, deploy and oversee integrated analytics/business intelligence/technology solutions
5) Build case for analytics through need analysis and business case (quantify likely benefits)
1) Consult with leaders of business teams and manage expectations, meet project and deliverable timelines, ensure accurate and timely completion of deliverables
2) Collaborate with several other teams and roles across the organization on requirements gathering and solution deployment
3) Make analytical product, service or process decisions likely to impact multiple groups of employees and/or customers (internal or external)
4) Manage technology solution portfolios, and identifying new technology approaches to solve business problems with a strong focus on leveraging enterprise data
5) Contribute to the building and management of the analytics infrastructure
6) Work with management team on staffing needs, strategic technology trend identification, monitoring project progress and completion, issue resolution and technical solutions related to data, data flow and advising on algorithm deployment
7) Collaborate with analytics practitioners, business analysts and methodologists to design and oversee the development of working prototypes of technical solutions
8) Technical support and lead for the Data Engineer team
9) Work with project teams to assist with data-related technical issues and support their data infrastructure needs
10) Any ad-hoc tasks requested by your superiors
Job Responsibilties: -
1) Bachelors degree in Computer Science, Data Science, Software Engineer or in a related field
2) Minimum THREE (3) years of relevant work experience
3) Professional certifications such as; is an added advantage
o Amazon Web Services (AWS)
o Certified Data Analytics
o Google Professional Data Engineer
4) Proven success working with all levels of management
5) Good analytical skills with proven ability to solve problems creatively
6) Good interpersonal skills and resourceful
Job Type: Full-time
Pay: RM5,
- 00 - RM8,000.00 per month
Benefits: - Company car
Maternity leave
Schedule:
Supplemental pay types:
Education:
Experience:
- Data Engineering: 3 years (Preferred)
Language:
* Mandarin (Preferred)
