We are seeking an experienced Data Engineer - ETL to join our dynamic team in Kuala Lumpur. This role is essential in supporting data analytics operations and projects within a manufacturing environment.
Key Responsibilities:
- ETL Solutions Development: Deliver reporting ETL (extract-transfer-load) solutions using data from Manufacturing, Enterprise, and other source systems/applications in Hadoop and cloud environments.
- Automation and Data Integration: Build and automate necessary data feeds (ETL/ELT) for data transfer from various source applications to target applications, focusing on administration, optimization of performance, and monitoring.
- Production Support: Troubleshoot existing production portfolios and provide effective fixes and solutions.
- SDLC Participation: Engage in all aspects of the software product development life cycle (SDLC), including requirement gathering, workflow architecture design, development, testing, documentation, and leading User Acceptance Testing (UAT).
- Collaboration: Work collaboratively with DBAs, infrastructure teams, network, data enablement teams, and application BA analysts to improve data governance, methodologies, and processes.
- Data Analytics Passion: Demonstrate a strong interest in data mining, scripting, problem-solving, and data analysis while exploring new technologies in the data analytics field.
- Knowledge Sharing: Share theoretical and practical knowledge with team members.
Qualifications:
- Education: Undergraduate or Master's degree in Computer Science, Information Technology, Engineering, or related courses.
- Experience: Minimum 5 years of IT working experience, particularly in Business Intelligence or Data Analytics roles.
- ETL Expertise: Strong experience in data integration (ETL), mining, and analytics with complex, high-volume, high-dimensionality data. Proficient in creating ETL scripts.
- Development Experience: Familiarity with Data Lake solutions such as Data Bricks, Azure DataLake, AWS, Snowflake, and Cloudera. Experience in Hadoop environments using ETL framework components (e.g., Nifi, Kafka, Pentaho, Spark).
- Cloud Development: Experience in cloud environments is preferred. Relevant certifications (HCIA/HCIP/HCIE in cloud computing, AWS, Azure, GCP) are a plus. Familiarity with AWS services (S3, Lambda, EMR, EC2) is advantageous.
- SQL Proficiency: Strong SQL skills are a must, with experience in databases such as MSSQL Server, Teradata, or Oracle.
- BI Tools Exposure: Experience with Business Intelligence tools (e.g., Tableau, Power Query, Power BI) is highly recommended.
- Manufacturing Background: Experience in the manufacturing sector is a plus but not essential.
- Additional Skills: Knowledge of programming languages such as PHP, Python, Java, or JavaScript is an added advantage. Strong visualization capabilities and a passion for quantitative analysis (statistics, math, modeling).
- Communication Skills: Excellent written and verbal communication skills in English, essential for collaboration with multiple organizations within the company.
- Analytical Mindset: Result-oriented with strong analytical, troubleshooting, and problem-solving skills, able to work with minimal supervision.
- Agile Knowledge: Familiarity with Project Management and Safe Agile processes is an added advantage.
- Virtual Team Experience: Experience working in a virtual team environment is a plus.
If you are a motivated Data Engineer looking to elevate your career, we would love to hear from you!
