Senior Data Engineer
As a Senior Data Engineer, you will play a crucial role in building Client's next-generation data platform, helping to bring smiles to our customers faces. We're looking for someone who thinks outside the box, has an innovative mindset, and is prepared to help scale our data infrastructure from the ground up.
If you have an entrepreneurial spirit, thrive in a start-up environment, and excel at solving complex problems, our global team in Malaysia is waiting for you!
Core Responsibilities
- Design and implementation of the data engineering tech stack and ETL pipelines needed to build a portfolio of actionable, accurate datasets to support business intelligence, product experimentation, and machine learning.
- Contribute to the definition of engineering and data science best practices to ensure the development of well-crafted, pragmatic and elegant solutions.
- Engage with local and global stakeholders to evolve and generalize data models and definitions.
- Foster collaboration, knowledge sharing and data literacy between teams.
- Deeply understand and strive to improve data organization, data management, and data governance best practices.
- Advocate code quality and documentation.
- Coach junior data engineers (and data scientists) through code reviews, pair programming, and tech talk sessions.
- Partner effectively with product and other stakeholders, to drive successful solutions.
What We're Looking For
- Strong experience (5-7 years) designing and developing data transformation, data transport and data serving applications in a cloud environment.
- Excellent knowledge of Python.
- Very good knowledge of Airflow.
- Very good knowledge of SQL.
- Experienced with AWS (Redshift, DMS, Secret Manager, RDS, SQS and Lambda Functions). AWS Certifications would be a Bonus.
- Prior Practical Experience with DBT (Cloud or Core) would be a plus.
- Has practical experience in GCP (Big Query, Dataflow, Secret Manager, Cloud SQL, Cloud Functions and Pub/Sub). GCP Certifications would be a Bonus.
- Experience with practices such as DevOps & MLOps is a plus.
- Experience with CI/CD practices and tools.
- Experience with Git and Github Actions.
- Ability to work independently and as part of a team.
Join us in Malaysia and be part of our journey