If interested, Kindly share your CV at [Confidential Information]
Role: Senior Data Engineer(AWS/Databricks)
Location: KL, Malaysia
Exp: 8+ Years
Job Description:
- A minimum of 8 years previous experience as a Data Engineer with at least 3+ years of hands on AWS technical/development experience
- Previous experience in programming eg. Core Java/Python/Scala programming; Hadoop Stack eg. Hive, Spark (Core and Streaming), Kafka, Flink, NIFI;
- Experience working on stream transform using Spark
- Experience working on change data capture in a big data ecosystem;
- Experience in building real time or batch ingestion and transformation pipelines;
- Should be able to work on AWS - S3, EMR, Redshift
- Should be able to implement the Data Vault & start schema Framework using redshift
- Should be able to work with Devops team on Orchestrating Airflow works
- Good understanding on iPython and Bigdata and Hands on SQL
