BettingJobs is working with a successful iGaming company with offices in Malaysia in their search for a Data Engineer Manager to join their team.
Our client are seeking a highly skilled and experienced Data Engineer Manager to join their team. The ideal candidate will have extensive experience with Google BigQuery (GBQ), PostgreSQL, and ETL technologies. This role will involve leading the data engineering team, designing and implementing scalable data pipelines, and optimizing our data infrastructure. You will work closely with cross-functional teams to ensure data availability, reliability, and performance.
Key Responsibilities:
Leadership and Strategy:
- Lead and mentor a team of data engineers, providing technical guidance and fostering a collaborative environment.
- Develop and execute data engineering strategies that align with business objectives.
- Collaborate with data scientists, analysts, and business stakeholders to understand data requirements and translate them into technical solutions.
Data Engineering and Implementation:
- Design, develop, and implement robust ETL processes to ensure the efficient ingestion, transformation, and loading of data from various sources into GBQ and PostgreSQL.
- Architect and manage scalable data pipelines and workflows to handle large volumes of data and support real-time analytics.
- Optimize and maintain data infrastructure, including GBQ and PostgreSQL databases, for performance and reliability.
Data Management and Optimization:
- Monitor data pipelines and databases to ensure data accuracy, consistency, and availability.
- Implement best practices for data governance, security, and compliance.
- Troubleshoot and resolve data-related issues, including performance bottlenecks and data quality problems.
Collaboration and Communication:
- Work closely with other engineering teams to integrate data solutions with existing systems and applications.
- Communicate complex technical concepts to non-technical stakeholders in a clear and effective manner.
- Prepare and present regular reports on data engineering metrics, progress, and initiatives.
Qualifications:
Education and Experience:
- Bachelor's degree in Computer Science, Engineering, Data Science, or a related field. Master's degree preferred.
- 7+ years of experience in data engineering, with at least 3 years in a lead or senior role.
- Proven experience with Google BigQuery (GBQ), PostgreSQL, and ETL technologies.
Technical Skills:
- Strong proficiency in SQL and experience with advanced SQL functions and performance tuning.
- Hands-on experience with ETL tools and frameworks (e.g., Apache Airflow, Talend, Informatica).
- Familiarity with cloud platforms (e.g., Google Cloud Platform, AWS) and data warehousing concepts.
- Knowledge of programming languages such as Python or Java for data processing and automation.
Soft Skills:
- Excellent leadership and team management skills.
- Strong problem-solving abilities and analytical skills.
- Effective communication and interpersonal skills.
Preferred Qualifications:
- Experience with additional data storage technologies and data lakes.
- Familiarity with machine learning and data science workflows.
- Certifications related to Google Cloud Platform or data engineering.
