Position Summary:
We are looking for a Data Engineer with 2-5 years of experience and expertise in Azure Data Services to join our dynamic team. The ideal candidate will have hands-on experience in designing, developing, and maintaining scalable data pipelines and solutions in the Azure cloud environment. You will work with large datasets, ensure data quality, and contribute to data warehousing and analytics initiatives.
Required Skills & Qualifications:
- 2-5 years of experience as a Data Engineer, with a focus on Azure-based solutions.
- Strong proficiency in Azure Data Factory, Azure Synapse Analytics, and Azure SQL Database.
- Experience in data modeling, data transformation, and building ETL/ELT pipelines.
- Hands-on experience with Azure Data Lake, Azure Blob Storage, and other Azure storage services.
- Familiarity with big data processing frameworks (e.g., Spark, Hadoop) in Azure.
- Proficient in SQL and other data querying languages.
- Knowledge of cloud architecture, distributed systems, and data storage best practices.
- Strong understanding of data security and governance in the cloud.
- Experience with scripting languages such as Python, Shell, or PowerShell is a plus.
- Excellent communication and collaboration skills to work with cross-functional teams.
Key Responsibilities:
- Design, develop, and implement scalable ETL processes and data pipelines in Azure.
- Work with Azure data technologies such as Azure Data Factory, Azure SQL Database, Azure Synapse Analytics, and Azure Data Lake.
- Ensure the smooth ingestion, transformation, and storage of data from various sources.
- Optimize data storage solutions and query performance in Azure-based data systems.
- Collaborate with data scientists, analysts, and other stakeholders to create robust data models for analytics.
- Support the migration of legacy data systems to Azure cloud-based solutions.
- Maintain data integrity, quality, and security standards within the data ecosystem.
- Automate data integration tasks and continuously improve the data pipeline processes.
- Assist in the deployment, monitoring, and troubleshooting of data solutions.
- Create and maintain technical documentation related to data systems and processes.
