Azure Data Engineer

This is Pragati from Nityo Infotech. We have a requirement for Azure Data Engineer..

We are looking for immediate or max 30 days notice. Candidates from any part of Asia can apply.

JD :

Description of services and expected results:

-

Design and develop data pipelines on Azure for ingesting, processing, and

storing data from various sources

-

Develop and maintain Azure-based data framework solution, including data lake

and data warehouse approaches

-

Collect requirements from data analysts, data scientists, and other stakeholders

to build solutions that meet their requirements

-

Implement security measures to ensure that our data is protected at all times

-

Optimize data pipelines and queries for performance, scalability, and cost

efficiency

-

Troubleshoot data-related issues and provide solutions in a timely manner

-

Recommend new technologies and best practices that can improve our data

platform and solutions

-

Develop and maintain documentation for the data engineering team, including

data models, data flow diagrams, and technical specifications

-

Provide feedback in code reviews to ensure that coding standards and best

practices are followed

4. Skill Requirements:

Level: Senior Data Engineer

Skills:

1. Azure Data Technologies: Azure Data Factory (ADF)

Azure Databricks

Azure Synapse Serverless

Azure Data Lake Storage (ADLS)

Azure Blob Storage

Azure SQL Database

2. Big Data Technologies:

Apache Spark

Delta Lake

Kafka (optional but beneficial)

Spark Streaming (optional but beneficial)

3. Programming and Scripting Languages:

Python

SQL

4. Data Modeling and ETL:

ETL/ELT processes

Data transformation and cleansing

Data warehousing concepts (optional but beneficial)

5. Data Integration:

Integration with various data sources (on-premises and cloud-based)

Real-time data processing and streaming (optional but beneficial)

6. DevOps and CI/CD:

Azure DevOps for CI/CD pipelines

Interested candidates, please apply.