IN_Manager_Azure Data Engineering_Data and Analytics_Advisory_Noida

Job Description & Summary: We are looking for a skilled Azure Cloud Data Engineer with strong expertise in Python programming, Databricks, and advanced SQL to join our team in Noida. The candidate will be responsible for designing, developing, and optimizing scalable data solutions on the Azure cloud platform. You will play a critical role in building data pipelines and transforming complex data into actionable insights by leveraging cloud-native tools and technologies. 

Responsibilities: 

• Design, develop, and manage scalable and secure data pipelines using Azure Databricks and Azure Data Factory. 

• Write clean, efficient, and reusable code primarily in Python for cloud automation, data processing, and orchestration. 

• Architect and implement cloud-based data solutions, integrating structured and unstructured data sources. 

• Build and optimize ETL workflows and ensure seamless data integration across platforms. 

• Develop data models using normalization and denormalization techniques to support OLTP and OLAP systems. 

• Manage Azure-based storage solutions including Azure Data Lake and Blob Storage. 

• Troubleshoot performance bottlenecks in data flows and ETL processes. 

• Integrate advanced analytics and support BI use cases within the Azure ecosystem. 

• Lead code reviews and ensure adherence to version control practices (e.g., Git). 

• Contribute to the design and deployment of enterprise-level data warehousing solutions. 

• Stay current with Azure cloud technologies and Python ecosystem updates to adopt best practices and emerging tools. 

Mandatory skill sets: 

• Strong Python programming skills (Must-Have) – advanced scripting, automation, and cloud SDK experience 

• Strong SQL skills (Must-Have) 

• Azure Databricks (Must-Have) 

• Azure Data Factory 

• Azure Blob Storage / Azure Data Lake Storage 

• Apache Spark (hands-on experience) 

• Data modeling (Normalization & Denormalization) 

• Data warehousing and BI tools integration 

• Git (Version Control) 

• Building scalable ETL pipelines 

Preferred skill sets (Good to Have): 

• Understanding of OLTP and OLAP environments 

• Experience with Kafka and Hadoop 

• Azure Synapse Analytics 

• Azure DevOps for CI/CD integration 

• Agile delivery methodologies 

Years of experience required: 

• 6+ years of overall experience in cloud engineering or data engineering roles, with at least 2-3 years of hands-on experience with Azure cloud services. 

• Proven track record of strong Python development with at least 2-3 years of hands-on experience. 

Education qualification: 

BE/B.Tech/MBA/MCA