IN_Senior Associate_Junior Cloud Data Engineer_D&A_Advisory_Noida

Job Description & Summary: We are looking for a skilled Cloud Data Engineer with strong expertise in Spark, Advanced SQL and in Python programming, to join our team in Noida. The candidate will be responsible for designing, developing, and optimizing scalable data solutions on the Azure cloud platform. You will play a critical role in building data pipelines and transforming complex data into actionable insights by leveraging cloud-native tools and technologies.

Responsibilities:

Design, develop, and manage scalable and secure data pipelines using Azure Databricks and Azure Data Factory. • Architect and implement cloud-based data solutions, integrating structured and unstructured data sources. • Write clean, efficient, and reusable code primarily in Python for cloud automation, data processing, and orchestration. • Build and optimize ETL workflows and ensure seamless data integration across platforms. • Develop data models using normalization and denormalization techniques to support OLTP and OLAP systems. • Manage Azure-based storage solutions including Azure Data Lake and Blob Storage. • Troubleshoot performance bottlenecks in data flows and ETL processes. • Integrate advanced analytics and support BI use cases within the Azure ecosystem. • Lead code reviews and ensure adherence to version control practices (e.g., Git). • Contribute to the design and deployment of enterprise-level data warehousing solutions. • Stay current with Azure cloud technologies and Python ecosystem updates to adopt best practices and emerging tools.

Mandatory skill sets:

Strong SQL skills (Must-Have) • Databricks (Must-Have) • Cloud Platform (Azure, AWS, or GCP). • Spark (hands-on experience) • Basic Python programming • Data modeling (Normalization & Denormalization) • Data warehousing and BI tools integration • Git (Version Control) • Building scalable ETL pipelines

Preferred skill sets (Good to Have):

Understanding of OLTP and OLAP environments, • Experience with Kafka and Hadoop, • DevOps for CI/CD integration, • Agile delivery methodologies, • 5+ years of overall experience in cloud engineering or data engineering roles, with at least 2-3 years of hands-on experience with Azure cloud services., • Proven track record of strong Python development with at least 2-3 years of hands-on experience.

Years of experience required:

• 5-8 years

Education qualification:

B.Tech/MCA/BCA/M.tech