IN_Associate_Python & CI/CD Developer_Digital Integration_Advisory_Kolkata

Job description & summary:

We are looking for a Python developer / data engineer to create python scripts to gather data from APIs, cloud files, etc and process it for visualization.

Responsibilities: 

Create python scripts for data transformation using python Databricks 

Troubleshoot issues with data processing or data storage 

Perform data manipulations with SQL and T-SQL 

Leverage requests library to extract data from tools 

Support necessary stakeholders' interaction/ calls

Create CI/CD pipelines to run unit tests and deploy code

Manage infrastructure pipelines with Terraform or Databricks DABs

Create and deploy function apps for event-based data ingestion

Mandatory Skill sets:

.Net

Preferred Skill sets:

NumPy, and Pandas 

Project delivery in an agile manner 

Experience with ETL and ELT workflows 

Foundational SQL knowledge 

Years of Experience Required:

Experience with Azure cloud infrastructure such as function apps, logic apps, blob storage

Experience with SDLC, DevOps, Azure DevOps / GIT version control is beneficial 

Strong analytical and problem-solving skills 

Strong communication skills 

Strong attention to detail and highly organized 

Education Qualifications: 

A bachelor's degree in a related field of study with a preference for Engineering or Computer Science 

Azure Data Engineer Associate certification is beneficial