Equal Opportunity Employer
All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, age, national origin, protected veteran status, or disability status. EEO/Disabled/Vets
Job Description :
We are looking for a Senior Data Engineer with experience in excellent analytical abilities in GCP BigQuery, ETL/BI, Python, Composer/Airfl ow, SQL, GCP Services - with the ability to operate in an agile environment and keen to detail while understanding the larger data warehouse.
Skills & Competencies
➔ A minimum of 4.5+ years of working experience as a hands-on data engineering is a must
➔ Advanced Degree in the fi eld of Computer Science, Data Engineering, Data Analytics or equivalent discipline
➔ Strong programming experience with Python, SQL, ETL and effi ciently querying big datasets using SQL
➔ Prior experience with CircleCI CI/CD, Terraform and Github version control is a must
➔ Solid understanding of Data Collection, Data Ingestion, Data Integration, and Data Operations & Maintenance
➔ Implement data governance practices, including data quality, security, and compliance, in line with organizational standards.
➔ Domain knowledge on News, Media & Communications is an added advantage.
R E S P O N S I B I L I T I E S
➔ Design, build, and maintain scalable ETL/ELT pipelines in Google Cloud, using tools like Cloud Composer (Airfl ow), Dataproc and BigQuery.
➔ Collaborate with cross-functional teams to defi ne data architecture and data warehouse requirements
➔ Automate data pipelines, ETL/ELT processes, and data integration workfl ows using infrastructure-as-code (IaC) and confi guration management tools
➔ Deep understanding of BigQuery, including SQL, optimization techniques, partitioning, clustering, and performance tuning.
➔ Deliver production quality, modular, reproducible code in Python, SQL
➔ Implement continuous integration and continuous deployment (CI/CD) pipelines for data pipelines and data-related applications
➔ Keep abreast of the latest developments in the fi eld through continuous learning and proactively champion promising new methods relevant to the problems at hand.
Our Tech Stack
● Google Cloud Platform is IaaS
● BigQuery, DataProc, Python, Pyspark, SQL
● Composer / Airfl ow - orchestration tools
● Terraform, CircleCI, CI/CD, GIthub, Jira, Confl uence
This job is posted with NTS Technology Services Pvt. Ltd.Job Category: