Senior Data Engineer

End Date

We Support Flexible Working – Click here for more information on flexible working options

Flexible Working Options

Hybrid Working

Job Description Summary

The Data Engineer will collaborate with the Data Operations, Software Engineers, Data Scientists, and Business SMEs to design, develop, integrate and test Data Product features on the product roadmaps to meet customer needs.
must have- Python, PySpark, BigQuery, GCP & Kafka 

Job Description

• Position: Senior Data Engineer 

  Location: Hyderabad 

  Years of experience:  9 – 14 years 

  We are looking for an experienced Data Engineer with strong expertise in Google Cloud Platform (GCP) and Python, PySpark, BigQuery, GCP & Kafka 

   

  Key Responsibilities: 

   

  • Build and maintain data pipelines on GCP (BigQuery, Dataflow, Dataproc, Pub/Sub, Cloud Storage). 

  • Develop scalable data processing solutions using Python and SQL. 

  • Work with batch and streaming data ingestion frameworks. 

  • Implement data quality checks, performance tuning, and optimisation. 

  • Collaborate with cross‑functional teams to deliver high‑quality data products. 

  • Ensure best practices in security, reliability, cost management, and documentation. 

  Required Skills 

  • Strong hands‑on experience in GCP services: BigQuery, Cloud Storage, Dataflow, Dataproc, Pub/Sub, Composer/Airflow. 

  • Excellent Python programming skills (PySpark is a plus). 

  • Strong SQL and experience with data modelling. 

  • Experience with CI/CD, Git, and basic DevOps workflows. 

  • Good understanding of data warehousing concepts. 

  • Ability to work independently and mentor junior engineers. 

  Good to Have 

  • Experience with Kubernetes/Docker. 

  • Exposure to Terraform or other IaC tools. 

  • Experience with Kafka or other messaging tools. 

  • GCP Professional Data Engineer certification. 

  Education 

  • Bachelor’s/Master’s degree in Computer Science, Engineering, or related field.