Want to know if this job is worth applying to?
India
Remote only
This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Lead Data Engineer 4C based in India.
In this role, you will lead a team of data engineers in designing and delivering scalable, reliable Big Data solutions. You will oversee the development of robust data pipelines and ETL processes, ensuring that data systems meet high standards of quality, integrity, and security. Working closely with business stakeholders, you will translate complex requirements into effective technical architectures and engineering solutions. You will also drive performance optimization, data integration, and continuous improvement across the data ecosystem. Beyond hands-on technical leadership, you will mentor engineers, promote best practices, and support a culture of knowledge sharing. This is a full-time, remote opportunity in a global, technology-driven environment.
Lead and coordinate a team of data engineers in the design, development, and implementation of Big Data solutions.
Design, build, and maintain scalable, reliable data pipelines and ETL processes to support business and analytical requirements.
Ensure data quality, integrity, consistency, and security across data platforms and systems.
Collaborate with business stakeholders and technical teams to understand requirements and translate them into effective data engineering solutions.
Provide technical direction, guidance, and mentorship to junior data engineers, encouraging best practices and continuous development.
Monitor, analyze, and troubleshoot data systems to identify performance issues and improve efficiency, reliability, and scalability.
Oversee data integration and data modeling activities, ensuring solutions are aligned with architectural and business needs.
Promote secure coding practices and contribute to CI/CD processes for data engineering workflows.
Develop, maintain, and update technical documentation covering data processes, systems, pipelines, and infrastructure.
Stay informed about emerging Big Data technologies, tools, and industry trends, identifying opportunities to improve engineering practices and solutions.
Requirements:
Bachelor's degree in Computer Science, Data Science, Statistics, or a related discipline; a master's degree in Data Science is also relevant.
Strong professional experience in data engineering, including designing and implementing enterprise-scale Big Data solutions.
Demonstrated experience leading or guiding data engineering teams and providing technical mentorship.
Proficiency with Apache Spark, Apache Kafka, and Apache Airflow.
Experience designing and managing data ETL processes, data pipelines, and integration workflows.
Knowledge of data modeling, data quality management, and secure data engineering practices.
Experience with Databricks and Snowflake platforms.
Familiarity with AWS Data Pipeline and API integration.
Strong SQL skills and experience with performance tuning and system performance monitoring.
Experience with CI/CD practices, Git, and infrastructure automation using Terraform.
Ability to translate business requirements into scalable technical solutions and collaborate effectively with stakeholders.
Strong analytical, troubleshooting, communication, and leadership skills.
Proficiency in English at C2 level.
Relevant Certifications:
Certified Data Management Professional.
Databricks Certified Associate Developer for Apache Spark 3.0.
Databricks Certified Associate Developer for Apache Spark.
Microsoft Certified: Azure Data Engineer Associate.
Oracle Database 12c Certified Implementation Specialist.
Benefits:
Fully remote work arrangement within India.
Full-time, regular employment.
Opportunity to lead data engineering initiatives supporting global enterprise transformation.
Exposure to advanced Big Data technologies and AI-driven innovation.
Mentorship and professional development opportunities.
Access to learning resources and opportunities to expand technical expertise.
Collaborative environment with experienced technology professionals.
Inclusive, values-driven workplace focused on integrity, innovation, and continuous learning.