Data Engineer Manager

About Us
Visa is a world leader in payments technology, facilitating transactions between consumers, merchants, financial institutions and government entities across more than 200 countries and territories, dedicated to uplifting everyone, everywhere by being the best way to pay and be paid.

At Visa, you'll have the opportunity to create impact at scale — tackling meaningful challenges, growing your skills and seeing your contributions impact lives around the world.

Join Visa and do work that matters – to you, to your community, and to the world. Progress starts with you.

Job Description

Data Engineer role for Asia Pacific Region is based out of Bangalore.  We are looking for an expert Data Engineer (Manager level) with deep expertise in big data/data warehousing and can build large-scale data processing systems by using the latest database and data processing technologies.  This is a Pan-regional position and plays a critical role in enabling the data platforms through which Data Scientists, Analysts, and BI Users drive solutions for our Visa clients.  

The Data Engineering Manager takes responsibility for building and running data pipelines, designing our local data warehouse, data marts and data frameworks, and catering for different data presentation techniques. We are looking for a talented, technical, proactive, energetic, and passionate person who embraces challenges and is a proven problem solver.

He/she will bring in deep expertise in data pipeline design and development with a strong background in developing and enhancing data Pipelines at scale to unlock business value.

Principal Responsibilities:

• Create and maintain optimal data pipelines, data marts and architecture(s), based on our Global Technology Stack
• Collaborate with the global data engineering team to adopt global engineering standards in AP region.
• Develop custom-built packages to support the needs of Data Scientists across the region
• Provide technical and business support for development of new platforms, tools for data science using both on-prem and cloud technologies.
• Identify, design, and implement internal process improvements to provide greater scalability to our existing client solutions
• Work with broader business stakeholders to assist clients and consultants with their data and infrastructure needs
• Partner with Technology on quarterly planning cycle and support management with relevant metrics to evaluate performance, stability, and reliability of various tools.
• Continuous focus on improving Infrastructure efficiency by analyzing logs of queries, tuning settings, translating queries if required.
• Review scripts for best practices, educating user base and building training assets for beginner and intermediate users.
• Increase consistency of tool usage by developing guidance for specific data science applications and sharing with user community

Desired Attributes:

• Self-Driven and Proactive: A highly motivated individual who takes initiative to identify potential issues and implement solutions without direct supervision.
• Dedicated: Committed to ensuring the highest standards of quality and reliability for our data operations.
• Proactive Communicator: Excellent verbal and written communication skills, with the ability to provide clear and timely updates to stakeholders on pipeline status and incidents.
• Collaborative Spirit: A team player who can work effectively with data engineers, analysts, and other teams to achieve common goals.
• Detail-Oriented: A keen eye for detail to ensure data accuracy and process integrity.

This is a hybrid position. Expectation of days in the office will be confirmed by your Hiring Manager. 


Visa requires at least 3 days in office, expectations of these days will be confirmed by your Hiring Manager.

Qualifications

Basic Qualifications: 5 or more years of relevant work experience with a Bachelor's Degree or at least 2 years of work experience with an Advanced degree (e.g. Masters, MBA, JD, MD) or 0 years of work experience with a PhD Preferred Qualifications: 6 or more years of work experience with a Bachelor's Degree or 4 or more years of relevant experience with an Advanced Degree (e.g. Masters, MBA, JD, MD) or up to 3 years of relevant experience with a PhD 8+ years’ experience plus a bachelor’s degree in computer science, information science, mathematics, or similar/related streams. Graduate master’s degree is a plus. Skill Level: Hands on Experience in API Development and API Publishing along with knowledge of API Integration. Hands on experience in a data engineering with good knowledge of distributed data architecture, commonly used BI tools, and approaches/packages used in machine learning build. Strong understanding of Hadoop architecture and its core components, including HDFS, YARN, and MapReduce. Database Knowledge: Solid understanding of SQL and experience working with various database systems. Expertise in creating production software/systems in Python and/or Scala, and a proven track record of identifying and resolving performance bottlenecks in production systems. Experience with complex, high volume, multi-dimensional data, as well as machine learning models based on unstructured, structured, and streaming datasets. Knowledge of Gen AI (Hands on preferred) and related tools along with working knowledge of LLM’s. Ability to learn new tools and paradigms as data science continues to evolve at Visa and elsewhere. Demonstrated ability to incorporate new techniques to solve business problems. Good communication and presentation skills with ability to interact with different cross-functional team members at varying level Self-motivated, results oriented individual with ability to handle multiple projects concurrently. Hands On Knowledge of Cloud Services such as AWS including Design and Development of Data Pipelines on AWS. (Good to Have) Understanding of Payments or Banking Industry will be a plus. Certification in Hadoop (Cloudera or Hortonworks) and Apache Spark preferred. Understanding of Data Visualization Tools like Tableau / Power BI. Cloud Certification in AWS ( Intermediate/Advanced Level) Desired Attributes Self-Driven and Proactive: A highly motivated individual who takes initiative to identify potential issues and implement solutions without direct supervision. Dedicated: Committed to ensuring the highest standards of quality and reliability for our data operations. Proactive Communicator: Excellent verbal and written communication skills, with the ability to provide clear and timely updates to stakeholders on pipeline status and incidents. Collaborative Spirit: A team player who can work effectively with data engineers, analysts, and other teams to achieve common goals. Detail-Oriented: A keen eye for detail to ensure data accuracy and process integrity.

Visa is an EEO Employer

Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability or protected veteran status. Visa will also consider for employment qualified applicants with criminal histories in a manner consistent with EEOC guidelines and applicable local law.