Lead Data Engineer (Director)


Bengaluru, Karnataka, India


Jul 5

This job is no longer accepting applications.

Company Description

As the world's leader in digital payments technology, Visa's mission is to connect the world through the most creative, reliable and secure payment network - enabling individuals, businesses, and economies to thrive. Our advanced global processing network, VisaNet, provides secure and reliable payments around the world, and is capable of handling more than 65,000 transaction messages a second. The company's dedication to innovation drives the rapid growth of connected commerce on any device, and fuels the dream of a cashless future for everyone, everywhere. As the world moves from analog to digital, Visa is applying our brand, products, people, network and scale to reshape the future of commerce.

At Visa, your individuality fits right in. Working here gives you an opportunity to impact the world, invest in your career growth, and be part of an inclusive and diverse workplace. We are a global team of disruptors, trailblazers, innovators and risk-takers who are helping drive economic growth in even the most remote parts of the world, creatively moving the industry forward, and doing meaningful work that brings financial literacy and digital commerce to millions of unbanked and underserved consumers.

You're an Individual. We're the team for you. Together, let's transform the way the world pays.

Job Description

You may have noticed that payment has become a very active/hot area in the last several years. Given the strong demands and innovation, this will be a very exciting area in the next 5 to 10 years. VISA is clearly a very strong leader in the payment industry, and is in a fast pace of technology transformation. For a payment system to work well, advance technologies such as data platform, big data, data mining, machine learning, cloud, etc. are critical. In VISA, we have all of these. The Data Platform Department is in the center for many of these technologies and development.

The Data Platform team is a key component of Visa's Technology organization that provides an enriched and valuable ecosystem of data platform and data services that drive innovation for our partners and clients, within Visa and globally. Data is the most valuable asset in Visa. The Data Platform Department is dedicated to develop advanced technology (e.g. Cloud, Machine Learning and Big Data), systems and services to make data secure, high quality, rich, fast, and easy to use, therefore enabling Visa the ability to leverage its data asset in an effective and timely manner to maximize technology/business development and differentiate Visa from others in the payment industry.

The department maintains over 100 petabytes of data supporting over 100 services for various internal lines of business and external clients.

The Data as a Service (DaaS) Data Assets Group in the Data Platform Department develops techniques, platforms, systems, and services to ensure the data pipeline development and services are efficient, high quality, rich, and easy to use.

Visa is seeking highly energetic, passionate, technology enthusiast for Data Platform team.

The successful candidate will work as a Lead Data Engineer and be part of the Data as a Service team to design and develop solutions for all data requirements.. This role will assume technical ownership of multiple applications and create robust and scalable solutions.


* Participate in design discussions, create solutions, develop programs and ensure successful delivery of business capabilities

•Take complete end-to-end ownership of one or more applications

•Translate business requirements and source system understanding into technical solutions

•Work with business partners directly to seek clarity on requirements and propose solutions

•Define solutions in terms of components, modules and algorithms

•Development and Implementation of the proposed solution

•Identify or develop software frameworks to be used

•Refactor existing solutions to make it reusable and scalable

•Come up with Coding and Design best practices

•Lead and mentor a small team, deliver tech talks to wider audience

•Thrive in self-motivated internal-innovation driven environment

•Adapt to new application knowledge and changes



•Bachelors in Computer Science, or Information Systems or related fields.

• 14+ years of experience in data technologies and applications development.

• 8+years of experience in building real-time and batch applications using Spark/Scala/Kafka. • • Prior experience in the continuous advancement of the data infrastructure for Petabyte scale of data.

• 7+ years of experience in Hadoop using Core Java Programming, Spark, Kafka , Hive, Pig scripts, Sqoop on Linux/Unix environment..

Open source contribution/committs will be a plus 

•Agile development experience

•Expertise in Object Oriented Programming Language - Java/ Python

•Strong algorithms and data structures

•Ability to generate creative and innovative solutions for QA challenges and constraints

•Strong knowledge of database concepts and UNIX/LINUX

•Expert level SQL skills for data manipulation (DML) and validation (DB2)

•Experience using version control(Git) and bug tracking tools

•Result oriented with strong analytical and problem solving skills

•Work independently with minimal supervision

•Comfortable learning new technologies quickly

•Experience leading a small team good to have

•Excellent team player

•Strong interpersonal and communication skills

You must be logged in to to apply to this job.


Your application has been successfully submitted.

Please fix the errors below and resubmit.

Something went wrong. Please try again later or contact us.

Personal Information


View resume



Leading global payment solutions