Mastercard→
Senior Data Engineer at Mastercard in Pune, Maharashtra, India
ExperiencedOn-siteFull-timePune, Maharashtra, India
Job Description
Senior Data Engineer
Location: Pune, India
Our Purpose
Mastercard powers economies and empowers people in 200+ countries and territories worldwide. Together with our customers, we’re helping build a sustainable economy where everyone can prosper. We support a wide range of digital payments choices, making transactions secure, simple, smart and accessible. Our technology and innovation, partnerships and networks combine to deliver a unique set of products and services that help people, businesses and governments realize their greatest potential.
Title and Summary
Senior Data Engineer
We are looking for a Data Engineer to join our Data Engineer team. This is a pivotal role, responsible for supporting multiple Data Analysts and Data Scientists day-to-day and assisting various data-driven requests across the company. The position involves a wide variety of technical skills, from coding to infrastructure, from data analysis to database management. The ideal candidate will have experience working with large-scale data and building automated data ETL processes for large-scale data analysis. ODS or data warehousing experience would be ideal.
Key responsibilities include:
• Build and maintain database technologies, environments, and applications, seeking opportunities for improvements and efficiencies.
• Should have strong hands-on experience and knowledge on PL/SQL and Java and Spring boot
• Write SQL statement procedures to optimize SQL execution and query development.
• Effectively utilizes various technology like PL/SQL packages for ETL.
• Manages the deployment of data solutions that are optimally standardized and database updates to meet project deliverables.
• Leads database security posture, which includes proactively identifying security risks and implementing both risk mitigation plans and control functions.
• Supports process improvement efforts to identify and test opportunities for automation and/or reduction in time to deployment.
• Participating in the entire solution development cycle from requirement gathering to solution deployment.
• Working with multiple stakeholders across teams to fulfill ad-hoc investigations, including large-scale data extraction, transformation, and analyses.
• Supporting production code to produce comprehensive and accurate data artifacts.
• Promoting strategies to improve our data modeling, quality, and architecture.
• Must be familiar with DevOps tools like Jenkins, Cloud bees, Sonar and more.
• Good to have knowledge on cloud, Databricks, Delta Lake, Spark, Hadoop, Power BI.
All About You:
• Should have experience working on Oracle (PL/SQL) writing optimized SQL queries and packages
• Skilled in Java and Spring boot to write application programming code/ build services.
• Highly skilled in SQL knowledge and relational databases.
• Experienced with developing and maintaining data pipelines for the extraction, transformation, and/or loading of large-scale data (knowledge on any ETL is good to have).
• Strong with Data warehousing concepts and ETL concepts.
• Experienced with working with large data sets. You’ve implemented parallel processing and have dealt with the limitations and challenges of working with terabytes of data.
• Strong analytics skills related to working with unstructured datasets.
• Experienced with performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
• Experience working with multiple global customers
• Good understanding of technical solutions and software patterns (including architectural & design patterns) at various levels.
• Solid experience of working in project teams
• Desire to stay abreast of new development tools and methods
• Excellent written and verbal communication skills
• Understanding of PCI, PII and other financial security requirements will be preferred
• Experienced with database administration and query optimization with different databases.
• Capable of effectively communicating requirements and solutions to audiences with different skill sets.
• Familiarity with the core requirements of data analysis and/or presentation.
• Focused, innovative, and self-sufficient problem solver who is willing to independently and creatively deep-dive into an issue, cut to the heart of a problem, and solve it.
Bonus Points if:
You have any prior experience with any of the following:
• Jenkins, JFrog, Datadog, Splunk.
• Familiarity with cloud data platforms like Snowflake and Databricks.
• Knowledge on distributed computing architecture like Cloudera Cluster, Hadoop.
• Knowledge on application programming Spark (Scala).
• Javascript, regex
• BI Tools: PowerBI, Tableau
Corporate Security Responsibility
Abide by Mastercard’s security policies and practices;
Ensure the confidentiality and integrity of the information being accessed;
Report any suspected information security violation or breach, and
Complete all periodic mandatory security trainings in accordance with Mastercard’s guidelines.