DescriptionAmazon Payments Data Team (APD) is responsible for managing all aspects of Amazon Payment Products (APP) organization's analytic strategy, projects and systems. This includes developing analytic strategy, implementing data warehousing and business intelligence tools, managing data infrastructure, applications and training, support for all stakeholders from ACC, CBCC, MAPLE, PLCC and 3P business areas. The team is the source of payments data for analytics and it oversees tasks such as data integration, data governance, data quality and metadata management.MAPLE (Merchandising Automation Program and Learning Engine) is a comprehensive, end-to-end merchandising and machine learning recommendation system designed to automate the merchandising of Amazon Payments' products and services. The system encompasses offer eligibility and content rendering services, ML recommendations, a promotions optimization engine, custom merchandising scheduling tools, front-end customer experience features, and dedicated content management for ASIN landing pages. MAPLE's integrated components enable global business lines within Amazon Payments to drive growth of high value actions through experimentation and optimization, all while maintaining compliance with industry regulations.APD is looking for a seasoned Data engineer for the MAPLE business component. As a Senior Data Engineer in the APD's MAPLE team, you are expected to demonstrate technical leadership and excel in delivering efficient and effective data solutions with no or minimal guidance, focusing on complex problem areas in both existing and new initiatives. You take a holistic, long-term view of your team's data architecture, anticipating access patterns and removing bottlenecks. Your expertise ensures that data is auditable, available, and accessible, and you proactively address architectural deficiencies. You demonstrate a deep understanding of the business impact of your systems, making judicious technical trade-offs between short-term needs and long-term business goals. Your influence extends to team strategy, driving meaningful discussions with stakeholders and guiding technology choices. You possess a comprehensive understanding of system limitations and the rationale behind existing solutions, enabling you to make appropriate architectural decisions.Your leadership extends beyond technical prowess to encompass ownership of team architecture and the promotion of data engineering best practices. You simplify complex systems, set standards, and work to resolve root causes of persistent problems, often influencing decisions across teams. Your ability to build consensus and navigate conflicting viewpoints is crucial in driving the organization forward. Additionally, you actively contribute to the professional development of your colleagues through mentoring and coaching, ensuring that your team remains strong and self-sufficient. Your code submissions and overall approach to work serve as exemplars of excellence, producing data solutions that are innovative, secure, maintainable, scalable, and easily adopted by customers and contributors alike.Key job responsibilitiesDesign, develop, and maintain new and existing data pipelines to drive key business decisions.Design, implement, and support a platform providing secured access to large datasets.Recognize and adopt best practices in data integrity, test design, analysis, validation, and documentation.Tune data pipelines and query performance using profiling tools and SQL.Analyze and solve problems at their root, stepping back to understand the broader context.Learn and understand a broad range of Amazon's data resources and know when, how, and which to use and which not to use.Keep up to date with advances in big data technologies and run pilots to design the data architecture to scale with the increased data volume using AWS.Continually improve ongoing reporting and analysis processes, automating or simplifying self-service support for datasets.Interface with other technology teams to extract, transform, and load data from a wide variety of data sources using SQL and AWS big data technologiesExplore and learn the latest AWS technologies to provide new capabilities and increase efficiencyCollaborate with Product Managers, Business Intelligence Engineers and Data Scientists to implement advanced analytics algorithms that exploit our rich data sets for statistical analysis, prediction, clustering and machine learningBasic Qualifications
5+ years of data engineering experience
Experience with data modeling, warehousing and building ETL pipelines
Experience with SQL
Experience in at least one modern scripting or programming language, such as Python, Java, Scala, or NodeJS
Experience mentoring team members on best practices
Preferred Qualifications
Experience with big data technologies such as: Hadoop, Hive, Spark, EMR
Experience operating large data warehouses
Amazon is committed to a diverse and inclusive workplace. Amazon is an equal opportunity employer and does not discriminate on the basis of race, national origin, gender, gender identity, sexual orientation, protected veteran status, disability, age, or other legally protected status.Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.Our compensation reflects the cost of labor across several US geographic markets. The base pay for this position ranges from $139,100/year in our lowest geographic market up to $240,500/year in our highest geographic market. Pay is based on a number of factors including market location and may vary depending on job-related knowledge, skills, and experience. Amazon is a total compensation company. Dependent on the position offered, equity, sign-on payments, and other forms of compensation may be provided as part of a total compensation package, in addition to a full range of medical, financial, and/or other benefits. For more information, please visit https://www.aboutamazon.com/workplace/employee-benefits . This position will remain posted until filled. Applicants should apply via our internal or external career site.