Sr Data Engineer (Scala/Spark)

As the Senior Data Engineer for the Data & Analytics team, you will have the opportunity to build data pipelines to land, profile, and store multiple internal & external datasets, and build applications that surface this data to support our business partners’ strategic decision making for analytics solution in media industry.We work in a very agile environment, where product specifications are flexible and often change rapidly over time. We are seeking people who are comfortable with ambiguity and figuring out an execute. While the key focus for this role is on backend engineering, the ability to architect in a cyber compliant way will be especially considered. Be a Contributor to the overall Data Product roadmap by working closely with our business partners to understand their challenges and develop analytical tools to help drive business decisions.Leverage prototyping methodologies to propose and design creative business solutions that exploit our broad toolset of technologies (AWS tech stack, data lake, Python, Spark, Scala, Iceberg, EMR Serverless, SNS, SQS, AWS Lambda, Step Functions, Event Triggers etc.)Educate and inform business partners on architecture, capabilities, best practices, and solutions to build out future enhancements.Assist in analyzing business requirements, source systems, understand underlying data sources, transformation requirements, data mapping, data model and metadata for reporting solutions.Write easily understood documentation and architecture diagrams and keeping them up to date as code and frameworks change over time.