Principal Data Engineer

As a senior member of the global data engineering team, reporting to the Data and Analytics Manager (US), this role has a primary focus on leading and contributing to our enterprise data warehousing and reporting deliverables. Responsibilities include leading the design, creation, and maintenance of business intelligence assets and reports that drive innovation, client value and business efficiency. This position will be working primarily in one of our largest business units, leveraging deep expertise with multi-terabyte database systems, modern cloud data warehousing (Snowflake), and CI/CD practices (GitFlow, GitHub Actions). Assisting primarily through architecting, maintaining, and implementing an array of data synchronization efforts across numerous systems both on-premises and in the cloud. You will coordinate with our data architects, product management, and IT management, and mentor other engineers to ensure that our data pipelines for both internal operations and customer reporting are accurate, scalable, secure, and aligned with Xplor’s strategic initiatives like Orbit Planning.Responsibilities:Include designing, creating, and maintaining business intelligence assets and reports that drive innovation, client value and business efficiency. This position will be working primarily in one of our largest business units and experience with multi-terabyte database systems is required. Assisting primarily through maintaining and implementing an array of data synchronization efforts across numerous systems both on-premises and in the cloud. You will coordinate with our data architects, product management, and IT management to ensure that our data pipelines for both internal operations and customer reporting are accurate, scalable, and secure. This will occur through several initiatives:Leading the maintenance and enhancement of existing reporting and BI solutions as needed for functionality or efficiency.Architecting and developing complex reporting stored procedures.Overseeing and contributing to ELT development and pipeline automation using tools like FiveTran, Coalesce, Python, and YAML.Driving and executing the migration of legacy reporting technologies to cloud platforms such as Snowflake.Championing and implementing best practices in data engineering, including GitFlow version control, GitHub Actions for CI/CD, and infrastructure automation.Providing technical leadership and mentoring to junior and mid-level data engineers.Leading and actively participating in team efforts within Agile/Scrum/Kanban methodologies, aligning with Xplor's Orbit Planning process.Collaborating on data architecture for multi-tenanted and single-tenanted systems across diverse database technologies (SQL Server, Postgres, MySQL).Key Responsibilities:The primary tasks, duties, and responsibilities are:Analyse customer and marketing data to identify business opportunities and threats, and create high-quality, insightful reports and dashboards.Lead the development and maintenance of BI solutions and ELT development based on agreed requirements.Spearhead initiatives for cloud migration (particularly to Snowflake) and ensure system uptime and performance for data warehouse products.Participate in and guide Agile work planning, testing, and quality assurance, ensuring alignment with strategic roadmaps.Evaluate internal and external customer needs and abilities to provide strategic and appropriate technical solutions, developing data solutions to a high standard of performance and accuracy.Identify and provide strategic input and leadership on new technology opportunities that could potentially have an impact on Data Engineering and Analytics systems.Advise and lead on how processes, practices and technologies can play a critical role in improving business management and optimization.Write, optimize, and review complex SQL queries to extract and manipulate data to be used by business units.Communicate data nuances, insights, and architectural decisions effectively to all levels of the company in a clear and concise manner.Provide expert-level technical expertise with all aspects of the solution design and implementation, including requirements definition, data acquisition processes, data modelling (dimensional and semantic), process automation, escalation procedures, construction and deployment.Identify and drive the implementation of innovative solutions to enhance the existing Data Engineering infrastructure processes and technology.Participate in and lead planning processes including inception, technical design, development, testing and delivery of Data solutions.Participate in and facilitate Agile work planning and estimation processes, including backlog grooming, sprint planning, and retrospectives.Act as a self-starter, proactively identifying areas for improvement and innovation within the data landscape.Foster a culture of technical excellence through team leadership and active mentoring.