Sr Data Engineer

The Senior Data Engineer will serve as a subject matter expert in end-to-end data engineering, focusing on large-scale data solutions. This role involves implementing and optimizing data architectures, designing and managing data pipelines, and leading the development of advanced data solutions, including real-time analytics and machine learning models. The Senior Data Engineer will also mentor junior data engineers and provide technical leadership. The role will collaborate with IT & Business workstreams to develop analytic tools to improve decision making leveraging data.The duties and responsibilities of this position shall consist of, but not be limited to, the followingData Engineering and ArchitectureServe as a subject matter expert in end-to-end data engineering, focusing on large-scale data solutions.Implement and optimize data architectures, including data lakes, warehouses, and pipelines, ensuring high performance, scalability, and security.Lead the design and implementation of advanced data solutions, including real-time analytics and machine learning models.Design, develop, and manage data pipelines and ETL processes to facilitate data flow from multiple sources, ensuring transformation and enrichment for analytics and reporting.Write clean, efficient, and optimized code using programming languages such as Python within Microsoft Fabric notebooks for data processing, automation, and custom ETL workflows.Use SQL for complex data querying, data manipulation, performance optimization, and database schema management within Microsoft Fabric and Azure environments.Develop, deploy, and maintain APIs for data access and integration across platforms, including Microsoft Fabric, SAP Datasphere, and Azure.Develop and maintain a metadata-driven data architecture to improve data governance, lineage, and qualityMentor and guide junior data engineers, providing technical leadership and fostering a collaborative team environment.Microsoft Fabric and SAP Datasphere IntegrationLead the implementation of Microsoft Fabric, ensuring seamless integration with SAP Datasphere and S/4 HANA as part of Jack Links' data strategy.Configure and manage Microsoft Fabric components, such as Lakehouse, Data Warehouse, Data Engineering, and Notebooks, to meet complex data processing, storage, and analytical requirements.Develop and implement data workflows within Microsoft Fabric, using notebooks for advanced data transformations, optimizing workflows for performance and data quality.Utilize Microsoft Fabric’s data connectors to ensure smooth data integration from diverse sources, including SAP Datasphere, S/4 HANA, and Azure.Collaborate with Azure administrators and stakeholders to optimize Fabric’s resource usage and performance, aligning with data processing needs.Stay updated with new features and best practices in Microsoft Fabric and SAP Datasphere to ensure that Jack Links leverages both platforms effectively.SAP Technologies and Embedded AnalyticsIntegrate SAP Datasphere and S/4 HANA embedded analytics within Microsoft Fabric to enhance enterprise-wide reporting and data insights.Manage SAP Datasphere data flows, connecting and orchestrating data from various SAP systems and non-SAP sources for comprehensive analytics.Configure and manage SAP Datasphere, ensuring high data quality and consistency across applications, and implement solutions for robust data governance and integration.Collaborate with business teams and SAP stakeholders to ensure SAP Datasphere and S/4 HANA data aligns with organizational goals for analytics, insights, and reporting.Lead initiatives to enhance data quality, governance, and integration across SAP systems.Power Platform and Power BIDevelop and deploy Power Platform solutions (e.g., Power Automate, Power Apps) to streamline data workflows, support automation, and enhance operational efficiency.Implement reporting solutions using Power BI, utilizing DAX functions for complex data transformations and Power BI dashboards to provide insights across the organization.Lead the development of advanced analytics and reporting solutions using Power BI and other visualization tools.