Description Position Overview:The Data Engineer role involves facilitating the implementation of projects centered on gathering, aggregating, storing, reconciling, and providing access to data from various sources to enable analysis and decision-making processes. This pivotal role ensures stakeholders can readily access and manipulate data for both routine and ad hoc analyses, thereby supporting the entire data lifecycle from sources to insights.Key Responsibilities:
Interpret business requirements and translate them into technical solutions, leveraging robust business acumen.
Analyze existing business practices, processes, and procedures, identifying opportunities for leveraging Microsoft Azure Data & Analytics PaaS Services.
Assist in planning and implementing data design services, offering sizing and configuration support, and conducting needs assessments.
Architect transformations and modernizations of enterprise data solutions utilizing Azure cloud data technologies.
Construct Azure Data Pipelines using Databricks for efficient data processing.
Develop and maintain data warehouse schematics, layouts, architectures, and both relational and non-relational databases for data access and Advanced Analytics.
Present data to end users through Power BI or other modern visualization platforms.
Implement effective metrics and monitoring processes to ensure data quality and reliability.
Requirements
Qualifications:
Bachelor’s degree in Computer Science or a related field, or equivalent work experience.
Minimum of 4 years of experience in data engineering.
Demonstrated ability to translate business use cases and requirements into technical solutions.
Experience in mapping business processes for data and analytics solutions.
Proficiency in conducting data profiling, cataloging, and mapping for technical design and construction of data flows.
Strong collaboration skills and experience working with remote teams.
Ability to apply Azure Data and Analytics services to solve business problems, including building data pipelines, data streams, and system integration.
Experience with ETL/ELT tools such as AWS Glue, Azure Data Factory, Talend, and EAI.
Familiarity with business intelligence tools like Power BI, Tableau, Qlik, and Cognos TM1.
Knowledge of Azure Data Factory, Azure Data Lake, Relational Databases SQL DW, SQL, and Azure App Service; familiarity with Azure IoT, Azure HDInsight + Spark, Azure Cosmos DB, Azure Databricks, and Azure Stream Analytics is advantageous.
Proficiency in Cloud Data-related tools such as Microsoft Azure and Amazon S3.
Ability to utilize various programming languages and data management/processing tools to ensure data reliability, quality, and efficiency.
Knowledge of Python is a plus.
Experience in designing and building Data Pipelines using streams of IoT data.
Understanding of DevOps processes, including CI/CD, and Infrastructure as Code fundamentals.
Technology Doesn't Change the World, People Do.®
Robert Half is the world’s first and largest specialized talent solutions firm that connects highly qualified job seekers to opportunities at great companies. We offer contract, temporary and permanent placement solutions for finance and accounting, technology, marketing and creative, legal, and administrative and customer support roles.Robert Half works to put you in the best position to succeed. We provide access to top jobs, competitive compensation and benefits, and free online training. Stay on top of every opportunity - whenever you choose - even on the go. Download the Robert Half app (https://www.roberthalf.com/us/en/mobile-app) and get 1-tap apply, notifications of AI-matched jobs, and much more.All applicants applying for U.S. job openings must be legally authorized to work in the United States. Benefits are available to contract/temporary professionals, including medical, vision, dental, and life and disability insurance. Hired contract/temporary professionals are also eligible to enroll in our company 401(k) plan. Visit roberthalf.gobenefits.net for more information.© 2024 Robert Half. An Equal Opportunity Employer. M/F/Disability/Veterans. By clicking “Apply Now,” you’re agreeing to Robert Half’s Terms of Use (https:///www.roberthalf.com/us/en/terms) .