Data Engineer

Description We are offering a long-term contract opportunity for a Data Engineer. This role is crucial in the development and optimization of data systems through the design and construction of ETL pipelines, data models, queries, and scripts. The Data Engineer will work closely with business domain leads, data scientists, product owners, and architects to deliver enterprise data solutions. This role is within the tech industry and focuses heavily on cloud-based infrastructure and data management.Responsibilities: Develop and maintain ETL pipelines and data models to optimize system performance. Create and implement scripts and maintenance procedures for data management. Collaborate with business domain leads, data scientists, and product owners to deliver enterprise data solutions. Participate in the design and development of Cloud-based infrastructure batch ETL processes. Construct multi-dimensional databases and data marts in line with business requirements. Contribute to the development of data management policies, standards, and procedures. Identify opportunities for process improvements, including automating manual processes, optimizing data delivery, and redesigning infrastructure for greater scalability. Communicate complex technical information to project stakeholders, ensuring non-functional requirements are captured. Collaborate with foundational solution functional teams, vendors, and technology support teams to build and deliver solutions on business initiatives. Take part in the delivery of solutions through a minimum viable product (MVP) and subsequent iterative cycles of development.Requirements Must hold a minimum of 5 years of experience as a Data Engineer or in a similar role Proficiency in Apache Kafka, Apache Spark, and Cloud Technologies is necessary Experience with Database and EO/IR systems is required Proven skills in Algorithm Implementation and Analytics Knowledge of Apache Hadoop and API Development is a must Familiarity with AWS Technologies and Azure Databricks is essential Must have experience in ETL - Extract Transform Load and T-SQL - Transact-SQL Excellent problem-solving abilities and detail orientation Strong communication and team management skills Bachelor’s degree in Computer Science, Engineering, or related field is required Strong understanding of data structures, data modeling, and software architecture Ability to work in a fast-paced environment and manage multiple tasks simultaneously. Technology Doesn't Change the World, People Do.® Robert Half is the world’s first and largest specialized talent solutions firm that connects highly qualified job seekers to opportunities at great companies. We offer contract, temporary and permanent placement solutions for finance and accounting, technology, marketing and creative, legal, and administrative and customer support roles.Robert Half works to put you in the best position to succeed. We provide access to top jobs, competitive compensation and benefits, and free online training. Stay on top of every opportunity - whenever you choose - even on the go. Download the Robert Half app (https://www.roberthalf.com/us/en/mobile-app) and get 1-tap apply, notifications of AI-matched jobs, and much more.All applicants applying for U.S. job openings must be legally authorized to work in the United States. Benefits are available to contract/temporary professionals, including medical, vision, dental, and life and disability insurance. Hired contract/temporary professionals are also eligible to enroll in our company 401(k) plan. Visit roberthalf.gobenefits.net for more information.© 2024 Robert Half. An Equal Opportunity Employer. M/F/Disability/Veterans. By clicking “Apply Now,” you’re agreeing to Robert Half’s Terms of Use (https://www.roberthalf.com/us/en/terms) .