Vacancy caducado!
We are currently seeking an experienced Data Engineer to join the Big Data and Advanced Analytics department. As part of the Data Engineering team, the Lead Data Engineer will work closely with Data Scientists and Business domain experts to solve real-world oil and gas midstream problems using advanced analytics, machine learning, and artificial intelligence. This individual will provide analytical and technical leadership to the team to advance the data engineering practice within the organization.
Responsibilities include:- Work directly with Business domain experts and Data Scientists to understand the business objective and develop high quality, scalable analytical applications and data products
- Architect and implement frameworks and tools to streamline the machine learning process
- Perform exploratory data analysis and present findings and recommendations
- Automate manual data flows for repeated use and scalability
- Develop data-intensive applications with API's and streaming data pipelines
- Convert research-based machine learning models into production-ready software
- Implement data quality checks to ensure data accuracy, consistency, and reliability
- 7+ years of programming experience in Python and SQL
- Experience performing exploratory data analysis using common statistical methods
- Experience working with industrial IOT data and performing time series analysis
- Experience in testing, packaging, and deploying machine learning models
- Strong understanding of data structures and algorithms
- Expertise in software engineering practices such as Design Principles and Patterns, Unit Testing, Refactoring, CI/CD, and version control
- Knowledgeable of modern data platform technologies including Apache Airflow, Kubernetes, Distributed File Systems, and object storage