Vacancy caducado!
- Design, develop, and test enhancements to Data Lake technology management using the Zaloni Data Platform – Arena.
- Experience using Lake Formation or other third party tools for expediting creations of data pipelines
- Significant experience in Hue/Hive SQL
- Work with complex Data modeling and design patterns for BI/Analytics reporting requirements.
- Serve as senior technical person for data solutions and architectures in relation to storage, governance, quality, cleansing and distribution.
- Design the infrastructure and reusable processes for optimal execution of data transformation.
- Facilitate the evaluation and selection of data toolsets required to achieve business objectives.
- Provide design decisions around data warehouse solutions that involve multiple disparate business systems.
- Ensure quality level of documentation is produced and maintained in regards to data solution architecture.
- Bachelor’s Degree in Computer Science or related field.
- 7 to 10 years’ experience in a data engineering environment, report automation, batch and real time processing
- Experience working in an Agile/Scrum environment
- Background in banking and financial services industry
- SQL, ETL/ELT and MDM
- Python, Spark, PySpark, Jupyter/Zepplin
- Strong hands on experience in Hive and HiveQL, SQL server
- AWS Data Lakes related skills Hadoop, HDFS, S3, EMR, Hive, Athena, Redshift, Glue, QuickSight, Apache Ranger
- Familiarity with Linux Shell Scripting
- C# is a plus
- Kafka streaming a big plus
- AWS Certified is a plus
Vacancy caducado!