Job Details

ID #19719178
Estado New York
Ciudad Nyc
Tipo de trabajo Permanent
Salario USD $60 - $70 60 - 70
Fuente Advent Global Solutions, Inc.
Showed 2021-09-16
Fecha 2021-09-15
Fecha tope 2021-11-13
Categoría Etcétera
Crear un currículum vítae

Data Engineer

New York, Nyc, 10001 Nyc USA

Vacancy caducado!

Job Title: Data Engineer with Pyspark and AWS

Location: NYC, NY

Duration: 12 months extendable

Responsibilities: Assist in migration of our feature pipelines from Teradata to pyspark /Sagemaker feature storeOne skill that is an absolute must is pyspark and ability to troubleshoot scaling issues.Duties and Responsibilities:• Architectural planning/ Development for Features as a Service (FaaS) that migrates the Legacy Dynamic SQL to an API Based Service that can be leveraged to create data feeds for Model training.• Creation of data /ML pipelines that use the services above foro Model Inferenceo Reinforcement Learning• Support for existing code base while it is being migrated from SQL to cloud based services• Documentation of all work on confluence pages in a business-friendly language along with technical design where needed.Technical Skills:10+ years of experience with data warehouse technical architectures, ETL/ ELT, reporting/analytic tools and, scripting.Expert knowledge on various Data modeling techniques: OLTP (normalized), ODS, EDW (dimensional).SQL-based and NoSQL-based technologies.Python/PySpark - Expert userAWS Certification – Associate or Professional (Preferred) level

Vacancy caducado!

Suscribir Reportar trabajo