Job Details

ID #21754284
Estado New Jersey
Ciudad Clinton
Tipo de trabajo Contract
Salario USD Depends on Experience Depends on Experience
Fuente Virtusa Corporation
Showed 2021-10-27
Fecha 2021-10-22
Fecha tope 2021-12-20
Categoría Etcétera
Crear un currículum vítae

AWS PySpark Developer

New Jersey, Clinton, 08809 Clinton USA

Vacancy caducado!

We are looking for AWS PySpark Developer – Clinton, NJ. This is a contract position.

Required Skills 4 to 6 years of Hands on experience in Development2 to 4 years of Hands on experience with Python scripts2 to 3 years of Hands on experience in PySpark coding. Worked in spark cluster computing technology.Min 2 years hands of experience on AWS DMS service to setup DMS, handling data format issues & monitoring DMS logs.Should have working experience on importing multiple RDMS data, Creating Replication tasks & applying filtering conditions on source endpoints using AWS DMS2 to 3 years of Hadoop ecosystem Hortonworks or Cloudera experience which include Hive Beeline Hive2 Oozie HDFS etc.2 to 3 years of Hands on end to end data pipeline experience working on AWS environments3 to 4 years of Hands on experience working on AWS services Glue Lambda Step Functions EC2 RDS SES SNS DMS CloudWatch etc. 2 to 3 years of Hands on experience working on AWS redshift3 plus years of Hands on experience with writing Unix Shell scriptsExperience in coming up with creative solutions to optimize the code to solve the performance issues and create frameworksGood communication skillsExcellent debugging and Performance tuning skills on AWS environment3 plus years of working experience in Data warehousing projects Staging Dimensions Facts SCD Type 1 SCD Type 2. Familiarity with Data lake Data migration and Data integration concepts. Having knowledge in OLAP OLTP systems.Experience in Agile Waterfall methodologies. Familiar with SDLC phases such as design development Testing UAT etc. Experience working on SQL skillsExperience working in an Onsite Offsite Development Model

Vacancy caducado!

Suscribir Reportar trabajo