Big Data Engineer puesto de trabajo vacante en la Bloomfield, Connecticut VLink Inc

Vacancy caducado!

Job Title: Big Data Engineer

Location: Bloomfield, Connecticut

Job Description:

Responsibilities: • Data Ingestion using Kafka, CDC or similar technologies.• Implement and support streaming technologies such as Kafka, K-SQL and Spark.• Implement and support big data tools and frameworks such as HDFS, Hive, and Hbase or Cassandra.• ETL Design and Development in the big data platform in Hadoop using technologies such as Scala, Spark, Python, Oozie, and more to support a variety of requirements and applications.• Warehouse Design and Development – Set the standards for warehouse and schema design in massively parallel processing engines such as Hadoop and Columnar Databases while collaborating with analysts and data scientist in the creation of efficient data models.• Implement a CICD DevOps strategy• Implement end to end Data Lake solution in on premise as well as on a cloud environment preferably Azure and AWS.• Deliver a Client/AI framework to support user Analysts and data scientists to support advance analytics.

Requirements / Qualifications: • 7+ years of work experience with ETL, and business intelligence big data architectures.• 5+ years of experience with the Hadoop ecosystem (Map Reduce, Hive, Oozie, Yarn, HBase, etc.) and big data ecosystems (Kafka, Cassandra, etc.).• 3+ years of hands-on Spark/Scala/Python development experience.• Experience developing and managing data warehouses on a terabyte or petabyte scale.• Experience with core competencies in Data Structures, Rest/SOAP APIs, JSON, etc.• Strong experience in massively parallel processing & columnar databases.• Expert in writing SQL – PLSQL or NoSQL• Deep understanding of advanced data warehousing concepts and track record of applying these concepts on the job.• Experience with common software engineering tools (e.g., Git, JIRA, Confluence, or similar)• Ability to manage numerous requests concurrently and strategically, prioritizing when necessary.• Good communication and presentation skills.• Dynamic team player.

Skill Set/Years of Experience/Proficiency Level Data Engineering

TableauBig DataSQL

Vacancy caducado!

ID	#20974378
Estado	Connecticut
Ciudad	Bloomfield
Tipo de trabajo	Contract
Salario	USD $70 - $80 70 - 80
Fuente	VLink Inc
Showed	2021-10-11
Fecha	2021-10-04
Fecha tope	2021-12-02
Categoría	Etcétera
Crear un currículum vítae

Job Details

Big Data Engineer

Puestos de trabajo relacionados

»Senior AWS DevOps Engineer

»Data Entry Clerk

»data management strat and gov advisor