Vacancy caducado!
Hi We have a direct client reuirement for Lead Data Engineer (Chapter Lead) position @ Miami FL.
Role:Lead Data EngineerLocation:Miami, FLDuration: Long Term Job Responsibilities- Lead with hands-on experience in developing big data/data lake/data analytics pipeline (ingesting, standardizing and transforming)
- Develop large scale data structures and pipelines to collect, organize, and standardize data that helps generate insights and addresses analytics and reporting needs with AWS Big Data Services (EMR, Glue, Kinesis, Lambda, KMS, S3) along with strong Pyspark experience
- Lead/Mentor a team of Data Engineers in design, development in the Data Lake pipeline stories in an Agile team. Ability to coach in development and analysis of complex data pipeline scenarios
- Collaborate with data science/business intelligence/supply chain management/other business units to transform data and integrate algorithms and models into automated processes.
- Experiment/Run Proof of Concepts with available tools and advise on new tools in order to determine optimal solution given the requirements dictated by the model/use case
- Apply principles of SDLC and methodologies like Scrum, CI/CD, Software and Product Security, Scalability, Testing, Documentation Practices, Refactoring and Testing Techniques
- AWS Certified Big Data Specialty - preferred
Vacancy caducado!