Vacancy caducado!
Role : Lead - Data Platform EngineerLocation : Philadelphia, PA, USA (Remote as of now)JD is as follows
Job Summary:Responsible for designing and implementing new data platform features defined by business stakeholders and technical development teams. Analyzes, tests and assists with the integration of new platform features. Acts as a key contributor in a complex and crucial environment. Has in-depth experience, knowledge and skills in a broad range of AWS services. Acts as a resource for colleagues with less experience. This position will have the opportunity to work cross-functionally and help shape and influence a more scalable and sustainable syndicated data lake environment spanning US and European AWS regions with 24x7 operational support.Job Description:- Provide insights into developing data platform strategy and business requirements to ensure alignment between the data lake platform strategy and business strategy
- Produce data and platform architecture design artifacts
- Develop and design architecture documentation for technical and business leadership
- Help maintain the integrity and security of the data lake
- Facilitate the end-to-end platform activities (architecture, integration, engineering, DevOps) and contingencies
- Define user stories that distill complex business problems into simple and clear terms, which technical teams can both understand and act on, enabling efficient hand-offs and hedging bottlenecks or development risks
- Collaborate with internal and external partners across Comcast to understand how associated data projects adhere to the broader customer & employee journey roadmap
- Act as an AWS subject matter expert and help foster knowledge transfers and system/platform requirements
- Consistent exercise of independent judgment and discretion in matters of significance.
- Regular, consistent and punctual attendance. Must be able to work nights and weekends, variable schedule(s) and overtime as necessary.
- Other duties and responsibilities as assigned.
- Self-starter
- 5+ years industry experience
- Demonstratable experience building and operating platforms at significant scale
- Expert in Python, proficient Scala
- Hands-on development with AWS services: Glue, Lake Formation, S3, DynamoDB, SQS, SNS, Aurora, Lambda, Step Functions, API Gateway, IAM, CloudWatch, Kinesis, ElasticSearch, Airflow, EventBridge, Grafana
- Working knowledge of Spark
- Databricks experience is a plus
- AWS certifications are a plus
- Skilled using git
- Comfortable working in a distributed team that operates in highly dynamic environment utilizing Agile, Scrum, SAFE methodologies
- Perform code reviews
- Participate in making major technical and architectural decisions
- Establish and document development and testing best practices
- Assist with cloud-based infrastructure planning and implementation
- Versed in AWS cost management
- Work with partners and technical architects on requirements definition
- Maintain technical documentation
- Assist in the ongoing system support and maintenance
- Have a track record of solving technical challenges and owning critical systems
- Recognize weaknesses in our technology and organization, and provide constructive feedback
- Be knowledgeable of fundamental computer science concepts