Big Data Developer Engineer : 2022-10-07

Vacancy caducado!

Job#: 1295717

Job Description: The primary focus of this Big Data Developer Engineer will be on the new mission Data Forge in the Cloud platform (Azure, Google) involving data mesh architecture. This role ensure that Data Forge (DF) operates with high reliability, availability, and performance at scale for our customers. The Data Forge team is looking for a Big Data Developer Engineer with Cloud experience and a diverse set of experiences and skillsets to help maintain exciting new initiative running on Google Cloud infrastructure. As Cloud SRE/Cloud engineer you will provide service reliability and availability via following SRE practices.Your job function comes with SRE mindset and a set of engineering practices to run reliable production systems. You will help to implement SRE principles through opensource tooling, and automation and prevent toil. Automate end to end, from writing code to running services in production. Leverage SRE principles developed and proven to work at scale.You will partner with Engineering teams to understand their challenges, work through their issues, and provide solutions that can be adopted widely. The ideal candidate is someone with a proven track record, sound technical knowledge and skills in delivering large scale complex software solutions deployed. This role will be responsible for designing, building, running, and monitoring public cloud infrastructure to support a variety of mission critical services. This is a highly technical, hands-on role that requires expertise supporting systems at enterprise level.Can you please provide a summary of the project/initiative which describes whats being done?Data Lake connects data to people and technologies and unearths valuable insights. By investing in these resources during a time of rapid change in the global marketplace, Client is poised to continue achieving its mission of helping people live healthier lives and making the health system work better for everyone.Some of the features of Client Data Lake• Serves as Client's repository of strategic and widely-used data sources from each major segment of the enterprise• Adapts to evolving business requirements for volume, variety, velocity and veracity• Provides an exact replication of source data along with metadata about the source system• Secures data access at the source level in line with an established platform governance frameworkWhat does the ideal candidate background look like (ex: healthcare specific background, etc.)? We want to be as specific as possible with our firms so they can find the type of candidate youre looking for.The candidate should be well experienced in all Big Data Technologies, like Java, MapReduce, Hive, HBase, Kafka, Spark/Scala, Kubernetes, Azure/Google Cloud, Jenkin Pipeline, GitHub, Grafana Dashboard etc.Of the required skills listed, which would you consider the top 3? Please list your expectations regarding years of experience for each requirement.Java 5+ yearsMapReduce 3+ yearsHive, HBase, Kafka, Spark/Scala, Kubernetes 3+ yearsWhat experience will set candidates apart from one another? Working in HealthCare environment in Big Data spaceAre you open to candidates that would need to be 100% remote for the duration of the engagement? YesAre you open to candidates that cannot convert to FTE without sponsorship? YesWhat does the team structure look like - how many members and what is the break-down of the teams skill sets (ex: 1 PM, 4 Developers, etc.)? 1 Delivery Lead, 8 Developers US and 20+ Developers IndiaWhat does the interview process look like?a. How many rounds? Minimum there will be 2 rounds of interview; live coding is a mandatory oneb. Video vs. phone? Videoc. How technical will the interviews be? Fully focused on the Technical questions with Live Coding skillsd. When do you anticipate starting the interview process? ASAPPrimary Responsibilities:• 50% Software Engineering and 50% Systems Engineering• Improve availability and reliability of services• Ensure compliance with appropriate security standards• Identifying the Service Level Objects (SLOs) and Service Level Indicators and maintaining those metrics in a good standard for smooth operations• Engineering - Continuously optimize secure, scalable and performant security tools and service.• Reliability - Drive fault detection and correction, performance, and uptime at scale• Monitoring - Instrument systems to gain visibility and understanding of how they are performing at any time• Accelerated infrastructure, application, and software configuration deployment• Automated response to alerts or indicators of performance issues• Infrastructure as code• Programming in one or more of these languages - Java spring boot, GO, Python for building automation• Experience with common formats such as JSON, YAML• Expertise with monitoring or log aggregation tools (Prometheus, Grafana)• Expertise in key SRE Skills (Scalability, Reliability and Observability)• Familiarity with CI/CD tools and deployment processes• Solid understanding and experience with Incident / Change management tool like ServiceNow• Conduct blameless post-mortems to analyze failures and prevent recurrence• Provide service support by participating in regular on-call shifts responding to service issues• Systematic problem-solving approach coupled with a strong sense of ownership and independence• Experience operating, troubleshooting, and scaling online services in cloud-based environment• Operational experience with networking and an understanding of networking principles• Experience reviewing security scans and remediating vulnerabilities• Experience with modern container orchestration systems like Kubernetes• Familiarity with security issues in the cloud such as intrusion, penetration, and vulnerability scanning• Experience with various data management technologies including relational and non-relational databases and message queues• Stay up to date on relevant technologies, plug into user groups, understand trends and opportunities to ensure we are using the best possible techniques and tools• Facilitation/presentation experience and ability to properly communicate with Business and Technical audience• Define and document standards and guidelines• Develop and automate repeatable tasks• Consult with development users; determine requirements and recommend solutions• Participate in product evaluations, design review session, data requirement meetings and consulting with application development productsRequired Qualifications:• 5+ years software engineering background covering the entire software lifecycle in a team-oriented environment.• 2+ years Azure, or Google Cloud Platform. Experience supporting infrastructure and services in public and private cloud environments• 3+ years of software development experience such as Java Spring boot, Python or Golang• The candidate must have working knowledge Terraform, Ansible, Helm.• The candidate must have working knowledge in container and container management technologies (Docker, Kubernetes).• Willingness to participate in on-call support rotationPreferred Qualifications:• Experience in analysis of healthcare data and management of healthcare information systems• Passion for automated CI and CD; record of doing considerable work in this area• Ability to use a wide variety of open-source technologies and cloud services• Experience with Infrastructure as Code (Terraform)• Hand on experience with Open Shift and Google Cloud and Azure cloud platforms• Understanding of Hadoop Distribution technologies and any Cloud ExperiencesEEO EmployerApex Systems is an equal opportunity employer. We do not discriminate or allow discrimination on the basis of race, color, religion, creed, sex (including pregnancy, childbirth, breastfeeding, or related medical conditions), age, sexual orientation, gender identity, national origin, ancestry, citizenship, genetic information, registered domestic partner status, marital status, disability, status as a crime victim, protected veteran status, political affiliation, union membership, or any other characteristic protected by law. Apex will consider qualified applicants with criminal histories in a manner consistent with the requirements of applicable law. If you have visited our website in search of information on employment opportunities or to apply for a position, and you require an accommodation in using our website for a search or application, please contact our Employee Services Department at or

ID	#46265987
Estado	Minnesota
Ciudad	Edenprairie
Tipo de trabajo	Permanent
Fuente	Apex Systems
Showed	2022-10-07
Fecha	2022-10-06
Fecha tope	2022-12-04
Categoría	Etcétera
	Crear un currículum vítae

Job Details

Big Data Developer Engineer