OverviewCome join the Data Engineering Team as a Software Engineer II.We are leveraging big data technologies to gain new insights into our customer experiences, building data frameworks, ingestion pipelines and tools. The technologies we are leveraging include Amazon Web Services & Google Cloud Platform big data services. Participate in the entire product lifecycle for software products and services that are broad in scope and complexity, applying a full understanding of software engineering methodologies and industry best practices. Work with Industry Experts; Senior, Staff andPrinciple Engineers, utilize specialized knowledge to develop, and maintain Intuit’s software. Primary job responsibilities are to develop and support batch and streaming data pipelines using Python, Scala, Java, Spark and SQL to enable AI, machine learning and analytics in a cloud-hosted environment.What you'll bring
BS or MS in Computer Science or related field; equivalent experience will be considered
3+ years of core development experience
Skilled in developing Software for Java (Spring & Springboot), Scala for spark streaming & spark applications, or other JVM based languages.
Working Knowledge of XML, JSON, YML, SQL, very strong Python and Linux
Knowledgeable with tools and frameworks Docker, Spark, Scala, Jupiter Notebook, Kubernetes, Feature Management Platforms, SageMaker
Advanced experience with scripting language – Python or Shell is a must have . Strong knowledge of software development methodologies and practices.
Experience working in Agile development teams; working knowledge of Agile (Scrum) development methodologies
Experience with Amazon web services: EC2, S3, and EMR (Elastic Map Reduce) or equivalent cloud computing approaches
Strong expertise in Data Warehousing and analytic architecture
Experience working with large data volumes
Experience with building stream-processing applications using Flink, Spark Streaming, Kinesis, etc. is a plus
Additional exposure to unit testing frameworks
Ability to research and integrate 3rd party solutions
Evolving a mature code base into new technologies
Experience creating and consuming SOAP based or JSON/REST web services and communicating with systems.
How you will lead
70-85% hands-on development in all phases of the software life cycle.
Rapidly fix bugs and solve problems
Conduct design and code reviews
Defect remediation
Technical design specification
Automated unit tests
Estimates and sequence of individual activities as inputs to project plans
Analyzes and synthesizes a variety of inputs to create software and services.
Identify dependencies as inputs to project plans
Collaborates effectively with peer engineers and architects to solve complex problems spanning their respective areas to deliver end-to-end quality in our technology and customer experience.
Influences and communicates effectively with non-technical audiences including senior product and business management.
Designing/developing ETL jobs across multiple big data platforms and tools including S3, EMR, Scala, Python and SQL
EOE AA M/F/Vet/Disability. Intuit will consider for employment qualified applicants with criminal histories in a manner consistent with requirements of local law.