Staff Engineer – Data Platform and Lakehouse

We are seeking and experienced  Staff Engineer – Data Platform and Lakehouse  to lead the design and implementation of our cloud-native Data Platform  that support AI, advanced analytics, and machine learning applications in our ecosystem of B2B SaaS applications in the FinTech vertical You’ll work with a diverse team of talented engineers, AI and ML scientists, and product managers to build our next generation data and AI platforms, support migration of products from legacy infrastructure, and help product engineering teams leverage the Data platform and Lakehouse to launch new products and build new genAI applications. As a company that specializes in data-driven insights, the reliability, scalability, and effectiveness of our data & AI platforms are integral to our product offerings.  This role requires deep technical expertise, strategic thinking, and strong collaboration across engineering, data science, and product teams.Responsibilities:Design and implement scalable, secure, and maintainable data platforms on Databricks and AWS cloud infrastructure.Provide architectural leadership across engineering domains, ensuring consistency, scalability, and resilienceArchitect distributed data processing systems using Apache Spark and optimize for performance and scalability.Lead development of reusable data pipelines and workflows using Databricks Workflows.Translate business objectives into platform capabilities in collaboration with Product Managers and cross-functional teams.Support AI/ML initiatives through robust data engineering, including feature engineering, model deployment.Champion best practices in ETL/ELT, data quality, monitoring, observability, and Agile development.Drive adoption of data governance standards: access control, metadata management, lineage, and compliance.Establish and maintain CI/CD pipelines and DevOps automation for data infrastructure.Evaluate and integrate emerging technologies to enhance development, testing, deployment, and monitoring.Salary Range: $170,000 -$190,000 (plus bonus)