Senior Data Engineer - Databricks

Data Engineering:Data pipeline development, maintenance and engineering support with modern data stack in a rapid, agile development practices Have Data Analysis, Data Modelling, Solution Design experience to design solutions to address new requirements or enhancements to existing pipelines and models.Have a clear understanding and can demonstrate experience on data modelling techniques, data integration patterns and data architectures. Tools/Tech Stack:Data pipeline and ETL tools (DBT, Airflow, Python). Cloud data warehouse – development, testing and production deployments.Experience in DataBricks, specifically using unity catalogue , delta live tables & spark.Nice to have:BI Tools (MS Fabric, Power BI) Cloud services & CI/CD tool chains (e.g. Terraform, Docker, AWS services, S3) AI / ML tools – AWS Sagemaker, AWS Bedrock SnowflakePerformance Optimization: Cloud data warehouse – development, testing and production deployments.Optimize data pipelines, build pipelines & BI solutions for performance and scalability. Implement data engineering best practices, design, testing, documentation and maintenance Data Governance: Ensure compliance with data governance policies and procedures. Monitor data quality and address any issues related to data completeness and accuracy. Collaboration: Provide input to solution design & technical support of pipelines. Documentation: Maintain comprehensive documentation of data engineering solutions, data models, and processes. Contribute to design guides and training materials as needed. Issue and Incident Resolution:Provide support for issue and incident resolution.