Senior Data and ML Platform Engineer

As a Senior Data and ML Platform Engineer in Sydney (hybrid), you will have the opportunity to scale rapidly within the company, potentially moving into far senior positions as an initial hire. Salary rises are expected with company growth, making this an opportunity you do not want to miss out on. Role Overview: You will be responsible for architecting and building the entire data platform, starting from Databricks lakehouse to customer-facing integrations. This involves modernising Unity Catalog governance, enhancing reliability patterns, and establishing the foundation that enables ML teams to deliver AI products more efficiently. This role is one of the initial senior positions with significant growth potential expected in the next year. Key Responsibilities: - Modernise Databricks lakehouse foundation with Unity Catalog governance and Delta Lake performance tuning - Develop reliable data integration patterns for high-volume SaaS ingestion with proper retry logic and freshness SLAs - Design data products and contracts that support forecasting, optimisation, and automation modules downstream - Implement AI-powered DataOps capabilities such as auto-triage, anomaly detection, and self-healing workflows Qualifications Required: - Production Databricks experience with Spark, Delta Lake, and Unity Catalog implementation - Strong Python/PySpark and SQL skills with expertise in data modelling in medallion architecture - Experience with modern ELT tools like dbt and AWS data platform fundamentals - Proven track record of using AI tools to enhance engineering output and quality About the Company: The company is an AI decision platform that processes over 2.2 billion records to optimize workforce management for major franchises and enterprises. Their clientele includes publicly-traded companies with numerous locations that require AI-scale decision-making beyond traditional spreadsheets or legacy vendors' capabilities. Please click the 'Apply' button to submit your application. If your CV is not up to date, feel free to send what you currently have. As a Senior Data and ML Platform Engineer in Sydney (hybrid), you will have the opportunity to scale rapidly within the company, potentially moving into far senior positions as an initial hire. Salary rises are expected with company growth, making this an opportunity you do not want to miss out on. Role Overview: You will be responsible for architecting and building the entire data platform, starting from Databricks lakehouse to customer-facing integrations. This involves modernising Unity Catalog governance, enhancing reliability patterns, and establishing the foundation that enables ML teams to deliver AI products more efficiently. This role is one of the initial senior positions with significant growth potential expected in the next year. Key Responsibilities: - Modernise Databricks lakehouse foundation with Unity Catalog governance and Delta Lake performance tuning - Develop reliable data integration patterns for high-volume SaaS ingestion with proper retry logic and freshness SLAs - Design data products and contracts that support forecasting, optimisation, and automation modules downstream - Implement AI-powered DataOps capabilities such as auto-triage, anomaly detection, and self-healing workflows Qualifications Required: - Production Databricks experience with Spark, Delta Lake, and Unity Catalog implementation - Strong Python/PySpark and SQL skills with expertise in data modelling in medallion architecture - Experience with modern ELT tools like dbt and AWS data platform fundamentals - Proven track record of using AI tools to enhance engineering output and quality About the Company: The company is an AI decision platform that processes over 2.2 billion records to optimize workforce management for major franchises and enterprises. Their clientele includes publicly-traded companies with numerous locations that require AI-scale decision-making beyond traditional spreadsheets or legacy vendors' capabilities. Please click the 'Apply' button to submit your application. If your CV is not up to date, feel free to send what you currently have.