Data Engineer (Databricks)

Reporting to the Platform Delivery Lead and working in a collaborative, exciting environment within the DataOps ecosystem , you will: Help design, build and deploy the next generation of our data lake.
Prove concept and value for pipeline patterns on data types and sources that are new to our Lakehouse ingestion.
Utilise the latest available technologies to flexibly manage and scale data.
Engineer systems to manage big data compute tasks.
Troubleshoot data pipeline operational failures.
Help design and implement platform monitoring, robustness and self-healing as an integral part of the platform design.
What you'll bring Experience with databases, including cloud databases, relational databases and no SQL databases (e.g.
Databricks, Redshift, Postgres, SQL Server, MongoDB) Experience building and creating data pipelines (preferably Databricks Delta Live Tables or similar) using both Python and SQL.
Experience of data streaming products such as Kafka, Kinesis etc… Experience with Git (or appropriate source control).
Experience with cloud platform deployment (AWS preferred) Please note that is role is Brisbane based only.
If you are interested in proceeding with an applicaiton, please apply using the button below or alternatively email your CV to ******