Engineering - Software (Information & Communication Technology)Full timeCompare the Market – yes, the one with the meerkats – is a high-growth FinTech company on a transformational journey. We are focused on designing, building, and delivering the very best home loan, energy, insurance, and health comparison experience in Australia.We are all about Customer first, teamwork, making a difference, and treating the business as our own – without compromise. These values are critical to delivering on our purpose: "to make a difference in the lives of Australians by simplifying the process of making sound financial decisions."About The Role:Are you ready to elevate your career? Compare the Market is looking for a Senior Data Engineer to join our innovative team. As we continue to advance our modern data platform on AWS and Databricks, this role offers the opportunity to shape the data foundations and provide technical leadership within the engineering team and across broader business stakeholders.What You'll Do:Collaborate with business and IT teams to define business problems, refine requirements, and design and develop data solutions.Ensure data engineering solutions align with data architecture and component designs.Lead the development and implementation of the data engineering roadmap.Manage data pipelines from acquisition to integration and consumption, architecting, building, and maintaining them for specific use cases.Promote best practices in data management, including Data Lakes, Data Warehouses, Data Quality, Lineage, and DataOps.Work closely with Data Architects, DevOps, and Data Engineers to design integrated data applications.Drive automation by using innovative tools and techniques to streamline data preparation and integration tasks.Identify, design, and implement scalable solutions that allow for future reuse.Develop production-ready data applications and pipelines within a cloud environment.Conduct root cause analysis on internal and external data and processes to address business questions and identify opportunities for improvement.What You'll Bring:Tertiary Qualifications in Computer Science, IT, or a relevant discipline.Demonstrated extensive experience in a similar role.Strong experience with cloud EDWs (AWS/GCP), Data Lakes, and Information Governance Suites.Skilled in data models (e.g., Star Schema, Data Vault) and developing unified data layers or presentation layers.Proven experience with modern platforms like Databricks or Snowflake, and expertise in Python/PySpark.Proficient in SQL.Experience with traditional on-premise EDW/ETL environments is a plus.Highly regarded experience in building metadata-driven, automated solutions.Skilled in optimising processes on both legacy systems and cloud platforms.Git experience for source code management is desirable.Familiar with DevOps practices and CI/CD tools.Strong understanding of the Data & Insights lifecycle.Agile experience using tools like Jira and Confluence.At Compare the Market, we offer a dynamic and collaborative work environment where your talents will be recognised and rewarded. You'll have the opportunity to make a meaningful impact and contribute to our continued success.Please note that this role is only available to candidates with unlimited Australian working rights, as sponsorship is not available.Compare the Market is an Equal Opportunity Employer, and we encourage all applicants to apply. We acknowledge that we are strengthened by diversity.Want to know more? Then apply now! It's Simples!
#J-18808-Ljbffr