Data Engineer - Data Bricks

Data Engineer - Data Bricks
Company:

Indigeco Pty


Details of the offer

This is a fantastic opportunity for professional growth, working alongside talented individuals in a collaborative environment.
Job Title: Data Engineer - Data Bricks Location: Brisbane
We are seeking a Data Engineer to join a dynamic team focused on the development and delivery of a cutting-edge Lakehouse platform. This role offers the opportunity to implement high-performance, end-to-end data solutions while optimizing processes for data integration, manipulation, and presentation.
Key Responsibilities: Design, build, and deploy the next generation of a data lake. Utilize modern technologies to manage and scale data pipelines and analytics models. Engineer systems for managing big data compute tasks. Troubleshoot data pipeline operational failures. Provide best practice advice and solution configuration to internal customers. Implement platform monitoring, robustness, and self-healing features. What You'll Bring: Extensive experience with cloud databases, relational databases, and NoSQL databases (e.g., Databricks, Synapse, SQL Server, MongoDB, CosmosDB, Redshift). Strong experience with Qlik Replicate (Attunity) and deploying complex CDC ETL solutions. Proficiency in building data pipelines using Python and SQL, preferably with Databricks Delta Live Tables. Experience with source control systems like Git. Familiarity with cloud platforms (Azure/AWS). Ability to perform root cause analysis on data and processes, providing insights and identifying improvement opportunities. Strong communication skills to collaborate with Product, Data, and Design teams. Expertise in Data DevOps and data-as-code design. Desirable Skills: Experience working with cross-functional teams in a dynamic environment. Basic understanding of data modeling concepts. Knowledge of streaming data and data mesh concepts. How to Apply: If you are ready to take on this exciting opportunity and become a valuable member of our team, please APPLY NOW. We will review applications on a rolling basis and contact qualified candidates for interviews.
Aboriginal and Torres Strait Islander candidates strongly encouraged to apply.
If this sounds like you, APPLY NOW!
Only shortlisted candidates will be contacted.
Applications received after the due date may be considered for similar roles.
Indigeco acknowledges the Traditional Custodians of country throughout Australia and recognizes our Brothers & Sisters' connection to Land, Waters, and Community. We pay our respects to our Brothers & Sisters, our Culture & to our Elders past, present & future. #J-18808-Ljbffr


Source: Jobrapido_Ppc

Requirements

Data Engineer - Data Bricks
Company:

Indigeco Pty


Advisor (Real-Time Network Management)

We are recruiting for two (2) Advisor (Real-time Network Management) roles in our regional Queensland Traffic Management Centres. One role is based in Cairns...


From Department Of Transport And Main Roads - Queensland

Published 9 days ago

Technical Services Deployment Technician - Desktop Support

Location: ToowoombaJob Type: TemporaryPosted: 8 days agoContact: Chantelle LeeDisciplineGeneral ITReference: 263561About The CompanyOur client is a world-cla...


From Peoplebank - Queensland

Published 9 days ago

Ongoing Support Consultant

Why join APM?APM is a global health and human services organisation transforming lives since 1994. Be part of a 15,000-strong team across 11 countries, empow...


From Apm - Queensland

Published 9 days ago

Cloud Services Manager

Management (Information & Communication Technology)At WorkCover Queensland our vision is to be the best worker's compensation insurer, to make a positive dif...


From Workcover Queensland - Queensland

Published 9 days ago

Built at: 2024-09-30T15:37:52.308Z