Job Requisition ID: 35889 Data Analyst/Engineer (Consultant) Global opportunities – for the travel bugs out there!
18 weeks paid parental leave + 12 months return to work support (work 4 days and get paid 5) CulturalFlex to observe your cultural and religious days of significance.
Do you want to add value and assist our clients navigate the future with confidence?
Provide world-class solutions that reimagine our clients' businesses, for a more sustainable, productive and resilient tomorrow.
What will your typical day look like?
Design and build robust data pipelines, preferably with Databricks, ensuring efficient handling of large-scale data operations.
Manage and optimize SQL databases for data ingestion, transformation, and storage, ensuring high performance and reliability.
Utilize Python to develop and enhance data engineering solutions, including advanced data manipulation and automation.
Implement and integrate Machine Learning (ML) and AI solutions, with a focus on Generative AI to drive data insights and innovation.
Work with AWS cloud data services to leverage cloud-based tools for data processing, storage, and analytics.
Collaborate with stakeholders to translate business requirements into technical solutions, ensuring alignment with project goals.
Stay current with emerging technologies and best practices in data engineering, maintaining a forward-thinking approach.
Promote an inclusive environment within the Illuminate Data team and across the broader Illuminate Product team.
Mentor and guide junior data engineers, fostering their growth and achieving team objectives.
About the team We focus on building Australia's industrial capacity and capability in smarter ways.
Our primary market offerings are large-scale program and portfolio management, physical asset management, and climate and industrial technology.
Enough about us, let's talk about you.
You may have all or some of the following skills / experiences: 2+ years of pipeline design and build experience on Databricks for handling large data volumes and ensuring seamless data flow.
Strong data engineering skills with SQL databases, including experience with complex data management and transformation tasks.
Proficiency in Python for developing data engineering solutions, from data ingestion to advanced processing.
Experience with Machine Learning (ML) and AI, particularly with Generative AI technologies, to enhance data-driven decision-making.
Hands-on experience with AWS cloud data services, including tools for data storage, compute, and processing.
Solid understanding of data modelling, database design, and ETL processes.
Strong problem-solving skills and the ability to resolve data engineering challenges effectively.
A proven ability to design and integrate complex data pipelines within business systems.
