Lead Engineer - Big Data

A leading Australian bank is seeking a skilled Lead Engineer - Big Data to support and enhance its big data platform.
This role is designed for a motivated data engineering professional who excels in building and managing robust, future-ready data solutions within the financial sector.
Key Responsibilities: Design, develop, test, and support data solutions across batch and near real-time pipelines.
Produce detailed solution designs and act as a technical lead, supporting data engineers and testers.
Demonstrate expertise in data architectures, big data, data modeling, analytics, cloud platforms, and data governance.
Lead proof-of-concept and demo sessions for innovative data solutions.
Collaborate closely with internal and external consultants on consulting and delivery engagements.
Mentor junior team members in data engineering practices and project delivery.
What You Need to Succeed: Minimum 5 years' experience in solution design, development, or tech leadership within IT consulting, ideally in banking or financial services.
At least 3 years' hands-on experience with Big Data/Data Lake technologies in cloud and on-premise settings.
Expertise with NoSQL databases (e.g., HBase) and distributed streaming platforms (e.g., Apache Kafka).
Proficiency in data modeling concepts, ETL, data warehousing, and BI solutions.
Strong coding skills in Scala, Python, SQL, and shell scripting.
Hands-on experience with cloud platforms such as Azure, AWS, or GCP.
Solid understanding of containerization, virtualization, infrastructure, and networking.
#scr-hannah-macleod At Randstad Digital, we are passionate about providing equal employment opportunities and embracing diversity to the benefit of all.
We actively encourage applications from any background.