Full time - Permanent role Brisbane based - hybrid role Work on cutting edge technology About The Role We are seeking an 'inhouse expert' Senior Data Engineer with Databricks and GenAI expertise in developing models, practical experience with vector databases, and advanced knowledge of Retrieval-Augmented Generation (RAG).
The ideal candidate will be an effective communicator, capable of collaborating with all levels of the organisation while advancing and documenting ML Ops processes to ensure that our machine learning operations are robust, scalable, and compliant.
Qualifications A Bachelor or Master's Degree in a quantitative discipline such as Computer Science, Data Science, Operational Research, Statistics, Mathematics, etc.
or equivalent experience.
GenAI accreditation.
Databricks accreditation.
Experience 5+ years of experience engineering a range of production-ready data pipelines.
5+ years of experience building statistical models and performing data analysis on large data sets (Desirable).
2+ years of building and deploying GenAI solutions, including prompt engineering, retrieval augmented generation (RAG), model fine tuning, through an ML Ops pipeline.
Generative AI expertise: Experience/good understanding of Generative AI Concepts and implementations.
Experience in Generative AI technology platform offerings, frameworks (Open source Langchain/LlamaIndex, other 3rd party platforms) and tools.
Good Experience in Prompt Engineering techniques.
Hands-on experience in vector databases, and advanced RAG.
Understanding of Knowledge Graphs is a plus.
Strong inclination to learn and experiment with new concepts and technologies in Generative AI space.
Skills Advanced programming skills in Python or R. Associated libraries like Pandas, NumPy, and Dask.
Frameworks like TensorFlow, PyTorch, or Keras.
Tools such as Apache Spark, Airflow, or similar technologies to ensure smooth data flow and integration.
Configuring Graph databases for optimal performance.
Familiarity with code management tools like Git, GitHub etc.
Familiarity with cloud computing and cloud native technologies (e.g.
Docker, K8S etc.).
Communication skills with the ability to communicate appropriately with customers in various situations.
Databricks Machine Learning/Mosaic (Desirable).
AWS services (Desirable).
Microsoft Azure OpenAI services (Desirable).
Data Management (Desirable).
Knowledge Deep understanding of machine learning algorithms, particularly those related to generative models such as GANs (Generative Adversarial Networks), VAEs (Variational Autoencoders), and transformers.
Deep knowledge of ML Ops.
Knowledge of optimisation for model performance and computational efficiency, including hyperparameter tuning, and model compression.
Who is 4impact 4impact is a Business and Technology Service Provider with offices in Brisbane (Australia), and Manila.
As a Data and Systems Integration company, we provide Enterprise Managed Services, Annuity Software and Data Services.
Put simply, we are experts at delivering complex projects well.
We believe people are at the heart of technology, and our focus is on delivering people-centric technology solutions.
4impact drives a values-based culture that bring out the absolute best in our people.
Our Values – Courageous, Committed, and Connected - influences how we engage with our people, clients, and partners.
What We Offer This is a rare opportunity to join an organisation embarking on an exciting period of growth.
Our future focused, values-based culture underpins our actions and decisions, enabling us to move forward together with clarity and define who we are in a way that is impactful and uniquely us.
You will have the opportunity to build a long-term career and work with leaders who want to see you succeed, and colleagues who collaborate with and support you in your success.
We offer genuine flexible working arrangements, you choose.
A competitive remuneration package in line with experience, with performance-based bonuses.
A culture that values continuous learning, with access to ongoing training and professional development opportunities.
We are an equal opportunity employer.