Data Engineer

7+12+12 Month Federal Government ContractAdelaide 2 days a week or Remote with some travel requiredNV1 clearance mandatoryOur Federal Government Client focused on science and innovation for Defence requires the services of a senior data engineer to support the ingestion, integration, and delivery of data products, with both structured and unstructured data. The senior data engineer will work as part of a multidisciplinary team of Data Scientists, Software and Platform Engineers. The data will range from data extracts (SQL) from legacy data systems, Excel spreadsheets and non-structured data such as imagery or documents. There will be some future integration required with SAP HANA.

The duties of the successful Data Engineer will be: Design and develop optimised data pipelines to collect, process, and manage large volumes of structured and unstructured data.Create data products for data analytics and Business Intelligence (e.g. for ingest by Tableau or PowerBI). This will involve assessing, aggregating and merging disparate datasets for efficient analytics.Source and negotiate access to data sets with data owners across Defence.Implement best practices for data quality assurance, data governance, and data security to ensure ongoing integrity of the data. This includes ongoing measurement of data quality.Collaborate, advice and document, including in-code artefacts, architecture and best practices for data management at scale.Evaluate emerging technologies and industry trends in data engineering and implement best of breed techniques.Source and negotiate for access to relevant Defence and open-source datasets.Support broader team in developing data products for decision making, business intelligence and machine learning.Demonstrate to Defence stakeholders the benefits and limitations of data architectures and maintaining good data quality.For a full copy of the Job Description please contact Jon at Recruitment Hive on 02 6299 1006 or click the apply button to send your interest in the position to Recruitment Hive. Job ID JB9250 closes COB on the 7th May 2024. All applicants must hold an NV1 clearance.

#J-18808-Ljbffr