12 + 12 + 12 month contract – Baseline clearance Civic, ACT – Flexible work arrangements Develop ETL and ELT processes, data products and complex data visualisations Our client, a large Federal Government department based in Civic, ACT, requires an experienced Data Engineer for a long 12 + 12 + 12 month contract.
The role will be responsible for design, development and unit testing activities across several data movement, data transformation, and data visualisation processes.
The data movement and transformation processes focus on the preparation of data for use in decision making processes across the department, utilising modern cloud technology (Azure) to enable operational analytics use cases.
You will have experience with: MS Azure Stack Data Integration – Data Factory, SQL Server Integration Services and/or Databricks Data Store – SQL Server and/or Data Lake Storage Analytics – Azure Databricks, Azure Machine Learning, ArcGIS Enterprise Development tools – DevOps, Visual Studio, VS Code Data technology solutions – sourcing (Oracle, Ingres, Azure, SQL Server), collecting, ingesting and storing Data Preparation Transformation of data into formats tailored to analytics use cases – Parquet and/or Delta Data Visualisation Analyse and interpret complex data sets, and to identify trends and patterns.
Design principles to create appropriate visualisations for target audience.
Visualisation tools – Power BI Selection Criteria Demonstrated experience developing ETL/ELT processes for complex and/or large data movement, transformation and/or visualisations, particularly in a cloud environment.
Experience preparing data optimised for query performance in cloud computed engines.
E.g.
Distributed computing engines (Spark) Graph Databases Azure SQL.
Experience working with Engineering, Storage and Analytics services in cloud infrastructure.
Experience working with Azure Data Factory and Databricks (desirable).
Experience/Knowledge of working with Data Lake and Lakehouses (desirable).
To apply for this long Data Engineer contract, please click the Quick Apply button to forward your CV to Andy at the Recruitment Hive.
Please note our internal Job ID is 10091 and this RFQ closes on the 6th of November 2024.