Role: Azure Data Engineer Location: Canberra
Active AGSVA Baseline Security Clearance. We are seeking candidates with strong experience in developing Extract, Transform, Load (ETL) and Extract, Load, Transform (ELT) processes, and/or the development of data products and complex data visualisations.
The role will be responsible for design, development and unit testing activities across several data movement, data transformation, and data visualisation processes within DAFF. The data movement and transformation processes focus on the preparation of data for use in decision making processes across the department, utilising modern cloud technology (Azure) to enable operational analytics use cases.
The successful candidate will require experience with the following techniques and technologies:
MS Azure Stack Data Integration - Data Factory, SQL Server Integration Services and/or Databricks LogicApp and/or FunctionApp Data Store SQL Server and/or Data Lake Storage Unity Catalog (Medallion Architecture) Analytics Azure Databricks Azure Machine Learning ArcGIS Enterprise Development tools DevOps Visual Studio VS Code Data technology solutions Sourcing (Flat file, Ingres, Azure, SQL Server) Collecting, ingesting and storing SQL, Python, R, .Net Data Preparation Transformation of data into formats tailored to analytics use cases – Parquet and/or Delta Data Visualisation Analyse and interpret complex data sets, and to identify trends and patterns. Design principles to create appropriate visualisations for target audience. Visualisation tools - Power BI Green Light is one of Australia's most successful and fastest growing IT services businesses. We offer a wide range of IT services in Security, infrastructure and Systems Integration to a diverse customer base throughout Australia, New Zealand, SE Asia and Europe.
#J-18808-Ljbffr