Data Engineer

Details of the offer

Must have a Negative Vetting Level 1 clearance. Working arrangements Onsite, Full-time (Monday to Friday). Flexible working/Work from home arrangements may be negotiated with the successful candidate after the first six months of the contract period.
Key ResponsibilitiesDemonstrated experience in designing, implementing and maintaining scalable and efficient data pipelines to process and integrate large datasets from multiple sources, including experience with performance optimisation.Demonstrated experience in creating and maintaining data models to support business needs, and ability to define relationships between different data entities.Experience with designing, building and maintaining a data analytics ecosystem/platform to support analytics and data science teams.Technical:Experience with Relational, Graph, Document, and Big Data Database Management Systems (DBMS).Experience with data modelling concepts for the various categories of DBMS.Proficiency in programming languages such as Python, SQL, Java, C#, or Scala.Experience with Extract, Transform, Load (ETL) tools, Data Warehousing, and Analytics.Data Quality, Governance and Security:Demonstrated experience in maintaining detailed documentation of data systems, processes, and pipelines to ensure they are easily understood and maintained.Experience implementing processes to ensure data accuracy, consistency, and security, including data cleansing and validation.Experience with data governance practices and data security measures.Qualifications:Bachelor's degree in Computer Science, Information Technology, Software Engineering, or a related field.Proven experience as a Data Engineer or in a similarly complex role.Experience with any of the following:Containerisation and orchestration tools (e.g., Docker, Kubernetes).Real-time data processing and streaming technologies, and data integration tools (e.g. Apache Kafka, Apache Nifi).Big Data technologies (e.g., Elasticsearch, Apache Spark, Databricks).CI/CD pipelines and infrastructure-as-code tools (e.g., Ansible).Kirra Services is a Supply Nation Certified ICT Service Provider, specialising in Hardware and Software procurement for Government, Corporate and Education. Services include cyber, consulting, recruitment, and project management.
#J-18808-Ljbffr


Nominal Salary: To be agreed

Source: Talent2_Ppc

Requirements

Test Automation Lead

NV1 security clearance required ACT, NSW, QLD, SA, VIC, WA - hybrid arrangements Long 12+24 month Federal Government contract Selenium/Postman/Swagger/Cucumb...


Clearcompany - Australian Capital Territory

Published 6 days ago

Solution Architects (Multiple)

Solution Architect (Multiple) Australian Citizens with Baseline only RFQ closing date: Thursday, 21 November 2024 Client: Australian Electoral Commission E...


Virtuoso Consulting Pty Ltd - Australian Capital Territory

Published 6 days ago

Aps6 Senior Test Analyst

The Technology and Information Management (TAIM) team maintains Comcare's Information, Communication and Technology (ICT) infrastructure and provides strateg...


Tideri Jobbörse - Australian Capital Territory

Published 6 days ago

Enterprise Service Desk Administrator

Help Desk & IT Support (Information & Communication Technology) Employment Type: Full-Time, Permanent Salary Range: $109,560 to $117,990 plus superannuation ...


Catholic Education - Archdiocese Canberra & Goulburn - Australian Capital Territory

Published 6 days ago

Built at: 2024-11-22T18:43:42.441Z