Data Engineer

Details of the offer

Must have a Negative Vetting Level 1 clearance. Working arrangements Onsite, Full-time (Monday to Friday). Flexible working/Work from home arrangements may be negotiated with the successful candidate after the first six months of the contract period. Key Responsibilities Demonstrated experience in designing, implementing and maintaining scalable and efficient data pipelines to process and integrate large datasets from multiple sources, including experience with performance optimisation. Demonstrated experience in creating and maintaining data models to support business needs, and ability to define relationships between different data entities. Experience with designing, building and maintaining a data analytics ecosystem/platform to support analytics and data science teams. Technical: Experience with Relational, Graph, Document, and Big Data Database Management Systems (DBMS). Experience with data modelling concepts for the various categories of DBMS. Proficiency in programming languages such as Python, SQL, Java, C#, or Scala. Experience with Extract, Transform, Load (ETL) tools, Data Warehousing, and Analytics. Data Quality, Governance and Security: Demonstrated experience in maintaining detailed documentation of data systems, processes, and pipelines to ensure they are easily understood and maintained. Experience implementing processes to ensure data accuracy, consistency, and security, including data cleansing and validation. Experience with data governance practices and data security measures. Qualifications: Bachelor's degree in Computer Science, Information Technology, Software Engineering, or a related field. Proven experience as a Data Engineer or in a similarly complex role. Experience with any of the following: Containerisation and orchestration tools (e.g., Docker, Kubernetes). Real-time data processing and streaming technologies, and data integration tools (e.g. Apache Kafka, Apache Nifi). Big Data technologies (e.g., Elasticsearch, Apache Spark, Databricks). CI/CD pipelines and infrastructure-as-code tools (e.g., Ansible). Kirra Services is a Supply Nation Certified ICT Service Provider, specialising in Hardware and Software procurement for Government, Corporate and Education. Services include cyber, consulting, recruitment, and project management. #J-18808-Ljbffr


Nominal Salary: To be agreed

Source: Jobrapido_Ppc

Requirements

Senior Solutions Engineer

The Zscaler Sales and Go-to-Market team is a global group of professionals who are passionate about delighting our customers, nurturing trusted partnerships,...


From Zscaler - Australia

Published 13 days ago

Senior Solutions Engineer

The Zscaler Sales and Go-to-Market team is a global group of professionals who are passionate about delighting our customers, nurturing trusted partnerships,...


From Zscaler - Australia

Published 13 days ago

Tech Lead

Make a difference and be part of an exciting national event.Work on next-gen avionics systems that shape the future of aerospace and defense!Have the opportu...


From Effective People Pty Ltd - Australia

Published 13 days ago

Sb17897 - Field Technician

Job Description MES is seeking a Field Technician to work for our client, an Australian based gold producer headquartered in Perth, Western Australia. Our cl...


From Https:/Www.Energyjobline.Com/Sitemap.Xml - Australia

Published 13 days ago

Built at: 2024-11-06T07:37:32.121Z