Who we areJemena is an Australian energy company who own and operate more than $12.4 Billion worth of gas and electricity transportation assets across Australia supplying millions of households and businesses with these essential services every day.We pride ourselves on our innovative approach, technical expertise, and dedication to safety, quality, and sustainability. Our Group's over 3000 team members consistently strive to make a difference in the communities we serve.Overview of our roleAs Senior Data Engineer, you will be empowered to build, optimise, and maintain Jemena's data pipelines and ETL processes to support data-driven decision-making across business units. Your role will focus on developing robust data solutions within Databricks, covering Bronze, Silver, and Gold medallion layers to ensure data integrity, accessibility, and performance.Play a key role in orchestrating data workflows, managing dependencies, and leveraging tools like Apache Airflow, DBT core, and Spark to develop efficient data models and processing pipelines. Bring your expertise and passion in data engineering best practices, including data extraction, transformation, and integration from various internal and external sources. Collaborate with line-of-business teams to understand data requirements and ensure the delivery of high-quality, reliable data products.By ensuring the continuous optimisation and scalability of Jemena's data engineering infrastructure, you will empower Jemena to derive actionable insights and drive business outcomes.A little about youDemonstrated experience in designing and optimizing (AWS) cloud-based data pipelines and ETL processes with a focus on data quality and performance.Proficiency in using Databricks to manage data flows across Bronze, Silver, and Gold layers, supporting efficient data architectures.Expertise in data orchestration tools such as Apache Airflow, DBT, or Databricks Workflows to streamline processes and manage dependencies.Strong skills in Python and SQL for creating scalable data models and transformations, with practical knowledge of integrating data from diverse sources, including APIs and real-time streams.Experience collaborating in agile environments with cross-functional teams to deliver impactful data solutions.Familiarity with Spark, PySpark, Delta Lake, and CI/CD tools such as GitLab to enhance large-scale data processing and infrastructure provisioning.Qualifications / certifications & SkillsDemonstrated expertise in data engineering principles, focusing on modern data lakehouse architectures in cloud environments.Skilled in using Databricks to design and manage data layers (Bronze, Silver, Gold) for seamless data processing and analytics.Proficient in Git version control for collaborative development and CI/CD pipelines (e.g., GitLab CI/CD) to automate the deployment and testing of data engineering workflows.Proficient in Python and SQL, developing scalable, reusable data transformations and optimizing workflows using tools like Apache Airflow and DBT.Experienced with big data frameworks such as Spark and PySpark to handle complex datasets and enhance ETL performance.Adept at ensuring data security and governance, adhering to best practices and compliance standards.Knowledgeable in integration tools for extracting data from APIs and diverse sources, enabling efficient ingestion and modeling.Why you should come and work for usOur people are our energy source and we offer meaningful benefits and rewards that work for you. We offer the opportunity for long-term career growth as part of our talent development and succession planning process. Join our team and make a meaningful impact toward Australia's "Net Zero" targets through the delivery of critical infrastructure projects and be a part of our journey to shape the future of the energy and utilities industry.Jemena is among the first companies in Australia to be accredited as a Family Inclusive Workplace.Flexible work arrangements, empowered to work your way & agile + additional leave benefits!Primary & secondary parental leave & well-being and family support benefits.Numerous career development pathways + yearly financial support to upskill.Annual bonuses + generous $$$ employee referral program.Empowering you within a fun, diverse, and inclusive culture.Group benefits galore for all employees!Genuine focus on work/life balance.We are committed to developing a diverse and inclusive workforce that reflects the communities we are part of. We welcome applications from people of all ages, backgrounds, abilities, and identities. At Jemena, you belong.Recruitment ProcessDuring our recruitment process, you will be required to undergo pre-employment checks including pre-employment medical, reference checks, and a national police check. Notice to Third Parties: Jemena does not accept unsolicited resumes (or liability associated with fees or costs) from recruitment agencies, search firms, or third parties. Interested candidates are welcome to submit their application independently.
#J-18808-Ljbffr