Senior Data Engineer

Senior Data Engineer
Company:

Octopus Energy


Details of the offer

Help us use technology to make a big green dent in the universe!
powers some of the most innovative global developments in energy.We're a technology company focused on creating a smart, sustainable energy system.
From optimising renewable generation, creating a more intelligent grid and enabling utilities to provide excellent customer experiences, our operating system for energy is transforming the industry around the world in a way that benefits everyone.It's a really exciting time in energy.
Help us make a real impact on shaping a better, more sustainable future.About the teamAt Kraken we have developed a platform to provide data services to our retail businesses and clients across 22 deployments globally.
The data platform engineering team develops and manages the back-end systems and processes supporting this platform, predominantly working with time-series data fed into the system by our customers' smart meters.
We have developed a suite of applications to process, transform, and make this data available to downstream services.
To process the volume of data we typically see, our applications run PySpark or dbt jobs using Databricks as our Spark engine.
We also leverage Airflow and Kubernetes heavily.
We also employ software engineering best practices to design, test, and deploy our data platform and services.More about the role This is a fantastic opportunity to work on data problems that genuinely move us closer to Net Zero with a company that is passionate about building great technology to change the way customers use energy.As a Senior Data Engineer, you will be responsible for supporting the constant improvement of our data systems.
As well as working on our core datalake transformations you may be developing custom applications to process third-party data, managing infrastructure in our AWS deployment, or working to expand our presence across our APAC, with offices in Australia, New Zealand, and Japan.Key responsibilities:- Supporting the development of our core Python applications- Supporting the development of our dbt models- Building and maintaining data pipelines in Airflow- Responding to internal requests for tooling and data pipelinesMore about you, our ideal candidate We are looking for someone who will self-manage, adapt to our changing business requirements, and proactively work to scope problems and deliver pragmatic solutions.Ideally, you have experience:- Building applications in Python- Working in a Spark or Databricks environment- Working in a software or data engineering environmentWe also want our data engineers to be great software engineers with a passion for writing quality code, so it would be helpful to have experience in at least some of the following: - SQL- dbt- Cloud data platforms (Ideally AWS)- Kubernetes- Version control and DevOps best practicesWhat you will love about us Our company culture - We are organisation where people learn, decide, and build quicker.
Where people work with autonomy, alongside a wide range of amazing co-owners, on projects that break new ground.
We want your hard work to be rewarded with perks you actually care about!
We won in 2022, on Glassdoor we were voted and our Group CEO, Greg has recorded and how we empower our people.Flexible working environment - genuine work life balance here, we are, we treat you as a human, and do our best to make work and life merge smoothly together Equity Options Scheme - you own your own part of the business, share options in the whole Octopus Energy Group so we all work together towards success Office - have a certain tech requirement?
We'll do our best to get it.
We also have drinks, snacks and a coffee machine at the WeWork office space.Your development is important - we support and help with development including internal and external courses, learning, study support etc, all bespoke to you We would prefer someone who can work in our Melbourne office hybrid / remote of 1-2 days a week onsite but it's not a deal breaker.
You do need to have the rights to work in Australia.
We're very excited to be growing our team.
We're looking for skills and experience to help shape and define the future of not only our team, but the wider business at a global scale.
If you're reading this and grinning, please apply!
There are huge challenges to tackle, and we need amazing people who are keen to get stuck in.


Source: Talent_Ppc

Requirements

Senior Data Engineer
Company:

Octopus Energy


It Support

SUMMARY OF THE ROLEEnsure that end user experience is always at desired levels by providing day to day support on all IT related matters and interactions or ...


From Jotun Dekorativ Marketing - Victoria

Published 9 days ago

Big Data Graduate Programme

Job Description:What we're all about.It isn't often you get to be part of a tech company that, since 2016, has been innovating the data analytics market in w...


From Exact It Consulting - Victoria

Published 9 days ago

Communications Manager

Communications ManagerDepartment: Strategic Communications - Australia RetailDivision: Communications & Public AffairsLocation: MelbourneAbout UsAt ANZ, we'r...


From Australia And New Zealand Banking Group Limited - Victoria

Published 9 days ago

Senior Valuers To Director | Asset Advisory (Plant Machinery/Infrastructure) | Melbourne

Join Our Team at Acumentis We are growing and looking for energetic folks who want to have fun, undertake challenging and exciting valuation and advisory ser...


From LMW - Victoria

Published 9 days ago

Built at: 2024-09-30T20:37:49.446Z