Data Engineer

Details of the offer

SAIRAM TECHNOLOGIES PTY LTD – Alfredton VIC
Job Type: Permanent position | Full time position
Job Description Data Engineer Opportunity
Stable and secure permanent full-time role
Competitive salary and benefits
Flexibility + access to professional development
Immediate start
Salary: $70k - $85k p.a plus Superannuation.
About Us
We are an IT consulting and services company focusing on Data Analysis, Data visualisation, Big Data and Cloud services based in Victoria.
Role Description
We have an opportunity for a Data Engineer to work on a large, greenfield data project in a large environment. You will be working closely with the business and other stakeholders as you develop a business-critical analytics and data platform.
Key Responsibilities: Build data lakes, data pipelines, big data solutions and data warehousing solutions.Develop and deploy key cloud based infrastructure and maintain data pipelines.Excellent working experience in Python and SQL.Excellent working experience of AWS Redshift.Experience with Dockers and Kubernetes.Experience with AWS including any or all of EC2, S3, IAM, EKS and RDS.Good understanding of Data Warehousing/ETL concepts.Experience with CI/CD tools.Translate business requirements into efficient technical design.Collaborate with cross-functional teams and work with different stakeholders.Work with the Lead Data Engineer to manage and maintain a global data warehouse environment/ETL framework and database integrations.Problem analysis, process improvements and efficient issue resolution.Design and implement technology best practices, guidelines, and repeatable operational processes.Skills and Experience:
To meet the challenges of this role, you will ideally be a bachelor's degree qualified in computer Science, engineering, or related field and possess the following skills and experience:
5+ years of experience in building cloud data infrastructure that can scale with ease, depending on traffic.Experience with Cloud platforms such as: AWS, Azure and GCP.Experience with DevOps / Continuous Integration frameworks with configuration management tools such as Puppet (Chef, Salt, Docker also relevant).Experienced with automation and orchestration concepts/skills.Good knowledge of data management, data governance, and data storage principles.Proficiency in Pyspark for data processing and analytics.Work closely with functional teams to design and implement a Customer Data Platform (CDP) on Cloud.Ensure data solutions adhere to best practices in security, scalability, and performance.Develop, manage, and maintain ETL frameworks, data modelling and analysis using Kimball dimensional modelling methodology.Ability to work both individually and collaboratively and enjoy taking ownership of a project.Infrastructure as Code: Terraform, ARM Templates, Cloud Formation, AWS CDK, Serverless Framework and Pulumi.Build / Release Tools: GitHub, Azure DevOps, Bitbucket and TeamCity.Containers: Docker, Kubernetes.Project Management Capabilities (scrum, agile, and waterfall) and good communication skills.Salary: $70,000.00 – $85,000.00 per year
Benefits: Professional development assistanceWork from homeHybrid Schedule: 8 hour shiftAbility to commute/relocate: Melbourne VIC: Reliably commute or planning to relocate before starting work (Preferred)
Work Authorisation: Australia (Preferred)
Date Posted: 15 Oct 2024
Education: Bachelor Degree (Preferred)
Experience: Data Engineer: 5 years (Preferred)
Work Location: Hybrid remote in Alfredton, VIC 3350
#J-18808-Ljbffr


Source: Talent2_Ppc

Requirements

Manager, Technical Talent & Bids Victoria, Bc

Bring your extensive skills and experience to a dynamic IT firm as Manager, Technical Talent & Bids. AOT Technologies is a youthful organization currently po...


From Tbwa Chiat/Day Inc - Victoria

Published 12 days ago

Services Engineer

BESIX Watpac is an Australian multi-disciplinary construction company, backed by a century of global expertise and financial strength. A wholly owned subsidi...


From Besix International - Victoria

Published 12 days ago

Service Desk Consultant - Health Information Software

Service Desk Consultant - Health Information Software• Fantastic opportunity with the fast-growing market leader in our industry • Great culture, which is su...


From Telstra Health - Victoria

Published 12 days ago

Enterprise Architect - Transformation Advisory

Join a leading business solutions companyWork alongside industry leading specialistsFantastic employee benefits and work cultureHybrid working environment / ...


From Fusion5 Pty Ltd. - Victoria

Published 12 days ago

Built at: 2024-11-05T10:38:17.484Z