Data Engineers

Data Engineers
Company:

Default


Data Engineers

Details of the offer

All Data Engineers And DevOps Consultant please apply here.
We are looking for Data Engineers and DevOps specialists with vast experience of solving complex data engineering and architecture challenges preferably with more than one of the three Cloud Vendor offerings, Microsoft Azure, AWS and Google platforms.
What you will be doing:

Building the infrastructure required for optimal extraction and loading of data from a wide variety of data sources using SQL, Snowflake, Azure, AWS and Google Cloud 'big data' technologies stack.
Designing and implementing major architectural patterns for Data to ensure consistency, security, maintainability and flexibility leveraging Cloud platforms and solutions.
Designing, developing and building security architecture implementation for public and/or hybrid cloud based systems within Amazon Web Services (AWS), Microsoft Azure and Google Cloud platform

Data Engineer Skills Set:

Processing frameworks & programming tools: Spark (Scala/Python/Java), Kafka
Hadoop platforms & distributions: Cloudera, Hortonworks, MapR, EMR
Agile and DevOps delivery practices
Data modelling & data pipeline design
Cloud platforms: Developing data engineering pipelines on AWS, Azure, GCP, including with Cloud platform PaaS components; Databricks

DevOps Skill Sets:
We are looking for a DevOps engineer to work with an established data and analytics and cloud practice across a number of projects and who will be responsible for building, improving and maintaining the cloud and big data infrastructure, enabling their services to be deployed, run and operated from development to production. You will have the chance to work on a variety of cloud and big data projects with highly robust and scalable infrastructure, and some of the most cutting-edge systems and tools, including AWS, Terraform, and Docker.

Expert skills in Amazon Web Services (EC2, S3, EMR, ELB, Elastic Beanstalk, VPC, Kinesis, Route 53, security groups)
Solid background in DevOps engineering (load testing, continuous integration, change management, application monitoring, production support)
Strong experience in orchestration tools (Jenkins, Ansible, Chef)
Experience with scripting languages (Python, Scala, Go)
Expert skills in UNIX
Good understanding of networks and information security
Ability to manage and work in fast-paced, dynamic work environment
Any Data Warehousing, Big Data or Data Analytics experience is a huge bonus, but not essential.


Source: Jobsjobsjobs


Area:

  • Other Jobs / Other Jobs - Crafts

Requirements

Related offers

Secondary teachers 2020, emerald

Marist College Emerald is a Catholic co-educational College of approximately 560 students in years 7-12 situated in Emerald, Central Queensland. At Marist...


From Marist College Emerald - Queensland

Published 15 days ago

Secondary teachers (various subject areas) 2020, australia

Holy Spirit College, Mackay Qld, is a Catholic co-educational college within the Diocese of Rockhampton, catering to students from Years 7-12. Idyllically...


From Catholic Education Diocese Of Rockhampton - Victoria

Published 15 days ago

Casual relief teachers (k-12), australia

Catholic Education in the Diocese of Rockhampton invites applications from suitably qualified persons for teaching positions across all areas from K-1...


From Catholic Education Diocese Of Rockhampton - Victoria

Published 15 days ago

Engineering technician electrical | iron ore | port | residential 8:6 / 7:7

About BHP At BHP we support our people to grow, learn, develop their skills and reach their potential.With a global portfolio of operations, we offer a diverse...


From Bhp Billiton - Western Australia

Published 15 days ago