Cloudera Hadoop Administrator

Details of the offer

About the Role
We are seeking a skilled Cloudera Hadoop Administrator to join our dynamic team and take ownership of maintaining and optimizing our big data infrastructure. The ideal candidate will have hands-on experience with Hadoop administration, a strong understanding of AWS DevOps, and the ability to troubleshoot and debug logs in tools like Impala, Hive, and Spark.
Key ResponsibilitiesAdminister and manage Cloudera Hadoop clusters to ensure high availability, scalability, and performance.Monitor and troubleshoot Impala, Hive, and Spark processes by reviewing logs to identify and resolve issues, with a primary focus on Impala and secondary on Hive.Collaborate with cross-functional teams to implement AWS DevOps solutions, including monitoring, automation, and infrastructure optimization.Assist in transitioning and cross-skilling between Impala and Hive, enabling effective troubleshooting across platforms.Utilize basic shell scripting skills to read, debug, and understand scripts for automating repetitive tasks or resolving technical issues.Ensure compliance with security policies and procedures, implementing cluster security and access controls.Support data pipeline operations and provide expertise to development teams where necessary.Skills and QualificationsMandatory: Proven experience in Cloudera Hadoop administration with a focus on cluster setup, monitoring, and optimization.Proficiency in Impala (primary focus), with secondary experience in Hive and working knowledge of Spark (non-development, primarily log troubleshooting).Solid experience with AWS DevOps tools and services (e.g., CloudFormation, Lambda, EC2, S3, and IAM). Candidates with Azure experience will be considered if part of a squad with complementary AWS expertise.Basic shell scripting skills, with the ability to read, understand, and debug scripts effectively.Exposure to Bitbucket.How to ApplyIf you're passionate about managing complex data environments and have the skills we're looking for, we'd love to hear from you. Apply today with your CV outlining your suitability for the role.
To be considered for the role click the 'apply' button or for more information about this and other opportunities please contact David Ruiz on or email: and quote the above job reference number.
Paxus values diversity and welcomes applications from Indigenous Australians, people from diverse cultural and linguistic backgrounds and people living with a disability. If you require an adjustment to the recruitment process, including the application form in an alternate format, please contact me on the above contact details.
#J-18808-Ljbffr


Nominal Salary: To be agreed

Source: Talent2_Ppc

Requirements

Data Services Lead

Data Services Chapter Lead - Build & RunPrimary Details Time Type: Full time Worker Type: Employee As QBE AUSPAC continues its transformation journey, we ar...


Qbe - New South Wales

Published 11 days ago

Infosys Limited | Support Engineer

About Infosys: Infosys is a global leader in next-generation digital services and consulting. We enable clients in more than 56 countries to navigate their d...


Tideri Jobbörse - New South Wales

Published 11 days ago

Tibco Specialist

Primary Details Time Type: Full time Worker Type: Employee Location: SydneyType: Full time permanent opportunityHybrid role, Happy to talk flexible workingTh...


This Is An It Support Group - New South Wales

Published 11 days ago

Graduate Software Development Engineer In Test (Trust & Safety) - 2025 Start

TikTok is the leading destination for short-form mobile video, with global headquarters in Los Angeles and Singapore, and offices in various cities worldwide...


Buscojobs - New South Wales

Published 11 days ago

Built at: 2024-12-27T09:58:05.271Z