Lead Engineer-Big Data

Details of the offer

Design, Develop, test and support future-ready data solutions for customers across industry verticalsProduce Detailed Solution Design and support data engineers and testers as a technical lead in a data projectDevelop, test and support end-to-end batch and near real-time data flows/pipelineDemonstrate understanding in data architectures, modern data platforms, big data, data modelling, ML/AI, analytics, cloud platforms, data governance and information management and associated technologiesDevelop and demonstrate Proof of Concepts and Working DemosSupport and collaborate with other internal/external consultants in consulting, workshops and delivery engagementsMentor junior IBM consultants in the practice and delivery engagementsMandatory Requirements: Must have leadership qualities applicable for the project team and beyondMust understand and navigate large organisation's governance and processes with easeMust have exceptional inter-personal skills and able to present solution design with confidence in large technical forumsMinimum of 5+ years of experience as a solution designer, tech lead, developer, tester or support role in IT Consulting or other technology business units across the industry but Banking/FSS is preferrableMinimum of 3+ years of hands-on development, testing and administration experience with Big Data/Data Lake services in cloud and on-premiseExperience in applying industry best practices, design patterns and first-of-a-kind technical solutions as developer or administrator on data and non-data specific platforms and applicationsExperience in NoSQL databases such as HBase(Expert in design and dev)Experience in implementing near real-time data flows/pipelines and distributed streaming applications using technology such as Apache Kafka (Expert in design and dev)Understanding of various data modelling concepts and techniques such as Entity Relationship Modelling, Third Normal Form, Dimensional Modelling etcUnderstanding of Data Mesh Architecture and Domain Data ProductsExperience in implementing traditional ETL, data warehousing and BI solutionsHands-on development experience and working skill level in Scala (Expert), Python, SQL, shell scripting and other programming/scripting languagesHands-on implementation of services sensitive to performance SLAs with high availability, fault-tolerance, automatic fail-over and geographical redundancyWorking knowledge and hands-on experience with Cloud Platform such as Azure, AWS, GCP and IBM and other modern data platformsSolid understanding of containerisation, virtualisation, infrastructure and networkingDiverse experience in software development methodologies and project delivery frameworks such as Agile Sprints, Kanban, Waterfall etcDesired Attributes and Skills: Degree in Computer Science, Information Technology or related Engineering coursesOne or more industry-recognised technology certifications or badges
#J-18808-Ljbffr


Nominal Salary: To be agreed

Source: Jobleads

Job Function:

Requirements

Dams Engineering Opportunities

Company Description Bold ideas bring transformative solutions. For decades AECOM has been providing water system services throughout ANZ with a focus on emer...


Aecom - New South Wales

Published 13 days ago

Civil Project Engineer

About Us Squadron Energy is Australia's leading renewable energy company that develops, operates and owns renewable energy assets in Australia. With proven e...


Squadron Energy - New South Wales

Published 13 days ago

Stantec | Asp3 Electrical Engineer | Willoughby

ASP3 Electrical Engineer - ( 24000333 ) Description About the role: Are you an experienced ASP3 Electrical Engineer looking for the next step in your caree...


Tideri Jobbörse - New South Wales

Published 13 days ago

Ghd | Senior Civil Engineer | Sydney (Haymarket)

At GHD, we don't just believe in the power of commitment, we live and breathe it every day. Who are we looking for? Join our dynamic team as a Senior Civil E...


Tideri Jobbörse - New South Wales

Published 13 days ago

Built at: 2024-12-22T17:28:31.035Z