Senior Databricks Consultant

Details of the offer

The Role At Cognizant, we're not just at the forefront of technological innovation – we're actively shaping the future of data-driven enterprises. As we rapidly expand our market presence and revolutionize industries, we're seeking exceptional talent at various levels to join our flourishing Databricks practice.
As a key player in our dynamic team, you'll have the opportunity to design and implement cutting-edge solutions for leading Australian organizations, leveraging the power of Databricks to solve complex business challenges. Your role will be pivotal in not only implementing state-of-the-art Databricks solutions but also in optimizing cloud environments and maximizing the business value our clients derive from them.
Responsibilities Diving deep into customer objectives, goals, and challenges, positioning yourself as a trusted advisor in their data transformation journey. Spearheading the design and deployment of large-scale Databricks environments on Azure and/or AWS, setting new industry benchmarks. Collaborating with cross-functional teams to architect optimal data solutions and enhance analytical capabilities, driving innovation across organizations. Crafting, developing, and maintaining scalable data pipelines, reusable frameworks, and platforms using Databricks, contributing to our growing suite of proprietary solutions. Staying at the cutting edge of data engineering and cloud technologies, ensuring Cognizant remains a step ahead in the rapidly evolving tech landscape. Optimize cluster performance and resource allocation to enhance processing efficiency and minimize costs. Monitor and troubleshoot cluster performance issues, implementing solutions to ensure uptime and reliability. Representing Cognizant as a thought leader in industry forums and meetups, elevating our brand and market position. Mentoring junior engineers and fostering knowledge sharing within the team, contributing to our culture of continuous growth and excellence. Qualifications To apply for this Databricks Consultant role, your soft skills, expertise and experience should include:
A minimum of 4 years' experience using Databricks (6+ years for Senior/Principal Consultant roles). Mastery of Databricks core components including DataFrames, Datasets, Spark SQL, Delta Lake, Databricks Notebook, DBFS, and Databricks Connect. Hands-on experience with Databricks, Azure Data Services, and related technologies, with Azure and/or AWS Databricks certifications. In-depth knowledge of the Medallion Architecture or similar data frameworks. Strong understanding of data architecture principles, including data modeling, ETL processes, data governance, data quality, privacy, and security controls. Proficiency in SQL, data analysis tools, and familiarity with programming languages such as Python, PySpark, Scala, and others. Exceptional problem-solving skills with the ability to analyze complex issues and develop effective, scalable solutions. Excellent communication skills: Strong written and verbal abilities to effectively collaborate with team members and stakeholders at all levels. Familiarity with AWS or Azure for deploying and optimizing Databricks environments. Additional Skills Additional skills which would be highly desirable:
Expertise in machine learning pipelines, Spark Streaming, Databricks AutoML, Delta Live Tables, Databricks Unity Catalog, and Databricks Serverless Computing. Experience in designing and implementing DataOps & Data Mesh aligned frameworks to optimize data platforms for cost, value, flexibility, and efficiency. Benefits Joining Cognizant will give you the opportunity to learn and collaborate with some of the most talented people in the industry, while having your finger on the pulse of emerging industry trends and working on the cutting edge of technology in your field of expertise.
We recognize that our people perform at their best when they feel valued as significant contributors and that is why at Cognizant, taking care of our employees is a priority:
You can pursue innovative career tracks and opportunities here. You can enhance your professional development through education and dedicated training. We'll give you the skills you need to keep pace with the changing workplace while our compensation, benefits and wellness packages help you stay healthy and plan for the future. Please reach out to our friendly and welcoming team today to apply and register your interest for this full-time hybrid Databricks Consultant position.

#J-18808-Ljbffr


Nominal Salary: To be agreed

Source: Jobleads

Requirements

Secure Kernel Engineer, Sydney - Australia

Secure Kernel Engineer, Sydney - AustraliaSoftware and ServicesThe people here at Apple don't just build products, we build the kind of wonder that revolutio...


Apple Inc. - New South Wales

Published 3 days ago

Senior Technical Analyst, Erdm | Sydney, Au

Senior Technical Analyst, ERDM Westpac Banking Corporation, Sydney, Australia Job Description Permanent Sydney based Data Platforms How will I help? The ERDM...


Westpac - New South Wales

Published 3 days ago

Nbn Telecommunications Desktop Designer

Telecommunications (Information & Communication Technology)Full timeThis opportunity will suit an experienced Telecommunications Designer. This is your chanc...


Northbridge Recruitment - New South Wales

Published 3 days ago

Cloud Operations Lead

Cloud Operations Lead (AWS)Job DescriptionSydney or Melbourne location with flexible workingBe a part of a world class teamHow will I help?The Cloud Support ...


Westpac - New South Wales

Published 3 days ago

Built at: 2024-11-15T19:41:11.121Z