Big Data Developer - Scala, Pyspark

Details of the offer

Direct message the job poster from Tech MahindraLead Talent Acquisition @ APJI - Banking & Insurance, Telecommunication, Global Media & Entertainment Projects || Global Recruitment Coach & TrainerJob Description:Design, build, and maintain scalable data pipelines and workflows on the Databricks platform.Collaborate with data engineers, data scientists, and analysts to optimize data architecture and performance.Implement monitoring, alerting, and automation solutions to ensure the reliability and efficiency of Databricks clusters and jobs.Provide technical expertise and support for troubleshooting issues and optimizing data processing and analysis tasks.Proficiency in Databricks, Apache Spark, and related big data technologies.Experience with designing and implementing ETL processes, data modeling, and data warehousing concepts.Strong programming skills in languages such as Python, Scala, or SQL.Familiarity with cloud platforms like AWS.Excellent problem-solving skills and the ability to work effectively in a collaborative team environment.Certifications in Databricks or related technologies are desirable.Seniority levelMid-Senior levelEmployment typeFull-timeJob functionIndustries: IT Services and IT Consulting
#J-18808-Ljbffr


Nominal Salary: To be agreed

Source: Whatjobs_Ppc

Requirements

Technical Customer Support Engineer - (Australia)

About HarperDB HarperDB is a new type of development technology that combines distributed database, cache, application, and streaming systems into a single p...


Buscojobs - Victoria

Published 4 days ago

Associate Vulnerability Analyst

Triskele Labs are one of the leading providers of cybersecurity services in Australia. We assist clients to reduce their risk of a cyber compromise through t...


Triskele Labs Global Pty - Victoria

Published 4 days ago

Pyramid Global Technologies | Azure Devops Engineer

Job Description for Azure DevOps Engineer in Sydney. Skills : Microsoft AzureAzure DevOps and JenkinsAKS, KubernetesTerraform, ARM, and BicepProject Build an...


Buscojobs - Victoria

Published 4 days ago

Data Engineer

Xero is a beautiful, easy-to-use platform that helps small businesses and their accounting and bookkeeping advisors grow and thrive. At Xero, our purpose is ...


Roman Health Pharmacy Llc - Victoria

Published 4 days ago

Built at: 2025-01-09T08:59:53.986Z