Senior / Lead Data Engineer - Pyspark & Scala

Details of the offer

Cognizant has an exciting opportunity for a skilled and collaborative Senior /Lead Data Engineers with hands-on experience in Pyspark & Scala to join our thriving team. This full-time role is based in Sydney and offers an attractive salary and benefits. You'll be joining a collaborative and inclusive team seeking to be at the forefront of the business unit and deliver outstanding projects.
In your first few weeks in this role, you can expect to: Independently design and build/configure Big data pipelines as per the design. Able to identify and solve big data problems independently. Work closely with Big data developers to report any issues in build. Work on defect fixes during QA & UAT. Work through the life cycle of the code from low-level design to production and post-production support. To apply for this role, your soft skills, expertise, and experience should include: Strong technical and analytic skills to solve complex big data problems. Experience with Spark software stack, prior experience in working on Spark using Python or Scala or Java and PySpark based big data implementations. Strong knowledge and hands-on experience with HDFS, MapReduce, Hive, Impala, Tej, Sqoop, Pig, Oozie, HBase, Cassandra, MongoDB, Kafka, Spark, Storm, Knox, Ranger, Flume, NiFi, Falcon, Kerberos, Sentry, Cloudera Manager, Cloudera Navigator, and Ambari. Good experience in CI/CD & DevOps concepts. Good experience working in any cloud environment (Azure / AWS / GCP) using Agile methodology. You'll receive an excellent salary and benefits package for your knowledge, expertise, and flexibility. At Cognizant, taking care of employees is a priority:
You can pursue innovative career tracks and opportunities here. You can enhance your professional development through education and dedicated training. We'll give you the skills you need to keep pace with the changing workplace while our compensation, benefits, and wellness packages help you stay healthy and plan for the future. If this full-time role in Sydney motivates and inspires you, please get in touch with Cognizant today. We'd love to help you get your next role.
At Cognizant, we engineer modern businesses to improve everyday life because we're dedicated to making a lasting impact. Cognizant (Nasdaq: CTSH) engineers modern businesses. We help our clients modernize technology, reimagine processes, and transform experiences so they can stay ahead in our fast-changing world. Together, we're improving everyday life. See how at www.cognizant.com or @cognizant.

#J-18808-Ljbffr


Nominal Salary: To be agreed

Source: Jobleads

Requirements

Data Quality Specialist Lead

TAFE NSW Life-Changing Careers Data Quality Specialist Lead Location negotiable (subject to campus availability) 2x temporary full time until November 2025 B...


From Tafe Nsw - New South Wales

Published 13 days ago

Business Analyst - Non-Financial Risk

Business/Systems Analysts (Information & Communication Technology) Are you passionate about driving meaningful change and delivering impactful solutions? A l...


From Morgan Mckinley - New South Wales

Published 13 days ago

Applications Specialist

At Varian, a Siemens Healthineers Company, we bring together the world's best talent to realize our vision of a world without fear of cancer. Together, we wo...


From 0460 Vms Australasia Pty Ltd. - New South Wales

Published 13 days ago

Security Operations Engineer

Salary: $900 to $1000 per day including super Location: Sydney CBD office Work Arrangement: Hybrid WFH 2 days a week Contract Duration: 6 to 12 month cont...


From Https:/Www.Energyjobline.Com/Sitemap.Xml - New South Wales

Published 13 days ago

Built at: 2024-11-06T06:26:45.956Z