Data Engineering & Warehousing - Green Light

Data Engineering & Warehousing - Green Light
Company:

Green Light


Details of the offer

```html Sydney CBD – hybrid work setup Initial 3-6 month contract engagement Immediate Start About the company: Green Light is one of Australia's most successful and fastest-growing IT services businesses.
We offer a wide range of IT services in Security, infrastructure, and Systems Integration to a diverse customer base throughout Australia, New Zealand, SE Asia, and Europe.
About the engagement: Green Light Worldwide are looking for a Data Analyst (Azure Data Bricks) to join our Sydney delivery team working on delivering excellence to work extensively with an enterprise end customer.
The Data Analyst (Azure Data Bricks) will possess a demonstrated background in data analysis and constructing complex queries.
The Data Analyst (Azure Data Bricks) will design, construct and implement new data feeds to the data warehouse, build complex reports for the business and be involved in the maintenance ETL (Extract-Transform-Load) programs.
Responsibilities: Data Modelling analysis, strategy, data governance, data quality, data analytics and mining across multiple database technologies.
Design and develop data pipelines using on Azure Databricks for ingestion, curation, enrichment and transformation of data.
Transformation of data – SQL, Spark and Data Bricks.
Data modelling predominately with Power BI.
Work closely with project stakeholders to understand data needs.
Develop and implement data quality checks and ensure data integrity throughout the processing pipeline within Databricks.
Define, produce and implement data strategy across data from various data sources.
Design effective solution to process very large volumes of data within acceptable SLA timeframe.
Complete Data Analysis and data modelling to build data models and physical data models for the designed solution – align with architecture framework.
Conduct Data Governance.
Fully utilise your knowledge of Azure services like Azure Data Lake Storage and Azure Data Factory to optimize data storage, access, and orchestration within the data platform.
Requirements: Strong data modelling & analysis, data migration strategy, data alignment across multiple applications, heterogeneous data identification, data masking/transformation & data mining.
Proven experience in designing and developing data pipelines using Databricks / Spark / Python.
Strong proven experience in building data models.
Strong hands-on experience doing data analysis using different formats.
Strong understanding of database concepts such as referential integrity and data alignment, table partitions, data import-export mechanisms, data transfer and transformation mechanisms, data encryption / decryption & cleansing / harmonization.
Strong understanding of table structures, schema, users and grants.
Strong skills in designing optimised solutions to process TBs of data.
Knowledge of query optimisation techniques.
Good knowledge of Microsoft Azure cloud platform and broader Databricks ecosystem (Azure Data Lake Storage, Azure Data Factory, Databricks workflow, Unity Catalog etc).
Strong business knowledge and quantitative modelling capabilities.
Must have a strong aptitude for careful and considered impact analysis, risk assessment, change management, and planning of recovery options.
Culture: Innovative and continually improving enterprise environment Be challenged by a high availability, significant enterprise-sized end customer Collaborative work environment Benefits: Have a technical partner invest into your skillset and ability.
Attractive working environment – emphasis on training and flexibility.
How to Apply: Click APPLY or contact Stephanie – Senior Resource Manager on for a confidential discussion with Green Light Worldwide.
```#J-18808-Ljbffr


Source: Jobrapido_Ppc

Requirements

Data Engineering & Warehousing - Green Light
Company:

Green Light


Aps 6 Senior Project Officer – First Nations Science And Knowledge - Affirmative

APS 6 Senior Project Officer – First Nations Science and Knowledge - Affirmative Join us to shape the future of one of Australia's greatest natural assets an...


From Tideri Jobbörse - Australia

Published 7 days ago

Security Tooling Engineer

Company DescriptionWe're a large scale systems integration company, committed to delivering trusted solutions that help to safeguard Australia. With over 20 ...


From Leidos- - Australia

Published 7 days ago

Aps 6 Senior Project Officer – First Nations Science And Knowledge - Affirmative

APS 6 Senior Project Officer – First Nations Science and Knowledge - Affirmative Join us to shape the future of one of Australia's greatest natural assets an...


From Tideri Jobbörse - Australia

Published 7 days ago

Machine Learning Platform Engineer

Full time $89,967 – $141,223 (AE5 - AEE1) + 15.4% super The Australian Security Intelligence Organisation (ASIO) protects Australia and Australians from thre...


From Tideri Jobbörse - Australia

Published 7 days ago

Built at: 2024-10-07T06:22:52.196Z