We are seeking an experienced Data Engineer or Senior Data Engineer to design, implement, and maintain data solutions using Microsoft Fabric and related technologies. The ideal candidate will bridge the gap between business needs and technical solutions, working within an Agile framework to deliver scalable data platforms.
Key Responsibilities Lead the design and implementation of end-to-end data pipelines using Microsoft Fabric, ensuring optimal performance, scalability, and reliability of data infrastructure.Develop and maintain data transformation processes using Python, implementing best practices for code quality and documentation.Architect and implement solutions using Microsoft Fabric, creating efficient data warehousing, lakehouse, and analytics solutions.Collaborate with cross-functional teams using Agile/Scrum methodologies, participating in sprint planning, daily stand-ups, and retrospectives.Design and implement data quality frameworks and monitoring solutions to ensure data accuracy and reliability.Mentor junior engineers and contribute to technical decision-making processes.Optimize existing data pipelines and implement automation solutions for improved efficiency.Required Qualifications & Experience Bachelor's degree in Computer Science, Engineering, or related field.5+ years of experience in data engineering roles.Strong expertise in Microsoft Fabric, including Data Factory, Synapse Analytics, and Power BI.Advanced Python programming skills with experience in data processing libraries (pandas, numpy, pyspark).Proven experience with Azure Synapse Analytics, including SQL pools and Spark pools.Strong understanding of data warehousing concepts and dimensional modelling.Experience working in Agile environments with Scrum methodology.Excellent understanding of CI/CD pipelines and DevOps practices.Strong SQL skills and experience with large-scale data processing.Preferred Qualifications & Experience Experience with Databricks and Delta Lake architecture.Knowledge of data governance and security best practices.Microsoft Fabric Data Engineer certification and/or Azure Data Engineer Associate certification.Experience with real-time data processing and streaming technologies.Familiarity with Infrastructure as Code (IaC) tools.Experience with version control systems (Git) and collaborative development.Experience with Generative AI and Large Language Models integration.Technical Skills Version Control: GitMethodologies: Agile, ScrumSoft Skills Strong problem-solving and analytical thinking abilities.Excellent communication and collaboration skills.Ability to work independently and as part of a team.Strong project management and organizational skills.Adaptability and willingness to learn new technologies.Impact and Growth Drive innovation in data engineering practices and architectural decisions.Contribute to the organization's data strategy and technical roadmap.Opportunity to work with cutting-edge technologies in the Microsoft ecosystem.Lead technical initiatives and mentor team members.About Tridant Tridant Pty Ltd is one of Australia's largest specialist consulting firms focused on designing and implementing Financial Performance Management, BI, Financial Reporting, Data Visualisation, Predictive Analytics and Information Management solutions, for both public and private sector organisations throughout Asia Pacific.
Why Tridant Our company offers a unique culture second to none; our ethos is that we are professional, but we make work an enjoyable experience. Tridant offers a collegiate team environment that embraces diversity and allows our staff the opportunity to grow independently in a supportive environment.
This is a fantastic opportunity to join a reputable, fast-growing company where there is a wealth of opportunity for the right candidate.
If you meet the required selection criteria and hold appropriate work rights, we invite you to apply for this role.
#J-18808-Ljbffr