Experis are proud to be representing a prestigious financial services organisation who are recruiting for an experienced Lead Engineer - Big Data to join their team on a contract basis and lead the design, development, and delivery of future-ready data solutions.
As a technical lead, you will work closely with cross-functional teams to provide cutting-edge data solutions while mentoring junior team members and ensuring excellence in project delivery.
Key Responsibilities:Design, develop, test, and support robust, scalable, and future-ready data solutions for a variety of industry verticals.Create and deliver detailed solution designs, providing technical leadership to data engineers and testers on data projects.Build and manage end-to-end batch and near real-time data pipelines and workflows.Demonstrate a strong understanding of data architectures, modern data platforms, big data, data modeling, machine learning (ML) & artificial intelligence (AI), analytics, cloud platforms, and data governance.Lead the development and presentation of Proof of Concepts (PoCs) and working demos.Collaborate and support both internal and external consultants in workshops, consulting engagements, and project delivery.Mentor junior consultants and guide them through delivery engagements and technical best practices.Key Skills and Experience:Leadership: Demonstrated leadership skills with the ability to lead and inspire project teams.Governance & Processes: Proven experience in navigating large organisational governance and processes effectively.Communication: Exceptional interpersonal skills with the confidence to present solution designs to large technical audiences.Industry Experience: Minimum of 5+ years of experience in solution design, technical leadership, development, or support roles in IT consulting or similar industries, with experience in the banking sector.Technical Expertise: 3+ years of hands-on experience with Big Data / Data Lake services in cloud and on-premise environments.
Strong experience in NoSQL databases (HBase) and distributed streaming applications (Apache Kafka).
In-depth knowledge of data modeling (ER, Third Normal Form, Dimensional Modeling), Data Mesh Architecture, and Domain Data Products.
Hands-on experience with traditional ETL, data warehousing, and business intelligence (BI) solutions.
Proficiency in programming languages such as Scala (expert), Python, SQL, shell scripting, and other languages.
Experience with implementing services with high availability, fault tolerance, and automatic failover.Cloud & Modern Platforms: Experience working with major cloud platforms (Azure, AWS, GCP, IBM) and containerisation / vitalisation technologies.Development Methodologies: Experience with Agile, Kanban, Waterfall, and other software development frameworks.Educational Background: A degree in Computer Science, Information Technology, or related engineering fields.Certifications: One or more industry-recognised certifications or technology badges.If you're passionate about data solutions, eager to lead technical teams, and thrive in a fast-paced, collaborative environment, we encourage you to apply and help us drive data innovation!
#J-18808-Ljbffr