We are seeking a highly skilled and experienced Senior Data Engineer to join our team. The Senior Data Engineer will play a critical role in designing, building, and maintaining robust data infrastructure and pipelines to support our trading strategies and operations. The ideal candidate will have a strong background in Python programming, experience with Apache Airflow for workflow orchestration, and proficiency in SQL for data manipulation and querying.
The Role:
Build, design and develop Tibra's data pipelines, to support real-time trading systems and analytics.
Collaborate with quantitative researchers, traders, and developers to understand data requirements and implement efficient solutions.
Evolve Tibra's data models and pipeline and systems architecture.
Perform and automate day-to-day data operations (DataOps).
Troubleshoot data issues and maintain reliability across our data assets.
Trial and onboard new datasets.
Ensure data quality and data availability for all our trading teams.
Implement data quality checks and monitoring to ensure the integrity and accuracy of data.
Create technical documentation related to system configuration and operation.
Lead projects, provide technical guidance and mentor junior engineers.
Stay current with industry trends and emerging technologies in data engineering and financial markets.
Requirements:
Bachelor's degree or higher in Computer Science, Engineering, Mathematics, or related field.
Proven experience as a Senior Data Engineer or similar role, preferably in the financial services industry.
Expertise in Python programming and software development best practices as well as the data processing stack in Python (pandas, numpy, polars, pyspark, matplotlib, etc.).
Strong proficiency in SQL and relational databases (e.g., PostgreSQL, MySQL).
Hands-on experience with containerised applications (Kubernetes, Helm, Docker) and monitoring (Grafana & Prometheus).
Experience with distributed computing frameworks such as Spark, Dask, Ray, or HTCondor.
Hands-on experience with Apache Airflow, Dagster, or similar workflow orchestration tools.
Understanding of Infrastructure as Code (Terraform, Chef, Ansible).
Solid understanding of data modelling and data warehousing concepts.
Experienced technologist with experience in business analysis, coding, architecture, and design.
Strong communication and collaboration skills.
Nice to have experience or exposure to the following technologies:
A job orchestration framework such as AWS Step Functions or Azure Data Factory.
Time-series databases.
Benefits:
Market-leading merit-based bonus scheme.
Breakfast, lunch, and snacks provided daily.
Fun company activities.
Massages and personal training sessions.
Life insurance cover.
Generous leave allowance.
Opportunity to benefit from in-house and external training courses.
Opportunity to travel.
Work with smart, passionate, and driven people.
Exposure to global financial markets.
If this sounds like you, we'd love to hear from you! Please apply now.
As you submit your application, please consider:
You must have, or be eligible to obtain, legal working rights in Australia.
Before joining Tibra, you will be required to pass a criminal history check.
Tibra is an Equal Employment Opportunity Employer.
#J-18808-Ljbffr
