-

Building Foundation Models for 3D Microscopy

Project type

  • PhD
  • Masters by Coursework
  • Honours

Project details

WEHI’s imaging facilities have built a 2–3 petabyte microscopy archive, including 3D data from confocal, light-sheet and lattice light-sheet microscopy. Foundation models are transforming image analysis, but progress has been largely 2D, as large 3D collections are rarely available for training. Making it AI-ready is an ongoing effort, with several ways to contribute:

  • Curating datasets, pretraining or benchmarking foundation models
  • Exploring whether models trained across the archive generalise across instruments and modalities, including generative models to augment scarce annotations
  • Profiling the archive and extending our metadata framework (REMBI, RO-Crate), including LLM-assisted extraction from proprietary formats
  • Reusing archived data to answer new biological questions
    Students will develop skills in large-scale data engineering, machine learning and scientific data standards. Python experience expected, microscopy experience not required.

This project is open to students in the Medical Student Research Internship program.

 

About our research group

The Bioimage Analysis Core (BAC) is based at WEHI’s Centre for Dynamic Imaging (CDI).

Working alongside the microscopists at CDI, our group collaborates with researchers to develop bioimage analysis solutions to draw insight from their complex microscopy data across diverse research areas.

We are a multidisciplinary team of physicists, biologists, engineers and bioinformaticians with a strong focus on methodology development.

Education pathways