Nellie: Automated organelle segmentation, tracking, and hierarchical feature extraction in 2D/3D live-cell microscopy
<|reference_start|>Nellie: Automated organelle segmentation, tracking, and hierarchical feature extraction in 2D/3D live-cell microscopy: The analysis of dynamic organelles remains a formidable challenge, though key to understanding biological processes. We introduce Nellie, an automated and unbiased pipeline for segmentation, tracking, and feature extraction of diverse intracellular structures. Nellie adapts to image metadata, eliminating user input. Nellie's preprocessing pipeline enhances structural contrast on multiple intracellular scales allowing for robust hierarchical segmentation of sub-organellar regions. Internal motion capture markers are generated and tracked via a radius-adaptive pattern matching scheme, and used as guides for sub-voxel flow interpolation. Nellie extracts a plethora of features at multiple hierarchical levels for deep and customizable analysis. Nellie features a Napari-based GUI that allows for code-free operation and visualization, while its modular open-source codebase invites customization by experienced users. We demonstrate Nellie's wide variety of use cases with two examples: unmixing multiple organelles from a single channel using feature-based classification and training an unsupervised graph autoencoder on mitochondrial multi-mesh graphs to quantify latent space embedding changes following ionomycin treatment.<|reference_end|>
@article{lefebvre2024nellie:,
    title={Nellie: Automated organelle segmentation, tracking, and hierarchical
  feature extraction in 2D/3D live-cell microscopy},
    author={Austin E. Y. T. Lefebvre (1), Gabriel Sturm (1 and 2), Ting-Yu Lin
  (1), Emily Stoops (1), Magdalena Preciado Lopez (1), Benjamin Kaufmann-Malaga
  (1), Kayley Hake (1) ((1) Calico Life Sciences LLC, (2) Department of
  Biochemistry and Biophysics, University of California San Francisco)},
    journal={arXiv preprint arXiv:2403.13214},
    year={2024},
    archivePrefix={arXiv},
    eprint={2403.13214},
    primaryClass={cs.CV cs.AI cs.LG q-bio.QM}
}