Update README.md
Browse files
README.md
CHANGED
@@ -1,3 +1,85 @@
|
|
1 |
---
|
2 |
license: bsd-3-clause
|
3 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
---
|
2 |
license: bsd-3-clause
|
3 |
+
tags:
|
4 |
+
- Confocal Fluorescence Microscopy
|
5 |
+
- Image Super-resolution
|
6 |
+
- Deep Learning
|
7 |
+
- Benchmark
|
8 |
+
---
|
9 |
+
|
10 |
+
# [SR-CACO-2: A Dataset for Confocal Fluorescence Microscopy Image Super-Resolution](https://arxiv.org/pdf/xxxx.xxxxx.pdf)
|
11 |
+
|
12 |
+
|
13 |
+
by **Soufiane Belharbi<sup>1</sup>, Mara KM Whitford<sup>2,3</sup>,
|
14 |
+
Phuong Hoang<sup>2</sup>, Shakeeb Murtaza<sup>1</sup>, Luke McCaffrey<sup>2,3,4</sup> Eric Granger<sup>1</sup>**
|
15 |
+
|
16 |
+
|
17 |
+
<sup>1</sup> LIVIA, Dept. of Systems Engineering, ETS Montreal, Canada
|
18 |
+
<br/>
|
19 |
+
<sup>2</sup> Goodman Cancer Institute, McGill University, Montreal, Canada
|
20 |
+
<br/>
|
21 |
+
<sup>3</sup> Dept. of Biochemistry, McGill University, Montreal, Canada
|
22 |
+
<br/>
|
23 |
+
<sup>4</sup> Gerald Bronfman Dept. of Oncology, McGill University, Montreal,
|
24 |
+
Canada
|
25 |
+
|
26 |
+
<p align="center"><img src="patch-demo.png" alt="outline" width="80%"></p>
|
27 |
+
|
28 |
+
## ArXiv: [2402.00281](https://arxiv.org/pdf/2402.00281.pdf)
|
29 |
+
|
30 |
+
## Abstract
|
31 |
+
Confocal fluorescence microscopy is one of the most accessible and widely used
|
32 |
+
imaging techniques for the study of biological processes at the cellular and
|
33 |
+
subcellular levels. Scanning confocal microscopy allows the capture of
|
34 |
+
high-quality images from thick three-dimensional (3D) samples, yet suffers from
|
35 |
+
well-known limitations such as photobleaching and phototoxicity of specimens
|
36 |
+
caused by intense light exposure, which limits its use in some applications,
|
37 |
+
especially for living cells. Cellular damage can be alleviated by changing
|
38 |
+
imaging parameters to reduce light exposure, often at the expense of image
|
39 |
+
quality. Machine/deep learning methods for single-image super-resolution (SISR)
|
40 |
+
can be applied to restore image quality by upscaling lower-resolution (LR)
|
41 |
+
images to produce high-resolution images (HR). These SISR methods have been
|
42 |
+
successfully applied to photo-realistic images due partly to the abundance of
|
43 |
+
publicly available data. In contrast, the lack of publicly available data
|
44 |
+
partly limits their application and success in scanning confocal microscopy.
|
45 |
+
In this paper, we introduce a large scanning confocal microscopy dataset named
|
46 |
+
SR-CACO-2 that is comprised of low- and high-resolution image pairs marked for
|
47 |
+
three different fluorescent markers. It allows the evaluation of performance of
|
48 |
+
SISR methods on three different upscaling levels (X2, X4, X8). SR-CACO-2
|
49 |
+
contains the human epithelial cell line Caco-2 (ATCC HTB-37), and it is
|
50 |
+
composed of 22 tiles that have been translated in the form of 9,937 image
|
51 |
+
patches for experiments with SISR methods. Given the new SR-CACO-2 dataset,
|
52 |
+
we also provide benchmarking results for 15 state-of-the-art methods that are
|
53 |
+
representative of the main SISR families. Results show that these methods have
|
54 |
+
limited success in producing high-resolution textures, indicating that SR-CACO-2
|
55 |
+
represents a challenging problem. Our dataset, code and pretrained weights are
|
56 |
+
available: https://github.com/sbelharbi/sr-caco-2.
|
57 |
+
|
58 |
+
**Code: Pytorch 2.0.0**
|
59 |
+
|
60 |
+
## Citation:
|
61 |
+
```
|
62 |
+
@article{belharbi24-sr-caco-2,
|
63 |
+
title={SR-CACO-2: A Dataset for Confocal Fluorescence Microscopy Image Super-Resolution},
|
64 |
+
author={Belharbi, S. and Hoang, P. and Whitford, M. and Murtaza, M. and
|
65 |
+
McCaffrey, L. and Granger, E.},
|
66 |
+
journal={CoRR},
|
67 |
+
volume={abs/xxxx.xxxxx},
|
68 |
+
year={2024}
|
69 |
+
}
|
70 |
+
```
|
71 |
+
|
72 |
+
|
73 |
+
|
74 |
+
## <a name="weights"> Pretrained weights (evaluation) </a>:
|
75 |
+
We provide the weights for all the models (135 models: 15 methods x 3 cells
|
76 |
+
x 3 scales). Weights can be found at [Hugging Face](https://huggingface.co/sbelharbi/sr-caco-2) in the file [shared-trained-models.tar.gz](https://huggingface.co/sbelharbi/sr-caco-2/resolve/main/shared-trained-models.tar.gz?download=true).
|
77 |
+
|
78 |
+
|
79 |
+
The provided weights can be used to reproduce the reported results in the
|
80 |
+
paper in the paper:
|
81 |
+
<p align="center"><img src="roi-perf.png" alt="roi performance"
|
82 |
+
width="80%"></p>
|
83 |
+
<p align="center"><img src="full-img-perf.png" alt="full image performance"
|
84 |
+
width="80%"></p>
|
85 |
+
|