📢 📃 Finetuning masking challenges narrow-task evaluation of cell foundation models
shorturl.at/dcz3l
We tested foundation model architectures across extreme reductions in pretraining scale. We found that standard narrow tasks were insensitive to pretraining scale, up tp 128-fold reduction!
Single-cell foundation models are large, self-supervised deep learning networks pretrained on millions of cellular transcriptomes. These models promise to deliver cell representations that are transfe...
