The current landscape and emerging challenges of benchmarking single-cell methods

I tiakina i:
Ngā taipitopito rārangi puna kōrero
I whakaputaina i:bioRxiv (Jan 31, 2025)
Kaituhi matua: Yang, Jean Yee Hwa
Ētahi atu kaituhi: Cao, Yue, Yu, Lijia, Torkel, Marni, Kim, Sanghyun, Lin, Yingxin, Yang, Pengyi, Speed, Terence P, Ghazanfar, Shila
I whakaputaina:
Cold Spring Harbor Laboratory Press
Urunga tuihono:Citation/Abstract
Full text outside of ProQuest
Ngā Tūtohu: Tāpirihia he Tūtohu
Kāore He Tūtohu, Me noho koe te mea tuatahi ki te tūtohu i tēnei pūkete!

MARC

LEADER 00000nab a2200000uu 4500
001 2903725285
003 UK-CbPIL
022 |a 2692-8205 
024 7 |a 10.1101/2023.12.19.572303  |2 doi 
035 |a 2903725285 
045 0 |b d20250131 
100 1 |a Yang, Jean Yee Hwa 
245 1 |a The current landscape and emerging challenges of benchmarking single-cell methods 
260 |b Cold Spring Harbor Laboratory Press  |c Jan 31, 2025 
513 |a Working Paper 
520 3 |a With the rapid development of computational methods for single-cell sequencing data, benchmarking serves as a valuable resource. As the number of benchmarking studies surges, it is timely to assess the current state of the field. We conducted a systematic literature search and assessed 282 papers, including all 130 benchmark-only papers from the search and an additional 152 method development papers containing benchmarking. This collective effort provides the most comprehensive quantitative summary of the current landscape of single-cell benchmarking studies. We examine performances across nine broad categories, including often ignored aspects such as role of datasets, robustness of methods and downstream evaluation. Our analysis highlights challenges such as how to effectively combine knowledge across multiple benchmarking studies and in what ways can the community recognise the risk and prevent benchmarking fatigue. This paper highlights the importance of adopting a community-led research paradigm to tackle these challenges and establish best practice standards.Competing Interest StatementThe authors have declared no competing interest.Footnotes* Updated the collection of papers to 282 
700 1 |a Cao, Yue 
700 1 |a Yu, Lijia 
700 1 |a Torkel, Marni 
700 1 |a Kim, Sanghyun 
700 1 |a Lin, Yingxin 
700 1 |a Yang, Pengyi 
700 1 |a Speed, Terence P 
700 1 |a Ghazanfar, Shila 
773 0 |t bioRxiv  |g (Jan 31, 2025) 
786 0 |d ProQuest  |t Biological Science Database 
856 4 1 |3 Citation/Abstract  |u https://www.proquest.com/docview/2903725285/abstract/embedded/BH75TPHOCCPB476R?source=fedsrch 
856 4 0 |3 Full text outside of ProQuest  |u https://www.biorxiv.org/content/10.1101/2023.12.19.572303v2