Jeremie Kalfon ๐Ÿ‘จโ€๐Ÿ’ป๐Ÿงฌ๐Ÿค–๐Ÿš€ @jkobject.com ยท Nov 19

-> it is for now a pre-print and more is to come but here are some of our results: scPRINT is a transformer model trained on 50M cells ๐Ÿฆ  from the cellxgene database, it has novel expression encoding and decoding schemes and new pre-training methodologies ๐Ÿค–. www.biorxiv.org/content/10.1...

1 likes 1 replies

?

Replies

Jeremie Kalfon ๐Ÿ‘จโ€๐Ÿ’ป๐Ÿงฌ๐Ÿค–๐Ÿš€ ยท Nov 19

We propose to use the specificity of scRNAseq data and define a multi task pre-training composed of expression denoising, bottleneck learning and classification. We also propose a new hierarchical classification method to work with the rich hierarchical ontologies used to label cells in cellxgene.