Show simple item record

dc.contributor.authorPang, Minxing
dc.contributor.authorTegner, Jesper
dc.date.accessioned2020-12-09T13:28:51Z
dc.date.available2020-12-09T13:28:51Z
dc.date.issued2020-02-06
dc.identifier.citationPang, M., & Tegnér, J. (2020). Multitask learning for Transformers with application to large-scale single-cell transcriptomes. doi:10.1101/2020.02.05.935239
dc.identifier.doi10.1101/2020.02.05.935239
dc.identifier.urihttp://hdl.handle.net/10754/666320
dc.description.abstractAbstractRecent progress in machine learning provides competitive methods for bioinformatics in many traditional topics, such as transcriptomes sequence and single-cell analysis. However, discovering biomedical correlation of cells that are present across large-scale data sets remains challenging. Our attention-based neural network module with 300 million parameters is able to capture biological knowledge in a data-driven way. The module contains high-quality embedding, taxonomy analysis and similarity measurement. We tested the model on Mouse Brain Atlas, which consists of 160,000 cells and 25,000 genes. Our module obtained some interesting findings that have been verified by biologists and got better performance when benchmarked against autoencoder and principal components analysis.
dc.publisherCold Spring Harbor Laboratory
dc.relation.urlhttp://biorxiv.org/lookup/doi/10.1101/2020.02.05.935239
dc.rights.urihttp://creativecommons.org/licenses/by-nc-nd/4.0/
dc.titleMultitask learning for Transformers with application to large-scale single-cell transcriptomes
dc.typePreprint
dc.contributor.departmentBiological and Environmental Sciences and Engineering (BESE) Division
dc.contributor.departmentBioscience Program
dc.eprint.versionPre-print
dc.contributor.institutionNankai University.
dc.contributor.institutionKarolinska Institutet.
kaust.personTegner, Jesper
refterms.dateFOA2020-12-09T13:29:41Z


Files in this item

Thumbnail
Name:
multitask learning.pdf
Size:
6.515Mb
Format:
PDF
Description:
pre print

This item appears in the following Collection(s)

Show simple item record

http://creativecommons.org/licenses/by-nc-nd/4.0/
Except where otherwise noted, this item's license is described as http://creativecommons.org/licenses/by-nc-nd/4.0/