CodonBERT large language model for mRNA vaccines.
Genome Res
; 34(7): 1027-1035, 2024 Aug 20.
Article
in En
| MEDLINE
| ID: mdl-38951026
ABSTRACT
mRNA-based vaccines and therapeutics are gaining popularity and usage across a wide range of conditions. One of the critical issues when designing such mRNAs is sequence optimization. Even small proteins or peptides can be encoded by an enormously large number of mRNAs. The actual mRNA sequence can have a large impact on several properties, including expression, stability, immunogenicity, and more. To enable the selection of an optimal sequence, we developed CodonBERT, a large language model (LLM) for mRNAs. Unlike prior models, CodonBERT uses codons as inputs, which enables it to learn better representations. CodonBERT was trained using more than 10 million mRNA sequences from a diverse set of organisms. The resulting model captures important biological concepts. CodonBERT can also be extended to perform prediction tasks for various mRNA properties. CodonBERT outperforms previous mRNA prediction methods, including on a new flu vaccine data set.
Full text:
1
Collection:
01-internacional
Database:
MEDLINE
Main subject:
RNA, Messenger
/
MRNA Vaccines
Limits:
Humans
Language:
En
Journal:
Genome Res
Journal subject:
BIOLOGIA MOLECULAR
/
GENETICA
Year:
2024
Document type:
Article
Affiliation country:
United States