RiNALMo: general-purpose RNA language models can generalize well on structure prediction tasks

Page view(s)
0
Checked on
RiNALMo: general-purpose RNA language models can generalize well on structure prediction tasks
Title:
RiNALMo: general-purpose RNA language models can generalize well on structure prediction tasks
Journal Title:
Nature Communications
Publication Date:
01 July 2025
Citation:
Penić, R. J., Vlašić, T., Huber, R. G., Wan, Y., & Šikić, M. (2025). RiNALMo: general-purpose RNA language models can generalize well on structure prediction tasks. Nature Communications, 16(1). https://doi.org/10.1038/s41467-025-60872-5
Abstract:
While RNA has recently been recognized as an interesting small-molecule drug target, many challenges remain to be addressed before we take full advantage of it. This emphasizes the necessity to improve our understanding of its structures and functions. Over the years, sequencing technologies have produced an enormous amount of unlabeled RNA data, which hides a huge potential. Motivated by the successes of protein language models, we intro duce RiboNucleic Acid Language Model (RiNALMo) to unveil the hidden code of RNA. RiNALMo is the largest RNA language model to date, with 650M parameters pre-trained on 36M non-coding RNA sequences from several databases. It can extract hidden knowledge and capture the underlying structure information implicitly embedded within the RNA sequences. RiNALMo achieves state-of-the-art results on several downstream tasks. Notably, we show that its generalization capabilities overcome the inability of other deep learning methods for secondary structure prediction to generalize on unseen RNA families.
License type:
Attribution-NonCommercial-NoDerivatives 4.0 International (CC BY-NC-ND 4.0)
Funding Info:
This work was supported by the National Research Foundation (NRF) Competitive Research Programme (CRP) under Project Identifying Functional RNA Tertiary Structures in Dengue Virus

This work was supported by the A*STAR under Grant GAP2: A*STAR RNA-Foundation Model - A*STARRNA-FM
Description:
ISSN:
2041-1723
Files uploaded: