1. Introduction
The quest for accurate protein structure prediction has been a cornerstone of molecular biology since 1951, initiated by the pioneering prediction of α-helices as key secondary structural motifs [1]. These early efforts focused primarily on secondary structure prediction by analyzing local interactions between amino acids, setting the stage for the broader field of bioinformatics [2]. As computational technologies advanced, the scope of prediction expanded to include tertiary structures, critical for deciphering protein functions and essential in applications such as drug discovery and functional studies [3].
Despite the progress, traditional prediction methods like homology modeling and threading, which rely on evolutionary conservation and pre-existing structures, often fall short when faced with proteins devoid of clear homologs [4]. In response, the advent of machine learning models such as AlphaFold and RoseTTAFold has marked a significant advancement, offering greater accuracy through the application of deep learning techniques. Furthermore, newer methods like ESMFold are enhancing computational efficiency, making them increasingly viable for large-scale applications, as noted in recent studies.
This paper provides a comprehensive review of the current methodologies employed in protein structure prediction, emphasizing the strengths and limitations of both traditional and contemporary approaches. It offers a detailed comparative analysis of the performance of machine learning models like AlphaFold and RoseTTAFold against traditional methods, and it explores emerging models such as ESMFold which prioritize computational efficiency. The paper aims to address the ongoing challenges within the field, exploring how each method contributes to our understanding and prediction of complex protein structures [5]. Through this analysis, it aims to shed light on future research directions that could potentially overcome existing barriers and enhance the accuracy and applicability of protein structure prediction techniques.
2. Overview of Typical Methods
2.1. Traditional methods
Since its inception in 1951, when the key secondary structures like α-helices were first elucidated through hydrogen-bonding patterns analysis, the field of protein structure prediction has seen profound advancements (Sixty-five years) [6]. Initially, the focus was on predicting secondary structures such as α-helices and β-sheets by pinpointing local interactions among amino acids. As the field progressed, it evolved from basic secondary structure prediction to more sophisticated techniques that accurately forecast complete tertiary (3D) structures [7]. The importance of these 3D predictions lies in the fact that a protein’s function is primarily determined by its three-dimensional shape. Thus, the accurate prediction of 3D structures has emerged as a pivotal challenge in biology (Improved protein structure prediction using potentials from deep learning) [8].
A significant breakthrough in this domain was the advent of homology modeling, a technique that predicts the 3D structure of proteins based on evolutionary conservation (AI-Driven Deep Learning Techniques in Protein Structure Prediction) [9]. This method uses existing protein structures as templates to generate predictions when a suitable homolog is available. However, the method shows its limitations when there is low sequence identity between the target and the template, which reduces its effectiveness for novel or significantly divergent proteins. Despite its drawbacks, homology modeling remains a crucial technique for connecting sequence data with protein structures.
To overcome these challenges, threading methods were introduced. These methods predict a protein’s structure by aligning its sequence with known structural folds, even when there is scant sequence similarity [10]. Threading is particularly advantageous for identifying structural resemblances in distant homologs. An evaluation on 21 target proteins revealed that threading accurately identified the correct fold in 44% of the cases. For common structures like the TIM barrel, the success rate was even higher, suggesting that threading is particularly effective for frequently occurring folds [11]. Nonetheless, the quality of sequence-structure alignments often falls short, with predicted alignments typically matching only a portion of residues when compared to experimental structures. This inconsistency, coupled with the dependency on existing fold libraries, can limit the effectiveness of threading if the correct fold is absent from the library.
Ab initio methods represent a shift from both homology modeling and threading as they do not depend on templates or known folds. Instead, these methods predict protein structures solely based on the amino acids' physical and chemical properties [12]. Unlike the other methods, ab initio approaches model the entire folding process from first principles. Early iterations of ab initio methods could generate low-resolution structures for smaller proteins, typically those under 100 amino acids. However, larger proteins presented significant challenges due to the immense conformational space that needed exploration. For instance, results from CASP4 indicated that predictions for small proteins reached a root mean square deviation (RMSD) of 6 Å from the actual structures, but the results were far less precise for larger proteins [13]. Although advancements in energy functions and search algorithms like Monte Carlo simulations have improved accuracy, achieving RMSD reductions to 4-6 Å for certain fragments, ab initio methods remain computationally intensive and less effective for larger proteins or extensive sequences.
2.2. Machine learning-based methods
The integration of machine learning and deep learning techniques has significantly advanced the accuracy and efficiency of protein structure prediction. Traditional methods like homology modeling and threading, which rely on evolutionary information or template structures, often face limitations when predicting novel or complex proteins. In contrast, machine learning-based models have drastically improved predictions by learning from extensive datasets and applying insights directly to sequence-based structure prediction. AlphaFold, RoseTTAFold, and ESMFold have emerged as transformative tools in this field, each offering unique strengths.
AlphaFold, developed by DeepMind, marked a major breakthrough at the CASP13 competition by generating high-accuracy structures for a significant portion of the free modeling domains. Utilizing multi-sequence alignments combined with transformer neural networks, AlphaFold excels in capturing complex relationships within protein sequences, significantly enhancing prediction accuracy, especially for proteins with limited homologous sequences. Despite its success, AlphaFold does encounter challenges in predicting the structure of membrane proteins, regions with high conformational flexibility, and proteins with multiple conformers.
RoseTTAFold, developed by the Baker Lab, employs a unique three-track architecture that processes protein sequences, residue distances, and structural coordinates simultaneously, improving the accuracy of its predictions. It has shown particular success in predicting protein–nucleic acid complexes, outperforming traditional docking methods and demonstrating effectiveness in modeling challenging nucleic acid interactions. RoseTTAFold's ability to model both protein monomers and complexes makes it a versatile tool for applications including drug design and functional analysis.
ESMFold, developed by Meta AI, is a novel approach to protein structure prediction that leverages a transformer-based architecture to predict structures based solely on single-sequence data. This innovation significantly reduces computational demands and increases processing speed, making ESMFold suitable for high-throughput studies. ESMFold achieves competitive accuracy and its application in the ESM Metagenomic Atlas, predicting over 617 million protein structures, demonstrates its scalability, especially in metagenomics where many proteins lack close homologs. Focusing on single-sequence inputs and eliminating the need for evolutionary data, ESMFold offers a powerful solution for rapid structure prediction in domains where speed and scalability are essential.
3. Comparative Analysis
This section compares the advantages and disadvantages of traditional methods, such as homology modeling and threading, with machine learning-based methods like AlphaFold and RoseTTAFold, and emerging methods like ESMFold. It includes key differences and real-world examples to illustrate the performance of each method.
Protein structure prediction models are evaluated using several key metrics in the Critical Assessment of protein Structure Prediction (CASP), a biennial competition. One primary metric is Root Mean Square Deviation (RMSD), which measures the average distance between atoms in the predicted and reference structures. Lower RMSD values indicate higher accuracy, with sub-angstrom accuracy considered excellent.
In addition to RMSD, the Template Modeling Score (TM-score) is used to assess the overall topological similarity between predicted and experimental structures, with values closer to 1.0 indicating better structural predictions. The Local Distance Difference Test (lDDT) focuses on local residue pair distances, providing a more granular measure of accuracy. The accuracy of protein structure prediction methods varies depending on their approach. Traditional methods such as homology modeling and threading perform reliably when there is high sequence similarity between the target protein and available templates, but their accuracy declines significantly for novel or highly divergent proteins. In contrast, machine learning-based models like AlphaFold have greatly improved accuracy across a wide range of protein structures, achieving an RMSD of 0.96 Å in CASP14, making them far more effective for novel proteins that lack homologous templates. RoseTTAFold, although slightly less precise for monomeric proteins, surpasses traditional methods in handling complex multimeric assemblies, achieving higher lDDT scores in protein-protein and protein-nucleic acid interactions. On the other hand, emerging methods like ESMFold provide competitive performance with a TM-score of 0.83, and while it is not as precise as AlphaFold for complex interactions, its scalability makes it well-suited for large-scale studies where throughput is more important than fine structural accuracy.
3.1. Computational efficiency
In terms of computational efficiency, traditional methods such as homology modeling and threading are fast and efficient when templates or known folds are available but are less scalable for novel proteins. Machine learning-based methods like AlphaFold and RoseTTAFold are significantly more resource-intensive, requiring multiple sequence alignments and deep learning architectures, which result in longer processing times that can range from minutes to hours depending on protein size. ESMFold, an emerging method, distinguishes itself through its computational efficiency by utilizing a transformer-based architecture, allowing it to generate predictions up to 60 times faster than AlphaFold. This efficiency is particularly beneficial for large-scale studies such as the ESM Metagenomic Atlas, where speed and scalability are prioritized over achieving the highest possible accuracy. Protein structure prediction methods have had a substantial impact on various fields, especially in drug discovery and therapeutic development. Each approach—traditional, machine learning-based, and emerging methods—has unique strengths and limitations that influence their practical application..
4. Drug Design and Therapeutic Development
Traditional methods such as homology modeling and threading have been foundational in drug discovery, particularly for well-characterized targets. For instance, homology modeling has been crucial in predicting the structure of enzymes like cytochrome P450, vital for understanding drug metabolism. These methods allow for the modeling of active sites and predicting drug-protein interactions by leveraging structural templates. However, their effectiveness is limited in cases where the target protein is novel or lacks homologous templates due to their reliance on sequence similarity.
Machine learning models like AlphaFold and RoseTTAFold have dramatically improved the accuracy of protein structure prediction, proving essential in therapeutic development. For example, AlphaFold's role during the COVID-19 pandemic in accurately predicting the structure of SARS-CoV-2 proteins highlighted its utility in fast-tracking drug design and vaccine development. Similarly, RoseTTAFold has shown its value in modeling multimeric protein complexes, crucial for understanding protein-protein interactions and developing antibody-based therapies.
In large-scale applications, emerging methods like ESMFold offer a faster alternative for predicting protein structures in high-throughput studies, though they may sacrifice some accuracy compared to AlphaFold. ESMFold’s scalability is particularly beneficial for exploratory research and handling large datasets, such as in metagenomics. The practical utility of each method depends on specific research goals. Traditional methods remain valuable for early-stage drug discovery when templates are available for well-characterized targets like enzymes. Meanwhile, machine learning models have become indispensable in therapeutic development, providing highly accurate structural models that enhance the design of targeted therapies. Emerging methods, while sometimes less precise, excel in high-throughput applications and are particularly advantageous in large-scale projects such as proteome-wide studies and metagenomics.
5. Future Application Scenarios
The future of protein structure prediction is poised for significant advances across various application scenarios, reflecting a growing convergence between computational techniques and experimental methods. As prediction models evolve, there is potential for these tools to become more integrated with experimental approaches like cryo-electron microscopy and X-ray crystallography. Such integration could lead to more dynamic models that adjust predictions based on real-time experimental feedback, thereby increasing accuracy and reliability. In terms of model development, we can anticipate enhancements that focus on the incorporation of machine learning algorithms that can handle increasingly complex datasets, including those with less common protein structures. These advancements will likely involve more sophisticated handling of non-standard amino acids and post-translational modifications, which are critical for understanding complex biological functions. Real-world applications of these enhanced prediction models extend beyond traditional academic and medical research settings into biotechnology and pharmaceutical industries. Here, improved prediction tools could significantly accelerate drug discovery processes by providing rapid insights into protein targets, facilitating the development of more effective therapeutic agents. Furthermore, these models could be used in agricultural sciences to engineer crops with improved traits or in environmental science to design proteins capable of breaking down pollutants. Each of these applications not only showcases the versatility of protein structure prediction models but also underscores their potential to contribute to wide-ranging societal and environmental benefits.
6. Challenges
Despite significant advancements, protein structure prediction methods continue to face several challenges. A major issue is their reliance on existing data, particularly for traditional methods like homology modeling and threading, which perform well only when there is high sequence similarity to known proteins. For novel or divergent proteins, these methods struggle due to a lack of suitable templates. Even machine learning-based models like AlphaFold and RoseTTAFold, while highly accurate, face limitations when predicting membrane proteins and proteins with high conformational flexibility. These proteins are difficult to model with static 3D structures, and the computational demands of these methods, especially their reliance on multiple sequence alignments, make them time-consuming and resource-intensive. Emerging methods like ESMFold, which forgo multiple sequence alignments in favor of single-sequence inputs, offer greater computational efficiency but at the cost of lower accuracy in predicting multimeric protein complexes and protein-protein interactions. Across all methods, the challenge of accurately predicting membrane proteins, protein interactions, and scaling efficiently for large datasets remains a persistent issue, necessitating a balance between speed, accuracy, and computational resources.
7. Conclusion
This paper has thoroughly examined the landscape of protein structure prediction, elucidating the distinct capabilities and limitations of traditional methods, machine learning models, and emerging computational techniques. Traditional approaches such as homology modeling and threading continue to be indispensable for well-characterized proteins, although they fall short when applied to novel proteins lacking similar templates. Conversely, machine learning models like AlphaFold and RoseTTAFold have significantly shifted the paradigm, providing high accuracy predictions across a diverse array of protein structures, despite facing challenges with computationally intensive demands and difficulties with membrane proteins and dynamically varied regions. Emerging methods, particularly ESMFold, strike an effective balance, offering improved computational efficiency and scalability, suitable for extensive applications, though sometimes at the expense of some precision.
The primary challenge remains to achieve an optimal balance among speed, accuracy, and scalability in protein structure prediction, especially as the complexity of datasets and the structural diversity of proteins continue to expand. Future research should focus on enhancing the integration of evolutionary information to refine accuracy further and expanding computational efficiency to handle larger datasets more effectively. Additionally, improving the modeling capabilities for flexible and multimeric proteins could potentially advance our understanding of protein dynamics and interactions. Continued innovation and adaptation in these areas are crucial as they will likely define the next wave of breakthroughs in structural biology, enabling more precise and rapid discoveries in drug development, molecular genetics, and beyond.
References
[1]. Altman R. B. A Holy Grail — The Prediction of Protein Structure. In the New England Journal of Medicine, 2023, 389(15): 1431–1434.
[2]. Kryshtafovych A., Schwede T., Topf M., Fidelis K., Moult J. Critical assessment of methods of protein structure prediction (CASP)—Round XV. In Proteins: Structure, Function, and Bioinformatics, 2023, 91(12): 1539–1549.
[3]. Bertoline L. M. F., Lima A. N., Krieger J. E., Teixeira S. K. Before and after AlphaFold2: An overview of protein structure prediction. In Frontiers in Bioinformatics, 2023, 3.
[4]. Bowie J., Luthy R., Eisenberg D. A method to identify protein sequences that fold into a known three-dimensional structure. In Science, 1991, 253(5016): 164–170. https://doi.org/10.1126/science. 1853201.
[5]. Zhu, X., Huang, Y., Wang, X., & Wang, R. (2023). Emotion recognition based on brain-like multimodal hierarchical perception.Multimedia Tools and Applications, 1-19.
[6]. Floudas C. A. Computational methods in protein structure prediction. In Biotechnology and Bioengineering, 2007, 97(2): 207–213.
[7]. Wang R., Zhu J., Wang S., Wang T., Huang J., Zhu X. Multi-modal emotion recognition using tensor decomposition fusion and self-supervised multi-tasking. International Journal of Multimedia Information Retrieval, 2024, 13(4): 39.
[8]. Jumper J., Evans R., Pritzel A., Green T., Figurnov M., Ronneberger O., Tunyasuvunakool K., Bates R., Žídek A., Potapenko A., Bridgland A., Meyer C., Kohl S. A. A., Ballard A. J., Cowie A., Romera-Paredes B., Nikolov S., Jain R., Adler J., Back T. Highly accurate protein structure prediction with AlphaFold. In Nature, 2021, 596(7873): 583–589.
[9]. Lemer C. M.-R., Rooman M. J., Wodak S. J. Protein structure prediction by threading methods: Evaluation of current techniques. In Proteins: Structure, Function, and Genetics, 1995, 23(3): 337–355.
[10]. Senior A. W., Evans R., Jumper J., Kirkpatrick J., Sifre L., Green T., Qin C., Žídek A., Nelson A. W. R., Bridgland A., Penedones H., Petersen S., Simonyan K., Crossan S., Kohli P., Jones D. T., Silver D., Kavukcuoglu K., Hassabis D. Improved Protein Structure Prediction Using Potentials from Deep Learning. In Nature, 2020, 577(7792): 706–710.
[11]. Tunyasuvunakool K. The prospects and opportunities of protein structure prediction with AI. In Nature Reviews Molecular Cell Biology, 2022.
[12]. Verkuil R., Kabeli O., Du Y., Basile, Milles L. F., Dauparas J., Baker D., Ovchinnikov S. G., Sercu T., Rives A. Language models generalize beyond natural proteins. In BioRxiv (Cold Spring Harbor Laboratory), 2022.
[13]. Yang Y., Gao J., Wang J., Heffernan R., Hanson J., Paliwal K., Zhou Y. Sixty-five years of the long march in protein secondary structure prediction: the final stretch? In Briefings in Bioinformatics, 2016, bbw129.
[14]. Yuan X., Shao Y., Bystroff C. Ab Initio Protein Structure Prediction Using Pathway Models. In Comparative and Functional Genomics, 2003, 4(4): 397–401.
Cite this article
Wang,Y. (2024). Advancements in Protein Structure Prediction: Novel Bioinformatics Algorithms and Applications. Theoretical and Natural Science,71,32-37.
Data availability
The datasets used and/or analyzed during the current study will be available from the authors upon reasonable request.
Disclaimer/Publisher's Note
The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of EWA Publishing and/or the editor(s). EWA Publishing and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.
About volume
Volume title: Proceedings of ICBioMed 2024 Workshop: Computational Proteomics in Drug Discovery and Development from Medicinal Plants
© 2024 by the author(s). Licensee EWA Publishing, Oxford, UK. This article is an open access article distributed under the terms and
conditions of the Creative Commons Attribution (CC BY) license. Authors who
publish this series agree to the following terms:
1. Authors retain copyright and grant the series right of first publication with the work simultaneously licensed under a Creative Commons
Attribution License that allows others to share the work with an acknowledgment of the work's authorship and initial publication in this
series.
2. Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the series's published
version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgment of its initial
publication in this series.
3. Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and
during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See
Open access policy for details).
References
[1]. Altman R. B. A Holy Grail — The Prediction of Protein Structure. In the New England Journal of Medicine, 2023, 389(15): 1431–1434.
[2]. Kryshtafovych A., Schwede T., Topf M., Fidelis K., Moult J. Critical assessment of methods of protein structure prediction (CASP)—Round XV. In Proteins: Structure, Function, and Bioinformatics, 2023, 91(12): 1539–1549.
[3]. Bertoline L. M. F., Lima A. N., Krieger J. E., Teixeira S. K. Before and after AlphaFold2: An overview of protein structure prediction. In Frontiers in Bioinformatics, 2023, 3.
[4]. Bowie J., Luthy R., Eisenberg D. A method to identify protein sequences that fold into a known three-dimensional structure. In Science, 1991, 253(5016): 164–170. https://doi.org/10.1126/science. 1853201.
[5]. Zhu, X., Huang, Y., Wang, X., & Wang, R. (2023). Emotion recognition based on brain-like multimodal hierarchical perception.Multimedia Tools and Applications, 1-19.
[6]. Floudas C. A. Computational methods in protein structure prediction. In Biotechnology and Bioengineering, 2007, 97(2): 207–213.
[7]. Wang R., Zhu J., Wang S., Wang T., Huang J., Zhu X. Multi-modal emotion recognition using tensor decomposition fusion and self-supervised multi-tasking. International Journal of Multimedia Information Retrieval, 2024, 13(4): 39.
[8]. Jumper J., Evans R., Pritzel A., Green T., Figurnov M., Ronneberger O., Tunyasuvunakool K., Bates R., Žídek A., Potapenko A., Bridgland A., Meyer C., Kohl S. A. A., Ballard A. J., Cowie A., Romera-Paredes B., Nikolov S., Jain R., Adler J., Back T. Highly accurate protein structure prediction with AlphaFold. In Nature, 2021, 596(7873): 583–589.
[9]. Lemer C. M.-R., Rooman M. J., Wodak S. J. Protein structure prediction by threading methods: Evaluation of current techniques. In Proteins: Structure, Function, and Genetics, 1995, 23(3): 337–355.
[10]. Senior A. W., Evans R., Jumper J., Kirkpatrick J., Sifre L., Green T., Qin C., Žídek A., Nelson A. W. R., Bridgland A., Penedones H., Petersen S., Simonyan K., Crossan S., Kohli P., Jones D. T., Silver D., Kavukcuoglu K., Hassabis D. Improved Protein Structure Prediction Using Potentials from Deep Learning. In Nature, 2020, 577(7792): 706–710.
[11]. Tunyasuvunakool K. The prospects and opportunities of protein structure prediction with AI. In Nature Reviews Molecular Cell Biology, 2022.
[12]. Verkuil R., Kabeli O., Du Y., Basile, Milles L. F., Dauparas J., Baker D., Ovchinnikov S. G., Sercu T., Rives A. Language models generalize beyond natural proteins. In BioRxiv (Cold Spring Harbor Laboratory), 2022.
[13]. Yang Y., Gao J., Wang J., Heffernan R., Hanson J., Paliwal K., Zhou Y. Sixty-five years of the long march in protein secondary structure prediction: the final stretch? In Briefings in Bioinformatics, 2016, bbw129.
[14]. Yuan X., Shao Y., Bystroff C. Ab Initio Protein Structure Prediction Using Pathway Models. In Comparative and Functional Genomics, 2003, 4(4): 397–401.