Download pdf
Multimodal fake news detection using graph neural networks and attention mechanisms
- 1 Jilin University
* Author to whom correspondence should be addressed.
Abstract
The rapid spread of fake news across digital platforms poses a significant challenge to societies, leading to a growing demand for robust detection mechanisms. Traditional fake news detection methods often rely on unimodal data, such as textual content, limiting their effectiveness in addressing the complex, and multimodal nature of fake news. This paper introduces a Multimodal Fake News Detector (MFND) that integrates textual, visual, and social context features to enhance detection accuracy. This makes classification tasks more accurate and reliable. The MFND was evaluated using the FakeNewsNet and Sina Weibo datasets, achieving high accuracy and outperforming existing models. The experimental results highlight the importance of multimodal fusion and attention-based weighting mechanisms in improving detection performance, particularly in complex social media environments. This research demonstrates the potential of multimodal approaches for more accurate and reliable fake news detection.
Keywords
fake news detection, multimodal analysis, graph neural networks (GNN), attention mechanisms, deep learning, social media analysis, feature fusion
[1]. Gupta, S., Gupta, B. B., & Chaudhary, P. (2018). Hunting for DOM-based XSS vulnerabilities in mobile cloud-based online social network. Proceedings of the IEEE International Conference on Cyber Security and Cloud Computing, 319-336.
[2]. Kumari, R., Jain, A. K., Krishnamurthi, S., Kumar, M., & Gupta, A. (2021). AMFB: Attention based multimodal factorized bilinear pooling for multimodal fake news detection. Proceedings of the IEEE International Conference on Artificial Intelligence and Applications, 1-12.
[3]. Meel, P., & Vishwakarma, P. (2021). A temporal ensembling based semi-supervised ConvNet for the detection of fake news articles. Proceedings of the IEEE International Conference on Machine Learning and Data Mining, 15-29.
[4]. Meel, P., & Vishwakarma, P. (2021). HAN, image captioning, and forensics ensemble multimodal fake news detection. Proceedings of the IEEE International Conference on Neural Networks and Computational Intelligence, 215-232.
[5]. Song, C., Huang, Y., Ouyang, W., Ni, F., & Luo, X. (2021). Knowledge augmented transformer for adversarial multidomain multiclassification multimodal fake news detection. Proceedings of the IEEE International Conference on Computational Intelligence and Virtual Environments for Measurement Systems and Applications, 48-59.
[6]. Bodaghi, A., Samiei, A., & Ziglari, A. N. (2022). The theater of fake news spreading, who plays which role? A study on real graphs of spreading on Twitter. Proceedings of the IEEE International Conference on Social Media and Cloud Computing, 150-165.
[7]. Davoudi, M., Hacid, H., Shidpour, A. Z., & Poncelet, P. (2022). DSS: A hybrid deep model for fake news detection using propagation tree and stance network. Proceedings of the IEEE International Conference on Big Data and Smart Computing, 134-145.
[8]. Nan, Q., Cao, J., Zhu, Y., Wang, Y., & Li, J. (2021). MDFEND: Multi-domain Fake News Detection. Proceedings of the 30th ACM International Conference on Information & Knowledge Management (CIKM), 3343-3347.
[9]. Volkova, S., Shaffer, K., Jang, J. Y., & Hodas, N. (2017). Separating facts from fiction: Linguistic models to classify suspicious and trusted news posts on Twitter. Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (ACL), 647-653.
[10]. Castillo, C., Mendoza, M., & Poblete, B. (2011). Information credibility on Twitter. Proceedings of the 20th International Conference on World Wide Web, 675-684.
[11]. Khattar, D., Goud, J. S., Gupta, M., & Varma, V. (2019). Mvae: Multimodal variational autoencoder for fake news detection. The World Wide Web Conference (WWW), 2915-2921.
[12]. Jahanbakhsh-Nagadeh, Z., Feizi-Derakhshi, M.-R., & Sharifi, A. (2022). A deep content-based model for Persian rumor verification. ACM Transactions on Asian and Low-Resource Language Information Processing, 21(1), 1-29.
[13]. Shu, K., Sliva, A., Wang, S., Tang, J., & Liu, H. (2019). FakeNewsNet: A data repository with news content, social context, and spatialtemporal information for studying fake news on social media. Proceedings of the Twelfth ACM International Conference on Web Search and Data Mining (WSDM), 258-266.
[14]. Jin, Z., Cao, J., Guo, H., Zhang, Y., & Luo, J. (2017). Multimodal fusion with recurrent neural networks for rumor detection on microblogs. Proceedings of the 25th ACM International Conference on Multimedia, 1-17.
[15]. Shu, K., Cui, L., Wang, S., Lee, D., & Liu, H. (2019). dEFEND: Explainable Fake News Detection. Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, 395-405. https://doi.org/10.1145/3292500.3330935
[16]. Zhang, Z., Zhang, X., & Tang, J. (2020). SAFE: Similarity-Aware Fake News Detection via Self-Supervised Learning. Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics (ACL).
[17]. Liu, Y., Wu, Y., & Zhang, S. (2018). CSI: Capture, Score, and Integrate—Fake News Detection via Propagation Patterns. Proceedings of the 27th International Joint Conference on Artificial Intelligence (IJCAI), 3744-3750.
[18]. Chen, J., Li, Q., & Wang, Y. (2019). MMCN: Multi-modal Cross-attention Network for Fake News Detection. Proceedings of the 28th ACM International Conference on Information and Knowledge Management (CIKM).
[19]. Shu, K., Mahudeswaran, D., & Liu, H. (2017). att-RNN: Attention-based Recurrent Neural Networks for Fake News Detection. Proceedings of the IEEE International Conference on Data Mining (ICDM), 383-392.
[20]. Kumar, A., Chauhan, M., & Bhatt, S. (2020). MTM: Multi-task Multimodal Learning for Fake News Detection. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) Workshops, 512-519.
Cite this article
Li,Z. (2025). Multimodal fake news detection using graph neural networks and attention mechanisms. Advances in Engineering Innovation,15,63-73.
Data availability
The datasets used and/or analyzed during the current study will be available from the authors upon reasonable request.
Disclaimer/Publisher's Note
The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of EWA Publishing and/or the editor(s). EWA Publishing and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.
About volume
Journal：Advances in Engineering Innovation
© 2024 by the author(s). Licensee EWA Publishing, Oxford, UK. This article is an open access article distributed under the terms and
conditions of the Creative Commons Attribution (CC BY) license. Authors who
publish this series agree to the following terms:
1. Authors retain copyright and grant the series right of first publication with the work simultaneously licensed under a Creative Commons
Attribution License that allows others to share the work with an acknowledgment of the work's authorship and initial publication in this
series.
2. Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the series's published
version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgment of its initial
publication in this series.
3. Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and
during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See
Open access policy for details).