PakParse: Machine Translation from Text to Pakistan Sign Language for Effective Communication with Deaf People

Rana Arsal Mahmood; Haseeb Ahmad; Qurat-ul Ann; Muhammad Usman Ashraf

doi:10.54254/2755-2721/2/20220568

Research Article

Open access

Published on 22 March 2023

Download pdf

Mahmood,R.A.;Ahmad,H.;Ann,Q.;Ashraf,M.U. (2023). PakParse: Machine Translation from Text to Pakistan Sign Language for Effective Communication with Deaf People. Applied and Computational Engineering,2,442-450.

Export citation

PakParse: Machine Translation from Text to Pakistan Sign Language for Effective Communication with Deaf People

Rana Arsal Mahmood ¹, Haseeb Ahmad *^,2, Qurat-ul Ann ³, Muhammad Usman Ashraf ⁴

¹ Department of Computer Science, National Textile University, Faisalabad, Pakistan
² Department of Computer Science, National Textile University, Faisalabad, Pakistan
³ Department of Computer Science, National Textile University, Faisalabad, Pakistan
⁴ Institute of Business Management Sciences University of Agriculture, Faisalabad, Pakistan

* Author to whom correspondence should be addressed.

https://doi.org/10.54254/2755-2721/2/20220568

Abstract

The People around the world use different languages to communicate with each other. But there are many individuals who can’t listen or speak. These people use gesture-based language for their communication which is called Sign Language. There is no universal Sign Language in world so it changes region wise. As Sign language can’t be written and sign video approach is also expensive (in terms of create, store and manage), that’s why sign animation through 3D avatar is best option. Recently Pakistan got its own Sign Language called Pakistan Sign Language (PSL). As a noteworthy population of deaf people live in country, there is no machine translator for PSL which can facilitate deaf in their communication and education. This work proposed a machine translator for Pakistan Sign Language called PakParse, which takes text (English & Urdu) as input, and animate corresponding signs by 3D avatar.

Keywords

Sign Language, Pakistan Sign Language, Machine translator, Deaf, HamNoSys, SiGML.

View pdf

References

[1]. K. Nabeel, A. Sabir, A. Adnan, F. Kamran, F. Uzma, S. Muhammad and H. Jameel, "Speak Pakistan: Challenges in developing Pakistan sign language using information technology," South Asian Studies, vol. 2, p. 367, 2015.

[2]. Marshall and I. Eva Safar, "The Architecture of an English Text-to Sign Languages Translation System," in Recent Advances in Natural Language Processing (RANLP), Tzigov Chark Bulgaria, 2001, pp. 223-228.

[3]. Hassan, F. Bilal, A. Muhammad Shoaib, S. Adnan and Nabeel, "Pakistan Sign Language: Computer Vision Analysis & Recommendations," VFAST Transactions on Software Engineering, vol. 9, pp. 1-6, 2015.

[4]. A. Aleem, K. Azhar, B. U. M Yousuf, M. Mehmood, R. Suleman, R. Sameer, A. Razi Ur and Israr, "Pakistan sign language recognition using statistical template matching," International Journal of Information Technology, vol. 1, pp. 1-12, 2004.

[5]. A. F. Sevilla, A. D. Esteban and J. M. Lahoz-Bengoechea, "Tools for the Use of SignWriting as a Language Resource," in Proceedings of the LREC2020 9th Workshop on the Representation and Processing of Sign Languages: Sign Language Resources in the Service of the Language Community, Technological Challenges and Application Perspectives, 2020, pp. 203-208.

[6]. Sulman, Z. Dr Nasir and Sadaf, "Pakistan sign language--a synopsis," Pakistan, June, 2000.

[7]. Y. Rabia, K. Ahmet Alp and H. Kose, "Avatar-based Sign Language Training Interface for Primary School Education," in Workshop: Graphical and Robotic Embodied Agents for Therapeutic Systems, 2016.

[8]. Dewani, B. Amirita, M. Sania, A. Mohsin, A. Wajiha, Z. Quratulain and B. Sayyid, "Sign Language e-Learning system for hearing-impaired community of Pakistan," International Journal of Information Technology, vol. 10, pp. 225-232, 2018.

[9]. N. S. Khan, A. Abid and K. Abid, "A Novel Natural Language Processing (NLP)--Based Machine Translation Model for English to Pakistan Sign Language Translation," Cognitive Computation, pp. 1-18.

[10]. Z. Liwei, Kipper, K. Schuler, W. Vogler, C. Badler, N. Palmer and Martha, "A machine translation system from English to American Sign Language," in Springer, 2000.

[11]. B. Andrew, J. C. Stephen, R. Elliott, G. John, I. Marshall and S. Rankov, "Virtual signing: Capture, animation, storage and transmission-an overview of the visicast project," in IET, 2000.

[12]. V. Tony, C. Alan and Collins, "The challenges of cross-modal translation: English-to-Sign-Language translation in the Zardoz system," Machine Translation, vol. 13, pp. 81-106, 1998.

[13]. A. Aleem Khalid, B. A. M Yousuf, U. Mehmood, M. Suleman, R. Sameer, U. R. Razi and I. Ahmed, "Pakistan sign language recognition using statistical template matching," International Journal of Information Technology, vol. 1, pp. 1-12, 2004.

[14]. Parkhurst, P. Steve and Dianne, SignWriting: A Complete System for Writing and Reading Signed Languages, SignWriting Press, 2007.

[15]. Stokoe, C. William C, C. Dorothy C and C. G, A dictionary of American Sign Language on linguistic principles, Linstok Press, 1976.

[16]. Thomas and Hanke, "HamNoSys-representing sign language data in language resources and language processing contexts," in LREC, 2004, pp. 1-6.

[17]. K. Rupinder and K. Parteek, "HamNoSys generation system for sign language," in 2014 International Conference on Advances in Computing, Communications and Informatics (ICACCI), IEEE, 2014, pp. 2727-2734.

Cite this article

Data availability

The datasets used and/or analyzed during the current study will be available from the authors upon reasonable request.

Disclaimer/Publisher's Note

The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of EWA Publishing and/or the editor(s). EWA Publishing and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

About volume

Volume title: Proceedings of the 4th International Conference on Computing and Data Science (CONF-CDS 2022)

Conference website: https://www.confcds.org/

ISBN：978-1-915371-19-5(Print) / 978-1-915371-20-1(Online)

Conference date: 16 July 2022

Editor：Alan Wang

Series: Applied and Computational Engineering

Volume number: Vol.2

ISSN：2755-2721(Print) / 2755-273X(Online)

© 2024 by the author(s). Licensee EWA Publishing, Oxford, UK. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license. Authors who publish this series agree to the following terms:
1. Authors retain copyright and grant the series right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgment of the work's authorship and initial publication in this series.
2. Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the series's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgment of its initial publication in this series.
3. Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See Open access policy for details).