1. Introduction
In today's theater domain, the application of artificial intelligence technology is increasingly pervasive, particularly demonstrating immense potential in the realms of art and stage performance. New media technologies such as projection screens, video displays, augmented reality (AR), and virtual reality (VR) have become key tools in shaping stage scenes, offering artists fresh possibilities to realize their visions. These technologies not only enhance the emotional connection between audiences and the stage but also disrupt the traditional paradigm of stage design, redefining the concept of stage art. Especially with the intervention of artificial intelligence, the theater field has witnessed a revolutionary transformation. Through the research and development of intelligent agents, interdisciplinary collaboration between artists and scientists has brought forth new perspectives and possibilities for multimedia theater. However, beyond its impact on the entire industry, the integration of artificial intelligence technology also brings unique artistic experiences for special groups, particularly for individuals with disabilities.
This article focuses on the application of artificial intelligence in multimedia stage design, aiming to explore its impact on the theater industry and individuals with disabilities through a current analysis approach. By studying the innovative applications of artificial intelligence technology in stage art, a deeper understanding can be gained of how it expands the boundaries of art, enabling more people to participate in and enjoy the pleasures and inspirations brought by theatrical performances.
2. Application of Artificial Intelligence in Stage Design
The application and development of artificial intelligence in stage design demonstrate diversity and innovation. Firstly, scriptwriting serves as the foundation of stage performance. Nowadays, tools like ChatGPT that assist in text generation are becoming increasingly popular. Artificial intelligence aids in scriptwriting by providing assistance in creative inspiration, plot construction, character design, dialogue generation, language optimization, scene description, emotion analysis, and feedback modification. It can generate ideas based on keywords, suggest plot developments, shape character images, generate natural dialogues, optimize language expressions, describe vivid scenes, analyze emotional states, and provide personalized suggestions based on user feedback.
Secondly, artificial intelligence can provide creative inspiration and stage design suggestions that match the plot for designers. By optimizing set and lighting effects through algorithms, it enhances visual effects and stage atmosphere to adapt to different scenes and audience responses. The team of Turkish-American artist Refik Anadol combines generative art, interactive art, and AI art applied to the exterior light show and real-time interactive performances at Walt Disney Concert Hall[1]. Additionally, artificial intelligence uses smart algorithms to enhance AR experiences by providing real-time object recognition, seamless natural language processing for voice commands, and personalized adaptive content. This means that each user can receive a customized AR experience based on their individual needs and interests. Furthermore, artificial intelligence assists in model visualization, allowing designers to simulate visual effects between objects in 3D space and create realistic virtual scenes efficiently. Recently, plugins like Play Maker, widely used in immersive theater games, eliminate the need for programming skills and help accomplish complex interaction designs[2].
Furthermore, the combination of AI and VR technologies in virtual theater is noteworthy. The origin of the term "virtual reality" can be traced back to the French playwright, poet, actor, and director Antonin Artaud, who described theater as a form of virtual reality. Nowadays, VR technology is widely used in gaming experiences, film design, and immersive theater spaces. The application of AI in VR theater scenes enables intelligent interaction between the audience and the virtual environment through technologies like natural language processing, speech recognition, and facial recognition. AI helps in rapid generation and automated adjustment of virtual spaces, creating high-quality virtual scenes through techniques like deep learning and generative adversarial networks, imparting higher intelligence and autonomy to characters, and portraying more realistic emotions and behaviors through machine learning and emotion recognition technologies. Speech recognition and natural language generation adjust and optimize based on audience behavior and feedback, offering a deeper interactive experience for theater audiences.
3. Challenges Faced by People with Disabilities in Artistic Experiences
Individuals with disabilities encounter various challenges that hinder their access to and enjoyment of artistic experiences. Firstly, physical environment barriers prevalent in traditional art venues, such as stairs, narrow doorways, and inconvenient seating arrangements, restrict their mobility and comfort. Secondly, accessibility and communication barriers further exacerbate the situation for those with auditory or visual impairments, as the absence of proper auditory assistive devices or visual descriptions limits their understanding and engagement with artistic works. Moreover, the social isolation and discrimination faced by people with disabilities contribute to feelings of being unwelcome or misunderstood, potentially causing them to distance themselves from artistic activities. Additionally, economic barriers pose significant challenges, as some individuals may struggle to afford the costs associated with artistic pursuits due to financial constraints. Furthermore, a lack of cultural sensitivity among arts institutions and practitioners leads to the neglect of the specific needs of the disabled community in the design and provision of artistic experiences, further marginalizing their participation in the arts.
4. Advantages of Artificial Intelligence Technology for Involving People with Disabilities in Artistic Experiences
4.1. Utilizing AR/VR Technology to Assist Disabled Individuals in Experiencing Digital Theaters
Using VR technology, people with disabilities can fully immerse themselves in real-time theatrical performances in virtual reality environments. They enter the virtual stage through head-mounted displays, feeling as if they are present at the scene, experiencing the situations, characters, and atmosphere firsthand[3]. This immersive experience helps them better understand the plot, emotions, and relationships between characters. VR technology not only provides visual immersion but also combines with sound effects and haptic feedback, offering disabled individuals a more comprehensive multisensory experience. Through stereo sound effects and tactile feedback devices, they can perceive the sound effects on the stage and the tactile sensation of objects, enhancing their sense of participation and immersion in the performance. Additionally, VR technology can be customized according to the personalized needs of disabled individuals to provide them with more suitable experience modes. For example, for visually impaired individuals, visual effects on the virtual stage can be adjusted to enhance reliance on sound and touch; for hearing-impaired individuals, visual elements can be strengthened, and text or sign language explanations can be provided. Moreover, through network connectivity, VR technology enables disabled individuals to participate remotely in theatrical performances. Whether physically disabled or unable to reach theaters for other reasons, they can watch real-time performances through VR technology and interact and communicate with other audience members, share theatrical experiences, and promote social interaction and cultural exchange.
4.2. Research on the Application of AI in the Field of Brain-Computer Interface Technology
Traditionally, the challenge of theater performances has been how to provide more comprehensive theatrical experiences for blind audience members. Compared to the previous single method of theater workers providing audio descriptions to blind audience members, the application of AI in the field of brain-computer interface (BCI) technology has the potential to help disabled individuals perceive visual images. The ability of AI to analyze large amounts of data and identify underlying patterns helps improve the accuracy and efficiency of interpreting neural signals for BCIs. BCIs combined with artificial intelligence (AI) have the ability to provide a more intuitive and natural user experience. Invasive brain interfaces, which require surgical procedures in the visual system, such as retinal and cortical implants, aim to restore vision to those who have lost it. Non-invasive brain interfaces, such as electronic and electromechanical assistive devices, are designed to complement the sensory abilities that blind people already possess, as well as sensory substitution devices (SSDs), which aim to convert visual information into another form, such as touch and hearing, electronically, providing a "visual-like" experience. This not only helps enhance the sense of participation and enjoyment of artistic experiences for disabled individuals but also promotes the development of the theater industry towards a more inclusive and diverse direction[4].
4.3. Establishment of Digital Theaters
In response to the potential copyright issues arising from AI-generated art, suggestions include establishing laws and regulations to clarify the legal status of AI-generated works and the requirements for originality. Additionally, employing digital watermarking, encryption technology, and blockchain can verify the source and integrity of works while ensuring authors receive fair compensation through licensing mechanisms. Furthermore, strengthening international cooperation to develop unified standards and norms can address cross-border copyright issues, promoting copyright protection and collaboration globally. Regarding privacy and security concerns for audiences, while AI enhances audience engagement through VR, AR, etc., it may involve collecting audience information, potentially risking privacy breaches. Therefore, clear legal regulations and robust management of user data are essential to ensure safety and privacy, along with implementing multilayered security and privacy protection mechanisms, such as AI-based user identity authentication. Concerning potential unemployment due to AI replacing traditional theater jobs, it is believed that AI will create new skill demands, allowing individuals to engage in creative design, content planning, etc., thereby enhancing the theater's attractiveness and competitiveness. Moreover, AI assists people in accomplishing more complex tasks and creative projects collectively, improving efficiency and quality. Regarding the ethical principles and technological literacy issues arising from AI integration into the theater industry, emphasis on AI as a tool of humans requires clear ethical principles and enhancing public understanding and awareness of technology ethics issues, ensuring that ethical, creative, and emotional aspects of theater remain integral components of its evolution. [8].
5. Transformation of Traditional Theaters
The digitization and intelligentization of audience experiences signify not only a transformation for traditional theaters but also a crucial step towards their digital and intelligent development[9]. By integrating AI technology into theaters, traditional theaters can expand the boundaries of audience experiences, evolving from traditional viewing modes to more personalized and interactive directions. Using VR technology to create virtual reality performance spaces offers audiences immersive experiences, demonstrating traditional theaters' proactive response to modern audience
Demands[10]. Additionally, setting up intelligent auxiliary facilities and utilizing AI voice recognition and translation technologies in digital theaters not only enhances the participation of disabled audiences but also showcases traditional theaters' transformation towards inclusivity and social responsibility. Combining augmented reality technology with multimedia interactive experiences, traditional theaters continually innovate in keeping with the times to meet modern audiences' pursuit of richer and more interactive artistic experiences. These initiatives reflect traditional theaters' active embrace of technological and intelligent transformation trends, injecting new vitality and attractiveness into traditional cultural arts.
6. Conclusion
The theater has undergone significant technological transformations, such as film, radio, and television. However, these "new" technologies have not replaced the importance of theater in the performing arts industry. The integration of new media technology and artificial intelligence, from innovative applications of AR and VR technology to the widespread adoption of artificial intelligence in stage scriptwriting and visual presentation, has witnessed multimedia stage design reaching new heights. This integration not only provides audiences with more immersive theater experiences but also offers artists and stage designers more creative possibilities.
Through intelligent stage design and programming, stage effects can be dynamically adjusted according to the audience's emotional changes, presenting a more vivid and dynamic performance scene to the audience. The application of artificial intelligence in scriptwriting provides playwrights with new creative inspirations.
Although AI-generated scripts also face issues of originality and copyright attribution, it remains a promising tool. On the other hand, the combination of AI technology and AR/VR offers disabled individuals new opportunities to participate in theater performances.
Through virtual stage experiences and multisensory encounters, disabled individuals can experience the allure of theater just like any other audience member, thereby significantly enhancing the inclusiveness and diversity of the theater industry. However, the advancement of emerging technologies also presents challenges and risks. Issues such as AI-generated copyright concerns, audience privacy and security, and potential unemployment stemming from AI's substitution of traditional theater roles all demand serious consideration and resolution. Additionally, ethical principles and technological literacy regarding AI in theatrical creation, as well as transparency concerns, warrant attention to ensure the harmonious integration of technological advancements with human culture.
In conclusion, the application of artificial intelligence in multimedia stage design will continue to propel the theater industry forward. Maintaining an open mindset and actively addressing the challenges posed by new technologies are essential to ensure that theatrical art remains a source of inspiration and delight for audiences.
References
[1]. Beauchamp, M. S., Oswalt, D., Sun, P., Pouratian, N., Bosking, W. H., & Yoshor, D. (2020). Dynamic stimulation of visual cortex produces form vision in sighted and blind humans. PubMed. https://pubmed.ncbi.nlm.nih.gov/32413298/
[2]. Kateryna, & Humen Y, T., Horevalov, S. (2023). Virtual reality in contemporary theatre. ACM Journal on Computing and Cultural Heritage, 15(4), Article 75. https://www.x-mol.com/paper/1578965724887048192
[3]. Hindawi. (2022). Integrated application of AR technology development and drama stage design. MISY, 2022, Article ID 5179451, 8 pages. https://www.hindawi.com/journals/misy/2022/5179451/
[4]. Zhang, Z., Wen, F., Sun, Z., Guo, X., He, T., & Lee, C. (2022). Artificial intelligence-enabled sensing technologies in the 5G/Internet of Things era: From virtual reality/augmented reality to the digital twin. Advanced Intelligent Systems. https://onlinelibrary.wiley.com/doi/full/10.1002/aisy.202100228
[5]. Ekweariri, C. S. (2013). Synthetic design and the art of virtual reality in theatre and film production. ajol-file journals_546_articles_120640_submission_proof_120640-6433-332093-1-10-20150806
[6]. Huang, A. (2022). Integrating virtual reality into scenic design. ScholarWorks. http://scholarworks.calstate.edu
[7]. Generative artificial intelligence and copyright law. (2023). DigitalCommons. https://digitalcommons.unl.edu/scholcom/243/
[8]. Karas, K., Pozzi, L., Pedrocchi, A., Braghin, F., & Roveda, L. (2023). Brain-computer interface for robot control with eye artifacts for assistive applications. Scientific Reports, 13, 17512. https://pubmed.ncbi.nlm.nih.gov/37845318/
[9]. Anantrasirichai, N., & Bull, D. (2022). Artificial intelligence in the creative industries: A review. Artificial Intelligence Review, 55, 589–656. https://link.springer.com/article/10.1007/s10462-021-10039-7
[10]. Befera, L., & Bioglio, L. (2022). Classifying contemporary AI applications in intermedia theatre: Overview and analysis of some cases. University of Turin. https://ceur-ws.org/Vol-3278/paper4.pdf
Cite this article
Du,S. (2024). The Opportunities and Challenges of Theater Stage Design in the Era of Artificial Intelligence. Communications in Humanities Research,38,76-80.
Data availability
The datasets used and/or analyzed during the current study will be available from the authors upon reasonable request.
Disclaimer/Publisher's Note
The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of EWA Publishing and/or the editor(s). EWA Publishing and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.
About volume
Volume title: Proceedings of the 3rd International Conference on Literature, Language, and Culture Development
© 2024 by the author(s). Licensee EWA Publishing, Oxford, UK. This article is an open access article distributed under the terms and
conditions of the Creative Commons Attribution (CC BY) license. Authors who
publish this series agree to the following terms:
1. Authors retain copyright and grant the series right of first publication with the work simultaneously licensed under a Creative Commons
Attribution License that allows others to share the work with an acknowledgment of the work's authorship and initial publication in this
series.
2. Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the series's published
version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgment of its initial
publication in this series.
3. Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and
during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See
Open access policy for details).
References
[1]. Beauchamp, M. S., Oswalt, D., Sun, P., Pouratian, N., Bosking, W. H., & Yoshor, D. (2020). Dynamic stimulation of visual cortex produces form vision in sighted and blind humans. PubMed. https://pubmed.ncbi.nlm.nih.gov/32413298/
[2]. Kateryna, & Humen Y, T., Horevalov, S. (2023). Virtual reality in contemporary theatre. ACM Journal on Computing and Cultural Heritage, 15(4), Article 75. https://www.x-mol.com/paper/1578965724887048192
[3]. Hindawi. (2022). Integrated application of AR technology development and drama stage design. MISY, 2022, Article ID 5179451, 8 pages. https://www.hindawi.com/journals/misy/2022/5179451/
[4]. Zhang, Z., Wen, F., Sun, Z., Guo, X., He, T., & Lee, C. (2022). Artificial intelligence-enabled sensing technologies in the 5G/Internet of Things era: From virtual reality/augmented reality to the digital twin. Advanced Intelligent Systems. https://onlinelibrary.wiley.com/doi/full/10.1002/aisy.202100228
[5]. Ekweariri, C. S. (2013). Synthetic design and the art of virtual reality in theatre and film production. ajol-file journals_546_articles_120640_submission_proof_120640-6433-332093-1-10-20150806
[6]. Huang, A. (2022). Integrating virtual reality into scenic design. ScholarWorks. http://scholarworks.calstate.edu
[7]. Generative artificial intelligence and copyright law. (2023). DigitalCommons. https://digitalcommons.unl.edu/scholcom/243/
[8]. Karas, K., Pozzi, L., Pedrocchi, A., Braghin, F., & Roveda, L. (2023). Brain-computer interface for robot control with eye artifacts for assistive applications. Scientific Reports, 13, 17512. https://pubmed.ncbi.nlm.nih.gov/37845318/
[9]. Anantrasirichai, N., & Bull, D. (2022). Artificial intelligence in the creative industries: A review. Artificial Intelligence Review, 55, 589–656. https://link.springer.com/article/10.1007/s10462-021-10039-7
[10]. Befera, L., & Bioglio, L. (2022). Classifying contemporary AI applications in intermedia theatre: Overview and analysis of some cases. University of Turin. https://ceur-ws.org/Vol-3278/paper4.pdf