1. Introduction
In the context of globalization, the importance of English as an international language has become increasingly prominent [1]. In recent years, with the rapid development and iterative update of artificial intelligence technology, Artificial Intelligence(AI) has penetrated various aspects of people’s jobs and lives. People's attention to teaching support tools like intelligent teaching systems has spread throughout the entire educational environment as the usage of AI and other technology in education has developed [2]. In the field of education, Al can assist teachers in evaluating students' academic performance and help teachers prepare lessons, which have been very common in Shanghai. Iwrite, based on artificial intelligence, is an English writing teaching and evaluation system that includes writing teaching, intelligent correction and automatic grading, which can play a great role in English writing teaching [3]. Nowadays, the potential of chatbots in education, especially in simulating human interactions and generating human-like texts, has been widely highlighted [4]. In reviewing previous studies, the author found that ChatGPT is used in most of the literature. Preparing lessons for teachers is a core part of the daily work of educators, which requires a lot of time and energy. ChatGPT, as a language processing tool, has been widely used in teaching plan design [5]. As Lotze argues, AI diagnostic systems still need to meet some key criteria (i.e., spontaneity, creativity, and shared knowledge) before they can serve as a real-life language teacher. Although AI has great potential to facilitate English as a Foreign Language (EFL), the integration of new technologies into classroom teaching generally requires teachers to overcome multilayer barriers [6]. Hence, along with providing more technical support to upgrade diagnostic systems of AI chatbots, future work is required to empirically investigate their adaptability to different language proficiency levels and various instructional contexts [7]. In order to explore whether AI-based iWrite assisted English writing teaching mode can effectively improve students’ English writing ability, the study adopts two different teaching methods to compare. In this paper, the author pays attention to ERNIE Bot 4.0 and ZECOBA 4o AI chat, trying to find out whose writing ability is better. The author sets Shanghai high school entrance examination English composition in 2022, 2023, 2024 as an example, letting two Al intelligent software generate relevant model essays, through the form of tables to compare them in words, grammar, special sentence patterns and etc., in order to find which software can better assist teachers in the teaching of writing. With AI technology tools and teacher coaching, students can make significant progress in their English learning experiences [8].
2. Research Design
2.1. AI Model Selection
In terms of software selection, the author chose two AI intelligence software developed by Chinese developers, because when looking up a lot of literature, the author found that there was little research on AI software in China.
However, the author wants to compare the intelligent software independently developed by Chinese developers, so as to see the continuous progress and strength of China's independent research capacity.
ERINE Bot is a generative dialogue product launched by Baidu based on ERINE big model technology. It can talk with people, interact with them, answer questions, assist creation, and help people get information efficiently and conveniently.
Although ZECOBA Al chat is not well known at present, it is an intelligent software independently developed and established by Shanghai Technology Company. In this topic, the author takes the English composition for the Senior high School entrance examination in Shanghai in the past two years as an example, so it may have a better understanding of some local English learning modes in Shanghai and generate more intelligent essay models.
2.2. Evaluation Criteria
1. Vocabulary sources. How many advanced words are beyond the scope of the exam syllabus? In this way, the advanced character of Al-generated model words is judged.
2. Will be judged by the emphasis sentence, inversion sentence, special clause, and several aspects.
3. Precision. Evaluate whether the model essay meets the standards and requirements, and whether the writing is coherent and smooth.
2.3. Text Sources
This paper takes the English composition questions of the 2022-2024 Shanghai high School Entrance exam as an example and lets Al generate model essays.
2022: Your school will add a student activity room, there are six ideas about the use of the activity room. You need to choose one of them and give your reasons. The situation is: The school is trying to find out the students' intentions through the school newspaper. Suppose you are Li Hua, please write an email to Miss Zhang in the school newspaper, indicating that you like it best one of the ideas, and explain why. The six ideas about the use of the activity room include: readers' home, labor workshop, art and sports world, charity bazaar, science and innovation hut and spiritual station. Candidates need to choose one of the ideas, explain why they chose the idea, and how it will benefit students.
2023: Your community plans to hold a training program called "time management" and is asking for comments on the training program. If you are Li Hua, a junior student, please read the following training program and write an email to Mr. Wang, the community leader. The email should contain the following content:
(1) Whether you will attend the training and give a brief explanation of the reasons
(2) Suggest changes to one item in the program and how it will benefit students.
Training Plan
Purpose |
Teach the ways to manage time |
participant |
Students from 13-17 |
Way of training |
Reading |
Time |
7-10 am. on every Saturday in July |
Place |
Community plaza |
2024: Suppose you are Li Feng and you are going to say goodbye to Frank, a foreign student you met at the school International Exchange Festival. You have given him a gift with Chinese elements. Please write down what you say to him on the gift card. This essay question requires the examinee to use his imagination to create a practical essay based on the specific situation. The examinee should consider the name, features and functions of the gift, as well as the reasons for choosing the gift.
3. Result & Conclusion
3.1. Compositions Produced by Two AI Models
Table 1 is the English compositions completed by ZECOBA 4o Chat according to the writing topic of 2022-2024.
Table 1: English compositions from 2022-2024 completed by ZECOBA 4o Chat
Year |
ZECOBA 4o Chat |
2022 |
Dear Ms. Zhang, I am Li Hua from Class 3. I am writing to express my preference for the "High-tech lab" as the purpose of the new student activity room. In my opinion, a High-tech lab would provide us with valuable opportunities to explore and learn about the latest technologies, such as robotics, coding, and 3D printing. This would not only enhance our practical skills but also inspire creativity and innovation, which are essential in today's world. Moreover, it would be a great platform for students interested in science and technology to collaborate and share ideas. Thank you for considering my suggestion. Best regards, Li Hua |
2023 |
Dear Mr. Wang, I hope this email finds you well. I would like to share my thoughts regarding the upcoming "Time Management" training program. First, I would like to confirm that I will attend this training. As a ninth-grade student, I have a heavy workload, and managing my time effectively is crucial for my academic success. I believe this training will help me learn valuable time management skills to improve my efficiency. Additionally, I have a suggestion regarding one part of the training program. I noticed that the program emphasizes the importance of creating a daily schedule. While this is very useful, I suggest adding an interactive component, such as having participants create their own daily schedules during the session, followed by feedback from the instructor. This would not only help us better understand how to plan our time but also make the training more practical and engaging. I look forward to your response. Best regards, Li Hua |
2024 |
Dear Frank, It was a pleasure to meet you during our school's International Exchange Festival. I hope you enjoyed your time here in China and made many unforgettable memories. As a small token of our friendship, I am giving you this Chinese calligraphy set. Calligraphy is a significant part of Chinese culture, representing the beauty of our language and art. I hope that whenever you use it, you will think of the wonderful moments we shared together. Wishing you all the best in your future endeavors. May our friendship last across borders and time! Best regards, Li Feng |
Table 2 is the English compositions completed by ERINE 4.0 Bot according to the writing topic of 2022-2024.
Table 2: English compositions from 2022-2024 completed by ERINE 4.0 Bot
Year |
ERINE 4.0 Bot |
2022 |
Dear Ms. Zhang, Hello! I'm Li Hua, and I wanted to write to you about the new student activity room our school is planning. Out of all the ideas like a Reading corner, Mini workshop, Arts and sports center, and the rest, I really like the idea of a Heart-to-heart room. I think it would be great to have a place where we can talk to each other and share how we feel. Sometimes school can be stressful, and it would be nice to have a safe space where we can just relax and talk about our problems. The Heart-to-heart room could be like a secret garden where we can be ourselves and get support from our friends. Also, it would be cool to learn how to listen to each other and help each other out. I think that's an important skill to have, not just in school but in life too. If we have a Heart-to-heart room, we could learn how to be better friends and support each other through good times and bad. Best regards, Li Hua |
2023 |
Dear Mr. Wang, Hello! I'm Li Hua from our community. Thank you for organizing the "Time Management" training. I think it's really helpful for us students. I want to take part in this training because I want to learn how to manage my time better. With exams coming up, I feel like there's so much to do and not enough time. Also, I think it would be more fun if we could do some activities together during the training. Like, maybe we can share our own tips on how we manage our time, or do some small games that teach us about time management. That way, it won't just be listening to lectures, but also doing something hands-on. Best regards, Li Hua |
2024 |
Dear Frank, Hi, I'm Li Feng. I'm giving you a gift as you're leaving. It's a Chinese fan with beautiful paintings on it. The fan can keep you cool in hot weather and also looks very pretty. I picked this fan for you because I know you like Chinese art. The paintings show traditional Chinese scenery and animals. I hope when you use the fan, you'll think of our time together at the International Exchange Festival. I hope you have a great trip back home and don't forget us! Best wishes, Li Feng |
3.2. Data Analysis
Table 3 is based on Table1 and Table2, comparing the compositions produced by ERINE 4o Bot and ZECOBA 4.0 in the following aspects.
Table 3: Comparison of the results
Year |
2022 |
2023 |
2024 |
|||
Name |
ZECOBA |
ERINE |
ZECOBA |
ERINE |
ZECOBA |
ERINE |
Words Out of syllabus |
10 |
0 |
13 |
2 |
4 |
1 |
Special Sentence Patterns |
Non-restrictive attributive clause; |
Adverbial clause |
Object clause; Adverbial clause |
Object Clause; Attribute clause |
Object Clause; Adverbial clause
|
Object Clause; Adverbial clause
|
Conjunctions |
Not only...but also… Moreover |
Also; So
|
First; Additionally; While
|
Also; Like |
As; Whenever
|
/ |
Number of words |
106 |
191 |
158 |
128 |
98 |
94 |
First, ZECOBA has more words out of the syllables, like “preference”, “enhance”, “practical”, “innovation”, “collaborate”, “management”, “effectively”, “components”, “engaging”, “unforgettable”, “calligraphy”, “significant”, “endeavors”, etc. (see Table 3).
Second, seeing from the special sentence patterns, ZECOBA has non- non-restrictive attributive clause, an objective clause and some adverbial clauses while ERINE has an adverbial clause and objective clause, too (see Table 3).
Third, ZECOBA uses more diversified conjunctions like “not only… but also…” “moreover”, “additionally”, and “whenever”, while ERINE just uses “also”, “so”, and “like” (see Table 3).
4. Conclusion
According to the data shown in the table above, the following conclusions can be drawn:
First, ZECOBA is more advanced and uses more words other than the syllabus. The words of ERINE are relatively simple, most of them belong to the scope of the exam, which belongs to the standard words.
Secondly, from the point of view of special sentence patterns, both use attributive clauses, adverbial clauses, object clauses and other basic clauses, and there is no big difference in special sentence patterns.
Thirdly, in terms of textual connectives, the connectives of ZECOBA are more diversified and advanced, while the conjunctions of ERINE are more simple.
Fourth, in terms of the number of words, the number of words is generally more than the specified number of words required by the test.
Overall, ERINE’s ability in the generation of junior high school essay model is more unstable, and its words and sentences are more regular, which can not be used as a good middle school exam model to be used as a reference; The generative ability of ZECOBA is relatively stable, and its words and sentences, including the fluency of writing. It has a good reference value. Therefore, the author thinks it can be better used as an auxiliary tool for junior middle school English teachers in Shanghai to generate compositions.
However, this study also has some limitations, it can’t know whether the two Al tools have a better teaching aid role in English essay writing in higher education, and it remains to be explored in this aspect.
References
[1]. MATSUMURA S. (2022) Self-efficacy beliefs among non-specialist teachers in primary English education[J]. Language Teaching for Young Learners, 4(1): 118-142.
[2]. Q Qian, R Jin, J Yi. (2013) et al. Efficient distance metric learning by adaptive sampling and mini-batch stochastic gradient descent (SGD)
[3]. Xia, J., Liu, H., Liu, W. (2022) AI-Based IWrite Assisted English Writing Teaching. In: Macintyre, J., Zhao, J., Ma, X. (eds) The 2021 International Conference on Machine Learning and Big Data Analytics for IoT Security and Privacy. SPIoT 2021. Lecture Notes on Data Engineering and Communications Technologies, vol 98 . Springer, Cham.
[4]. ADIGUZEL T. KAYA M H, CANSU F K. (2023) Revolutionizing education with AI: exploring the transformative potential of ChatGPT [JI. Contemporary Educational Technology 15(3): ep429.
[5]. Guo Sijia. (2024) The role of AI tools in helping non-native English teachers deal with teaching challenges. English Abroad, (09):70-72.
[6]. Tsai, C., & Chai, C. S. (2012) The “third”-order barrier for technology-integration instruction: Implications for teacher education. Australasian Journal of Educational Technology, 28(6), 1057–1060.
[7]. Lotze, N. (2018) Goodbye to classroom teaching. Artificial intelligence in language learning. Translation: Chris Cave. Copyright: Goethe-Institute. V., Redaktion Magazin Sprache.
[8]. Liu, Xing; Huang, Xiaoyin. (2022) Design of Artificial Intelligence-Based English Network Teaching (AI-ENT) System. Mathematical Problems in Engineering; New York Vol.
Cite this article
Gao,W. (2024). The Comparison of Different Artificial Intelligence Software in Assisting Teacher’s Teaching Ability of Junior Middle School English Writing. Lecture Notes in Education Psychology and Public Media,74,120-125.
Data availability
The datasets used and/or analyzed during the current study will be available from the authors upon reasonable request.
Disclaimer/Publisher's Note
The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of EWA Publishing and/or the editor(s). EWA Publishing and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.
About volume
Volume title: Proceedings of ICILLP 2024 Workshop: Today's College Students and Faculty: How AI is Transforming Their Behaviors, Legally
© 2024 by the author(s). Licensee EWA Publishing, Oxford, UK. This article is an open access article distributed under the terms and
conditions of the Creative Commons Attribution (CC BY) license. Authors who
publish this series agree to the following terms:
1. Authors retain copyright and grant the series right of first publication with the work simultaneously licensed under a Creative Commons
Attribution License that allows others to share the work with an acknowledgment of the work's authorship and initial publication in this
series.
2. Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the series's published
version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgment of its initial
publication in this series.
3. Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and
during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See
Open access policy for details).
References
[1]. MATSUMURA S. (2022) Self-efficacy beliefs among non-specialist teachers in primary English education[J]. Language Teaching for Young Learners, 4(1): 118-142.
[2]. Q Qian, R Jin, J Yi. (2013) et al. Efficient distance metric learning by adaptive sampling and mini-batch stochastic gradient descent (SGD)
[3]. Xia, J., Liu, H., Liu, W. (2022) AI-Based IWrite Assisted English Writing Teaching. In: Macintyre, J., Zhao, J., Ma, X. (eds) The 2021 International Conference on Machine Learning and Big Data Analytics for IoT Security and Privacy. SPIoT 2021. Lecture Notes on Data Engineering and Communications Technologies, vol 98 . Springer, Cham.
[4]. ADIGUZEL T. KAYA M H, CANSU F K. (2023) Revolutionizing education with AI: exploring the transformative potential of ChatGPT [JI. Contemporary Educational Technology 15(3): ep429.
[5]. Guo Sijia. (2024) The role of AI tools in helping non-native English teachers deal with teaching challenges. English Abroad, (09):70-72.
[6]. Tsai, C., & Chai, C. S. (2012) The “third”-order barrier for technology-integration instruction: Implications for teacher education. Australasian Journal of Educational Technology, 28(6), 1057–1060.
[7]. Lotze, N. (2018) Goodbye to classroom teaching. Artificial intelligence in language learning. Translation: Chris Cave. Copyright: Goethe-Institute. V., Redaktion Magazin Sprache.
[8]. Liu, Xing; Huang, Xiaoyin. (2022) Design of Artificial Intelligence-Based English Network Teaching (AI-ENT) System. Mathematical Problems in Engineering; New York Vol.