Comparative analysis of text readability and writing styles in AI-generated vs. Human-written academic abstracts
Document Type
Article
Publication Date
4-1-2026
Abstract
Research article abstracts are vital in scientific publications for readers to assess a study’s significance. The increasing use of AI tools, such as Kimi, ChatGPT and DeepSeek, to generate abstracts raises concerns about their readability and writing styles compared to human-written ones. The study aims to compare the differences in text readability and writing styles between human-written against AI-generated abstracts. A total of 150 abstracts of high-impact journal articles in the field of linguistics and computer science, 75 from each discipline, and another 150 AI-generated abstracts from the same corpus of articles served as the source texts for analysis. The Readability Scoring System, a computational tool, yielded readability and writing style metrics, while expert evaluation was performed to assess the quality of AI-generated academic abstracts. The quantitative data generated were analysed using SPSS 27 with non-parametric statistical methods. Key findings revealed: (1) AI-generated abstracts exhibited significantly lower readability across eight metrics, indicating greater complexity and lower readability; (2) Discipline-specific analysis showed five differing metrics in linguistics and eight in computer science; (3) Interdisciplinary comparisons revealed non-significant differences across nine readability metrics, highlighting AI’s potential to mimic natural writing. However, it still faces challenges in generating lexically diverse content. These results underscored the current limitations of AI in generating readable and human-like abstracts, especially in technical fields.
Keywords
Abstracting and Indexing; Artificial Intelligence; Comprehension; Humans; Reading; Writing
Publication Title
Plos One
ISSN
1932-6203
DOI
10.1371/journal.pone.0343163
Recommended Citation
Zou, Yumei; Kuek, Florence; Ng, Kwan Hoong; and Cheng, Xiaoli, "Comparative analysis of text readability and writing styles in AI-generated vs. Human-written academic abstracts" (2026). Research Publications (2026 to 2030). 873.
https://knova.um.edu.my/research_publications_2026_2030/873
Funders
Jiangxi Provincial Education Science Planning Project
Volume
21
Issue
4 April
Publisher
Public Library of Science