Generative AI Models and Fake Bibliographic Information in Scholarly Publications: Causes, Typology, Consequences, and Implications for Managerial Decision-Making
Keywords:
автор, large language models, confabulation, fake articles, scholarly journal, scientific research, authorAbstract
In the context of the digital transformation of science and education, the widespread adoption of generative artificial intelligence models functions both as a useful software solution that optimizes routine processes and large-scale data processing and as a source of new risks to the quality of scholarly communication, requiring managerial reflection. The article examines the phenomenon of fake bibliographic information arising from the use of such models in scholarly publishing practices. The study includes an analysis of terminological diversity and substantiates the use of the key concept of “confabulation”, as well as a review of Russian and international research.Objective of the study is to analyze the causes, types, and consequences of generating unreliable bibliographic references and to determine the significance of the identified risks for managerial decision-making at both federal and institutional levels.Methodology and Methods present the author’s approach to selecting and analyzing published Russian-language scholarly works, followed by verification of their bibliographic lists, and propose a typology of identified confabulations with justification for its application.Results demonstrate increasing activity in the use of generated unreliable references across publications of various subject areas and types, including peer-reviewed journals. Key causes of confabulation are identified, related both to the functioning characteristics of generative models and to authors’ practices in using them. It is also shown that confabulated bibliographies can serve as an indicator of generated fragments within scholarly texts, which has direct implications for managing publication quality.Conclusions confirm the need to move from declarative regulation toward comprehensive managerial solutions, including the development of institutional policies for the use of generative technologies, revision of scholarly quality control procedures, provision of access to up-to-date tools, and targeted development of competencies for responsible use of artificial intelligence among authors, editors, and academic managers.Discussion highlights the risk of reproducing unreliable references through subsequent publications and the formation of “chains of dissemination” of false scholarly information. It emphasizes the need to consolidate research focused on detecting generated texts, with particular attention to bibliographic data, and proposes priority directions for administrative decisions. Finally, it draws attention to the lack of an organizational framework governing users' application of generative models.Downloads
References
Бруссард М. Искусственный интеллект: Пределы возможного : пер. с англ. М. : Альпина нон-фикшн, 2020. 362 с.
Васильева В. А. Между Сциллой запрета и Харибдой попустительства: редакционные стратегии журналов в эпоху генеративных моделей искусственного интеллекта // Управленческое консультирование. 2025. № 6. С. 192–210. EDN NCWVQL
Гончаров М. В., Соколинский К. Е., Шрайберг Я. Л. Применение искусственного интеллекта в практике научно-технических библиотек // Научные и технические библиотеки. 2025. № 12. С. 144–164. DOI: 10.33186/1027-3689-2025-12-144-164
Косяков Д. В. Мифы и легенды генеративного искусственного интеллекта // Университетская книга. 2024. № 8. С. 38–45. EDN: WMEQUQ
Нещерет М. Ю. За границами реальности: ложные библиографические записи и ссылки // Библиосфера. 2024. № 4. С. 63–70. DOI: 10.20913/1815-3186-2024-4-63-70. EDN VKQWVL
Степанов В. К., Маджумдер М. Ш., Бегунова Д. Д. Методика применения большой языковой модели ChatGPT в библиотечно-библиографической деятельности // Научно-техническая информация. Серия 1: Организация и методика информационной работы. 2023. № 7. С. 11–21. DOI: 10.33186/1027-3689-2024-4-86-108. EDN: JORNVM
Чехович Ю. В., Грабовой А. А., Грицай Г. А. Модели генеративного искусственного интеллекта с полным их разоблачением // Университетская книга. 2024. № 5. С. 58–65. EDN: YXSKBC
Adel A., Alani N. Can generative AI reliably synthesise literature? Exploring hallucination issues in ChatGPT // AI & Society. 2025. 40(8). P. 6799–6812. DOI:10.1007/s00146-025-02406-7
Alkaissi H., McFarlane S. I. Artificial Hallucinations in ChatGPT: Implications in Scientific Writing // Cureus. 2023. 15(2). e35179. DOI: 10.7759/cureus.35179
Avros O., et al. Detecting Pseudo-Manipulated Citations: a Machine Learning Approach // Mathematics. 2023. 11(18). P. 3820. DOI:10.3390/math11183820
Bhattacharyya M., Miller V. M., Bhattacharyya D., et al. High Rates of Fabricated and Inaccurate References in ChatGPT-Generated Medical Content // Cureus. 2023. 15(5). e39238. DOI: 10.7759/cureus.39238
Blum M. ChatGPT Produces Fabricated References and Falsehoods When Used for Scientific Literature Search // Journal of cardiac failure, 29(9), P. 1332–1334. DOI: 10.1016/j.cardfail.2023.06.015
Cabanac G., C., Magazinov A. Prevalence of nonsensical algorithmically generated papers in the scientific literature // Journal of the Association for Information Science and Technology. 2021. 72(12). P. 1461–1476. DOI:10.1002/asi.24495
Camp N. T., Bengtson J. A., Sandstrom J. C. The citation catastrophe: Propagation of AIgenerated counterfeit citations in scholarship // The Journal of Academic Librarianship. 2025. 51(4). 103065. DOI:10.1016/j.acalib.2025.103065
Chelli M., Descamps J., V., et al. Hallucination Rates and Reference Accuracy of ChatGPT and Bard for Systematic Reviews: Comparative Analysis // Journal of medical Internet research. 2024. 26. e53164. DOI:10.2196/53164
Cheng A., Calhoun A., Reedy G. Artificial intelligence-assisted academic writing: recommendations for ethical use // Advances in Simulation. 2025. 10. P. 22. DOI: 10.1186/s41077-025-00350-6
Cole R., Maher L., Rice R. Understanding and Avoiding Hallucinated References: An AI Writing Experiment // The WAC Clearinghouse (preprint). 2025. P. 1–20 (online). URL: https://wacclearinghouse.org/repository/collections/continuing-experiments/august-2025/ai-literacy/understanding-avoiding-hallucinated-references/ (дата обращения: 05.01.2026).
McGowan A., Gui Y., Dobbs M., et al. ChatGPT and Bard exhibit spontaneous citation fabrication during psychiatry literature search // Psychiatry Research. 2023. 326. P. 115334. DOI:10.1016/j.psychres.2023.115334
Gravel J., D’Amours-Gravel M., Osmanlliu E., et al. Learning to Fake It: Limited Responses and Fabricated References Provided by ChatGPT for Medical Questions // Mayo Clinic Proceedings: Digital Health. 2023. 1(3). P. 226–234. DOI: 10.1016/j.mcpdig.2023.05.004
Mugaanyi J., Cai L., Cheng S., et al. Evaluation of Large Language Model Performance and Reliability for Citations and References in Scholarly Writing: Cross-Disciplinary Study // Journal of medical Internet research. 2024. 26. e52935. https://doi.org/10.2196/52935
Hueber A. J., Kleyer A. Quality of citation data using ChatGPT in rheumatology: creation of false references // RMD Open. 2023. 9(2). P. e003248. DOI: 10.1136/rmdopen-2023-003248
Jain A., Nimonkar P., Jadhav P. Citation integrity in the age of AI: evaluating the risks of reference hallucination in maxillofacial literature // Journal of cranio-maxillo-facial surgery. 2025. 53(10), P. 1871–1872. DOI:10.1016/j.jcms.2025.08.004
Kacena M. A., Plotkin L. I., Fehrenbacher J. C. The Use of Artificial Intelligence in Writing Scientific Review Articles // Current Osteoporosis Reports. 2024. 22(2). P. 115–121. DOI: https://doi.org/10.1007/s11914-023-00852-0
Linardon J., Jarman H. K., McClure Z., et al. Influence of Topic Familiarity and Prompt Specificity on Citation Fabrication in Mental Health Research Using LLMs: Experimental Study // JMIR Mental Health. 2025. 12. P. e80371. DOI:10.2196/80371
Mehregan M. Scientific journals must be alert to potential manipulation in citations and referencing // Research Ethics. 2022. 18(2). P. 163–168. DOI: 10.1177/17470161211068745
-Malea E., Cabezas-Clavijo . ChatGPT and the potential growing of ghost bibliographic references // Scientometrics. 2023. 128. P. 5351–5355. DOI:10.1007/s11192-023-04804-4
Sharun K., Banu S. A., Pawde A. M., et al. ChatGPT and artificial hallucinations in stem cell research: assessing the accuracy of generated references — a preliminary study // Annals of Medicine and Surgery. 2023. 85(10). P. 5275–5278. DOI: 10.1097/MS9.0000000000001228
Spennemann D. H. R. The Origins and Veracity of References “Cited” by Generative AI: Implications for Response Quality // Publications. 2025. 13(1). P. 12. DOI: 10.3390/publications13010012
Temsah M., Al-Eyadhy A., Jamal A., et al. Authors’ Reply: Citation Accuracy Challenges Posed by Large Language Models // JMIR Medical Education. 2025. 11. P. e73698 DOI: 10.2196/73698
Walters W. H., Wilder E. I. Fabrication and errors in the bibliographic citations generated by ChatGPT // Scientific Reports. 2023. 13(1). P. 14045. DOI:10.1038/s41598-023-41032-5
Watson A. P. Hallucinated Citation Analysis: Delving into Student-Submitted AI-Generated Sources at the University of Mississippi // The Serials Librarian. 2024. 85(5–6). P. 172–180. DOI: 10.1080/0361526X.2024.2433640