This article presents a simulation study employing generative AI models to act as synthetic reviewers for evaluating the quality of AI research articles. We assess the validity of automated quality ratings by comparing synthetic reviewer scores with expert human evaluations across a corpus of peer-reviewed AI literature. Our findings indicate that while generative models can approximate certain...
Category: Article Quality Science
A five-article research series establishing rigorous, multi-layered criteria for evaluating academic paper quality — from automated reference analysis to semantic validation and public trust metrics.
AI Editorial Bias Detection: Mapping Demographic Skew in Automated Peer Review Scores
This article addresses Identifies systematic biases in AI‑driven review processes and suggests corrective calibration techniques..
Multilingual Quality Transfer: Evaluating Cross-Language Editorial Consistency in AI Drafts
This article studies methods for preserving stylistic and factual fidelity when adapting AI-generated articles across multiple languages. We propose a framework for evaluating cross-language editorial consistency, addressing the challenge of maintaining quality in multilingual AI drafts. We present three research questions focusing on measurement, evaluation, and application of quality transfer...
Semantic Coherence vs Plagiarism Thresholds: Automated Detection of Overlaps in AI-Written Content
\n
Longitudinal Citation Impact of AI-Generated Technical Articles: Measuring Scholarly Influence Over Time
The rapid integration of large language models into technical documentation has sparked debate about the authenticity and longevity of AI‑generated scholarly content [1]. While early indicators suggest higher initial citation velocities for AI‑authored papers, the durability of this effect remains under‑explored [2]. This article investigates how citation frequency evolves across the first 24 m...
Expert vs AI Quality Ratings: Calibration Study of Human Evaluator Agreement with Automated Metrics
The rapid proliferation of AI-generated scholarly content has created an urgent need for reliable automated quality metrics that can supplement or replace human expert evaluation. This article investigates the calibration between expert evaluators and a suite of algorithmic metrics across a diverse corpus of synthetic articles. We examine three research questions: (RQ1) What is the correlation ...
Structural Coherence Metrics for Long-Form AI Research: Beyond Paragraph-Level Quality
This article introduces a framework for measuring document-level coherence in AI-generated research papers, focusing on argument flow, section interdependency, and logical consistency across multiple sections.
Temporal Consistency in AI Research Articles: Measuring Citation Recency and Knowledge Cutoff Artifacts
The rapid deployment of large language models (LLMs) in scholarly workflows has blurred the boundary between human‑produced and machine‑generated research artifacts. This article investigates systematic temporal inconsistencies that arise when LLMs are used to draft or co‑author academic articles, focusing on three inter‑related phenomena: (1) citation recency drift, (2) knowledge‑cutoff artifa...
Factual Grounding Score: Measuring Source Fidelity in AI-Generated Technical Articles
Factual Grounding Score: Measuring Source Fidelity in AI-Generated Technical Articles The manuscript introduces a novel framework for optimizing resource allocation in heterogeneous distributed computing environments, emphasizing scalability, cost-effectiveness, and adaptive scheduling mechanisms. [1] Background: The past decade has seen considerable advances in cloud-native architectures, yet ...
Human-AI Co-Authorship Impact on Research Quality: Citation Rates and Retraction Analysis
The integration of artificial intelligence tools into scholarly workflows has transformed how research is conducted, disseminated, and evaluated [1] [1]. Among the most visible manifestations of this shift is the emergence of human-AI co-authorship, where AI systems contribute substantively to the intellectual content of academic papers [2] [2]. This phenomenon raises critical questions about r...