Category: Article Quality Science

A five-article research series establishing rigorous, multi-layered criteria for evaluating academic paper quality — from automated reference analysis to semantic validation and public trust metrics.

Public Trust Metrics for Research Platforms: From Badge Scores to Community Credibility

Posted on by
Quality Research
Quality Research by Oleh Ivchenko  ·  DOI: 10.5281/zenodo.19434311  80stabilfr·wdophcgmx
BadgeMetricValueStatusDescription
[s]Reviewed Sources64%○≥80% from editorially reviewed sources
[t]Trusted84%✓≥80% from verified, high-quality sources
[a]DOI72%○≥80% have a Digital Object Identifier
[b]CrossRef68%○≥80% indexed in CrossRef
[i]Indexed76%○≥80% have metadata indexed
[l]Academic72%○≥80% from journals/conferences/preprints
[f]Free Access96%✓≥80% are freely accessible
[r]References25 refs✓Minimum 10 references required
[w]Words [REQ]2,543✓Minimum 2,000 words for a full research article. Current: 2,543
[d]DOI [REQ]✓✓Zenodo DOI registered for persistent citation. DOI: 10.5281/zenodo.19434311
[o]ORCID [REQ]✓✓Author ORCID verified for academic identity
[p]Peer Reviewed [REQ]—✗Peer reviewed by an assigned reviewer
[h]Freshness [REQ]65%✓≥60% of references from 2025–2026. Current: 65%
[c]Data Charts4✓Original data charts from reproducible analysis (min 2). Current: 4
[g]Code✓✓Source code available on GitHub
[m]Diagrams3✓Mermaid architecture/flow diagrams. Current: 3
[x]Cited by0○Referenced by 0 other hub article(s)
Score = Ref Trust (81 × 60%) + Required (4/5 × 30%) + Optional (3/4 × 10%)

The credibility of research platforms depends not only on the quality of individual publications but on systematic, measurable signals that allow readers, institutions, and policymakers to calibrate trust. This article examines how multi-dimensional badge scoring systems — exemplified by the STABIL framework — translate article-level quality evidence into platform-level credibility, and how com...

Show moreHide
Quality Research by Oleh Ivchenko DOI: 10.5281/zenodo.19434311 80stabilfr·wdophcgmx
BadgeMetricValueStatusDescription
[s]Reviewed Sources64%○≥80% from editorially reviewed sources
[t]Trusted84%✓≥80% from verified, high-quality sources
[a]DOI72%○≥80% have a Digital Object Identifier
[b]CrossRef68%○≥80% indexed in CrossRef
[i]Indexed76%○≥80% have metadata indexed
[l]Academic72%○≥80% from journals/conferences/preprints
[f]Free Access96%✓≥80% are freely accessible
[r]References25 refs✓Minimum 10 references required
[w]Words [REQ]2,543✓Minimum 2,000 words for a full research article. Current: 2,543
[d]DOI [REQ]✓✓Zenodo DOI registered for persistent citation. DOI: 10.5281/zenodo.19434311
[o]ORCID [REQ]✓✓Author ORCID verified for academic identity
[p]Peer Reviewed [REQ]—✗Peer reviewed by an assigned reviewer
[h]Freshness [REQ]65%✓≥60% of references from 2025–2026. Current: 65%
[c]Data Charts4✓Original data charts from reproducible analysis (min 2). Current: 4
[g]Code✓✓Source code available on GitHub
[m]Diagrams3✓Mermaid architecture/flow diagrams. Current: 3
[x]Cited by0○Referenced by 0 other hub article(s)
Score = Ref Trust (81 × 60%) + Required (4/5 × 30%) + Optional (3/4 × 10%)
Article Quality Sc…Read More
Read more

Peer Review Automation: Combining Rule-Based Validation with LLM-Assisted Quality Assessment

Posted on by
Quality Research
Quality Research by Oleh Ivchenko  ·  DOI: 10.5281/zenodo.19433308  60stabilfr·wdophcgmx
BadgeMetricValueStatusDescription
[s]Reviewed Sources6%○≥80% from editorially reviewed sources
[t]Trusted78%○≥80% from verified, high-quality sources
[a]DOI17%○≥80% have a Digital Object Identifier
[b]CrossRef6%○≥80% indexed in CrossRef
[i]Indexed28%○≥80% have metadata indexed
[l]Academic56%○≥80% from journals/conferences/preprints
[f]Free Access100%✓≥80% are freely accessible
[r]References18 refs✓Minimum 10 references required
[w]Words [REQ]3,607✓Minimum 2,000 words for a full research article. Current: 3,607
[d]DOI [REQ]✓✓Zenodo DOI registered for persistent citation. DOI: 10.5281/zenodo.19433308
[o]ORCID [REQ]✓✓Author ORCID verified for academic identity
[p]Peer Reviewed [REQ]—✗Peer reviewed by an assigned reviewer
[h]Freshness [REQ]67%✓≥60% of references from 2025–2026. Current: 67%
[c]Data Charts4✓Original data charts from reproducible analysis (min 2). Current: 4
[g]Code✓✓Source code available on GitHub
[m]Diagrams3✓Mermaid architecture/flow diagrams. Current: 3
[x]Cited by0○Referenced by 0 other hub article(s)
Score = Ref Trust (47 × 60%) + Required (4/5 × 30%) + Optional (3/4 × 10%)

The scalability crisis in academic peer review — where submission volumes grow 8–12% annually while reviewer pools stagnate — demands systematic automation without sacrificing the scientific rigor that peer review is designed to enforce. This article examines how hybrid systems combining deterministic rule-based validators with large language model (LLM)-assisted semantic evaluation can address...

Show moreHide
Quality Research by Oleh Ivchenko DOI: 10.5281/zenodo.19433308 60stabilfr·wdophcgmx
BadgeMetricValueStatusDescription
[s]Reviewed Sources6%○≥80% from editorially reviewed sources
[t]Trusted78%○≥80% from verified, high-quality sources
[a]DOI17%○≥80% have a Digital Object Identifier
[b]CrossRef6%○≥80% indexed in CrossRef
[i]Indexed28%○≥80% have metadata indexed
[l]Academic56%○≥80% from journals/conferences/preprints
[f]Free Access100%✓≥80% are freely accessible
[r]References18 refs✓Minimum 10 references required
[w]Words [REQ]3,607✓Minimum 2,000 words for a full research article. Current: 3,607
[d]DOI [REQ]✓✓Zenodo DOI registered for persistent citation. DOI: 10.5281/zenodo.19433308
[o]ORCID [REQ]✓✓Author ORCID verified for academic identity
[p]Peer Reviewed [REQ]—✗Peer reviewed by an assigned reviewer
[h]Freshness [REQ]67%✓≥60% of references from 2025–2026. Current: 67%
[c]Data Charts4✓Original data charts from reproducible analysis (min 2). Current: 4
[g]Code✓✓Source code available on GitHub
[m]Diagrams3✓Mermaid architecture/flow diagrams. Current: 3
[x]Cited by0○Referenced by 0 other hub article(s)
Score = Ref Trust (47 × 60%) + Required (4/5 × 30%) + Optional (3/4 × 10%)
Article Quality Sc…Read More
Read more

Freshness Decay in Academic References: Measuring Citation Shelf Life Across AI Research Domains

Posted on by
Quality Research
Quality Research by Oleh Ivchenko  ·  DOI: 10.5281/zenodo.19428758  60stabilfr·wdophcgmx
BadgeMetricValueStatusDescription
[s]Reviewed Sources0%○≥80% from editorially reviewed sources
[t]Trusted47%○≥80% from verified, high-quality sources
[a]DOI24%○≥80% have a Digital Object Identifier
[b]CrossRef6%○≥80% indexed in CrossRef
[i]Indexed71%○≥80% have metadata indexed
[l]Academic53%○≥80% from journals/conferences/preprints
[f]Free Access100%✓≥80% are freely accessible
[r]References17 refs✓Minimum 10 references required
[w]Words [REQ]2,335✓Minimum 2,000 words for a full research article. Current: 2,335
[d]DOI [REQ]✓✓Zenodo DOI registered for persistent citation. DOI: 10.5281/zenodo.19428758
[o]ORCID [REQ]✓✓Author ORCID verified for academic identity
[p]Peer Reviewed [REQ]—✗Peer reviewed by an assigned reviewer
[h]Freshness [REQ]73%✓≥60% of references from 2025–2026. Current: 73%
[c]Data Charts4✓Original data charts from reproducible analysis (min 2). Current: 4
[g]Code✓✓Source code available on GitHub
[m]Diagrams3✓Mermaid architecture/flow diagrams. Current: 3
[x]Cited by0○Referenced by 0 other hub article(s)
Score = Ref Trust (48 × 60%) + Required (4/5 × 30%) + Optional (3/4 × 10%)

The lifespan of a scientific reference is finite. In fast-moving fields like artificial intelligence, a citation that was cutting-edge eighteen months ago may today represent outdated or superseded knowledge. This article introduces the concept of freshness decay — the progressive reduction in the epistemic relevance of a reference as its publication age increases — and develops a quantitative ...

Show moreHide
Quality Research by Oleh Ivchenko DOI: 10.5281/zenodo.19428758 60stabilfr·wdophcgmx
BadgeMetricValueStatusDescription
[s]Reviewed Sources0%○≥80% from editorially reviewed sources
[t]Trusted47%○≥80% from verified, high-quality sources
[a]DOI24%○≥80% have a Digital Object Identifier
[b]CrossRef6%○≥80% indexed in CrossRef
[i]Indexed71%○≥80% have metadata indexed
[l]Academic53%○≥80% from journals/conferences/preprints
[f]Free Access100%✓≥80% are freely accessible
[r]References17 refs✓Minimum 10 references required
[w]Words [REQ]2,335✓Minimum 2,000 words for a full research article. Current: 2,335
[d]DOI [REQ]✓✓Zenodo DOI registered for persistent citation. DOI: 10.5281/zenodo.19428758
[o]ORCID [REQ]✓✓Author ORCID verified for academic identity
[p]Peer Reviewed [REQ]—✗Peer reviewed by an assigned reviewer
[h]Freshness [REQ]73%✓≥60% of references from 2025–2026. Current: 73%
[c]Data Charts4✓Original data charts from reproducible analysis (min 2). Current: 4
[g]Code✓✓Source code available on GitHub
[m]Diagrams3✓Mermaid architecture/flow diagrams. Current: 3
[x]Cited by0○Referenced by 0 other hub article(s)
Score = Ref Trust (48 × 60%) + Required (4/5 × 30%) + Optional (3/4 × 10%)
Article Quality Sc…Read More
Read more

The STABIL Badge System: A Multi-Dimensional Framework for Quantifying Research Article Trust

Posted on by
Quality Research
Quality Research by Oleh Ivchenko  ·  DOI: 10.5281/zenodo.19427380  63stabilfr·wdophcgmx
BadgeMetricValueStatusDescription
[s]Reviewed Sources6%○≥80% from editorially reviewed sources
[t]Trusted81%✓≥80% from verified, high-quality sources
[a]DOI38%○≥80% have a Digital Object Identifier
[b]CrossRef6%○≥80% indexed in CrossRef
[i]Indexed31%○≥80% have metadata indexed
[l]Academic50%○≥80% from journals/conferences/preprints
[f]Free Access88%✓≥80% are freely accessible
[r]References16 refs✓Minimum 10 references required
[w]Words [REQ]2,223✓Minimum 2,000 words for a full research article. Current: 2,223
[d]DOI [REQ]✓✓Zenodo DOI registered for persistent citation. DOI: 10.5281/zenodo.19427380
[o]ORCID [REQ]✓✓Author ORCID verified for academic identity
[p]Peer Reviewed [REQ]—✗Peer reviewed by an assigned reviewer
[h]Freshness [REQ]69%✓≥60% of references from 2025–2026. Current: 69%
[c]Data Charts3✓Original data charts from reproducible analysis (min 2). Current: 3
[g]Code✓✓Source code available on GitHub
[m]Diagrams3✓Mermaid architecture/flow diagrams. Current: 3
[x]Cited by0○Referenced by 0 other hub article(s)
Score = Ref Trust (53 × 60%) + Required (4/5 × 30%) + Optional (3/4 × 10%)

In the previous article, we established that automated citation validation using CrossRef, DOI resolution, and source classification provides a quantitative foundation for reference quality assessment. Building on that foundation, this article introduces the STABIL badge system — a multi-dimensional scoring framework designed to quantify the overall trustworthiness of scientific research articl...

Show moreHide
Quality Research by Oleh Ivchenko DOI: 10.5281/zenodo.19427380 63stabilfr·wdophcgmx
BadgeMetricValueStatusDescription
[s]Reviewed Sources6%○≥80% from editorially reviewed sources
[t]Trusted81%✓≥80% from verified, high-quality sources
[a]DOI38%○≥80% have a Digital Object Identifier
[b]CrossRef6%○≥80% indexed in CrossRef
[i]Indexed31%○≥80% have metadata indexed
[l]Academic50%○≥80% from journals/conferences/preprints
[f]Free Access88%✓≥80% are freely accessible
[r]References16 refs✓Minimum 10 references required
[w]Words [REQ]2,223✓Minimum 2,000 words for a full research article. Current: 2,223
[d]DOI [REQ]✓✓Zenodo DOI registered for persistent citation. DOI: 10.5281/zenodo.19427380
[o]ORCID [REQ]✓✓Author ORCID verified for academic identity
[p]Peer Reviewed [REQ]—✗Peer reviewed by an assigned reviewer
[h]Freshness [REQ]69%✓≥60% of references from 2025–2026. Current: 69%
[c]Data Charts3✓Original data charts from reproducible analysis (min 2). Current: 3
[g]Code✓✓Source code available on GitHub
[m]Diagrams3✓Mermaid architecture/flow diagrams. Current: 3
[x]Cited by0○Referenced by 0 other hub article(s)
Score = Ref Trust (53 × 60%) + Required (4/5 × 30%) + Optional (3/4 × 10%)
Article Quality Sc…Read More
Read more

Reference Quality Analysis: Automated Validation of Academic Citations Using CrossRef, DOI, and Source Classification

Posted on by
Quality Research
Quality Research by Oleh Ivchenko  ·  DOI: 10.5281/zenodo.19341350  62stabilfr·wdophcgmx
BadgeMetricValueStatusDescription
[s]Reviewed Sources14%○≥80% from editorially reviewed sources
[t]Trusted71%○≥80% from verified, high-quality sources
[a]DOI29%○≥80% have a Digital Object Identifier
[b]CrossRef14%○≥80% indexed in CrossRef
[i]Indexed43%○≥80% have metadata indexed
[l]Academic79%○≥80% from journals/conferences/preprints
[f]Free Access100%✓≥80% are freely accessible
[r]References14 refs✓Minimum 10 references required
[w]Words [REQ]3,001✓Minimum 2,000 words for a full research article. Current: 3,001
[d]DOI [REQ]✓✓Zenodo DOI registered for persistent citation. DOI: 10.5281/zenodo.19341350
[o]ORCID [REQ]✓✓Author ORCID verified for academic identity
[p]Peer Reviewed [REQ]—✗Peer reviewed by an assigned reviewer
[h]Freshness [REQ]62%✓≥60% of references from 2025–2026. Current: 62%
[c]Data Charts0○Original data charts from reproducible analysis (min 2). Current: 0
[g]Code✓✓Source code available on GitHub
[m]Diagrams2✓Mermaid architecture/flow diagrams. Current: 2
[x]Cited by0○Referenced by 0 other hub article(s)
Score = Ref Trust (55 × 60%) + Required (4/5 × 30%) + Optional (2/4 × 10%)

Academic citation integrity is a foundational requirement for trustworthy research publishing. Yet the manual verification of hundreds of references per article is neither scalable nor consistent. This article describes the automated reference validation system deployed on the Stabilarity Research Hub — a multi-layer pipeline that combines CrossRef DOI lookup, HTTP status probing, source classi...

Show moreHide
Quality Research by Oleh Ivchenko DOI: 10.5281/zenodo.19341350 62stabilfr·wdophcgmx
BadgeMetricValueStatusDescription
[s]Reviewed Sources14%○≥80% from editorially reviewed sources
[t]Trusted71%○≥80% from verified, high-quality sources
[a]DOI29%○≥80% have a Digital Object Identifier
[b]CrossRef14%○≥80% indexed in CrossRef
[i]Indexed43%○≥80% have metadata indexed
[l]Academic79%○≥80% from journals/conferences/preprints
[f]Free Access100%✓≥80% are freely accessible
[r]References14 refs✓Minimum 10 references required
[w]Words [REQ]3,001✓Minimum 2,000 words for a full research article. Current: 3,001
[d]DOI [REQ]✓✓Zenodo DOI registered for persistent citation. DOI: 10.5281/zenodo.19341350
[o]ORCID [REQ]✓✓Author ORCID verified for academic identity
[p]Peer Reviewed [REQ]—✗Peer reviewed by an assigned reviewer
[h]Freshness [REQ]62%✓≥60% of references from 2025–2026. Current: 62%
[c]Data Charts0○Original data charts from reproducible analysis (min 2). Current: 0
[g]Code✓✓Source code available on GitHub
[m]Diagrams2✓Mermaid architecture/flow diagrams. Current: 2
[x]Cited by0○Referenced by 0 other hub article(s)
Score = Ref Trust (55 × 60%) + Required (4/5 × 30%) + Optional (2/4 × 10%)
Article Quality Sc…Read More
Read more