Open Source Research
Open Source Research by Oleh Ivchenko · DOI: 10.5281/zenodo.23560178 86stabilfr·wuedophcgmx
| Badge | Metric | Value | Status | Description |
|---|---|---|---|---|
| [s] | Reviewed Sources | 19% | ○ | ≥80% from editorially reviewed sources |
| [t] | Trusted | 91% | ✓ | ≥80% from verified, high-quality sources |
| [a] | DOI | 78% | ○ | ≥80% have a Digital Object Identifier |
| [b] | CrossRef | 19% | ○ | ≥80% indexed in CrossRef |
| [i] | Indexed | 75% | ○ | ≥80% have metadata indexed |
| [l] | Academic | 81% | ✓ | ≥80% from journals/conferences/preprints |
| [f] | Free Access | 100% | ✓ | ≥80% are freely accessible |
| [r] | References | 32 refs | ✓ | Minimum 10 references required |
| [w] | Words [REQ] | 4,314 | ✓ | Minimum 1,000 words of article body. Current: 4,314 |
| [u] | Original [REQ] | 100% | ✓ | ≥85% unique sentences (no padding or repeated blocks) and no leaked drafting notes. Current: 100% unique |
| [e] | Evidence [REQ] | 27 | ✓ | Cites at least 1 external source(s): links, DOIs or a reference list. Current: 27 |
| [d] | DOI [REQ] | ✓ | ✓ | Zenodo DOI registered for persistent citation. DOI: 10.5281/zenodo.23560178 |
| [o] | ORCID | ✓ | ✓ | Author ORCID verified for academic identity |
| [p] | Peer Reviewed | — | ○ | Peer reviewed by an assigned reviewer |
| [h] | Freshness | 64% | ✓ | ≥60% of references from 2025–2026. Current: 64% |
| [c] | Data Charts | 4 | ✓ | Original data charts from reproducible analysis (min 2). Current: 4 |
| [g] | Code | ✓ | ✓ | Source code available on GitHub |
| [m] | Diagrams | 3 | ✓ | Mermaid architecture/flow diagrams. Current: 3 |
| [x] | Cited by | 0 | ○ | Referenced by 0 other hub article(s) |
Score = Ref Trust (81 × 60%) + Required (4/4 × 30%) + Optional (5/7 × 10%)
Open-weight models let anyone compute token probabilities, but their training corpora are rarely public, so claims about training data are hard to check. We ask what a third party holding only the weights can verify. We scored 2,400 matched member and non-member documents from the Pile train and test splits, 400 Wikipedia articles created in October 2026 and the WikiMIA benchmark with three Pyt...
Show moreHideOpen Source Research by Oleh Ivchenko DOI: 10.5281/zenodo.23560178 86stabilfr·wuedophcgmx
Trusted Open SourceRead More| Badge | Metric | Value | Status | Description |
|---|---|---|---|---|
| [s] | Reviewed Sources | 19% | ○ | ≥80% from editorially reviewed sources |
| [t] | Trusted | 91% | ✓ | ≥80% from verified, high-quality sources |
| [a] | DOI | 78% | ○ | ≥80% have a Digital Object Identifier |
| [b] | CrossRef | 19% | ○ | ≥80% indexed in CrossRef |
| [i] | Indexed | 75% | ○ | ≥80% have metadata indexed |
| [l] | Academic | 81% | ✓ | ≥80% from journals/conferences/preprints |
| [f] | Free Access | 100% | ✓ | ≥80% are freely accessible |
| [r] | References | 32 refs | ✓ | Minimum 10 references required |
| [w] | Words [REQ] | 4,314 | ✓ | Minimum 1,000 words of article body. Current: 4,314 |
| [u] | Original [REQ] | 100% | ✓ | ≥85% unique sentences (no padding or repeated blocks) and no leaked drafting notes. Current: 100% unique |
| [e] | Evidence [REQ] | 27 | ✓ | Cites at least 1 external source(s): links, DOIs or a reference list. Current: 27 |
| [d] | DOI [REQ] | ✓ | ✓ | Zenodo DOI registered for persistent citation. DOI: 10.5281/zenodo.23560178 |
| [o] | ORCID | ✓ | ✓ | Author ORCID verified for academic identity |
| [p] | Peer Reviewed | — | ○ | Peer reviewed by an assigned reviewer |
| [h] | Freshness | 64% | ✓ | ≥60% of references from 2025–2026. Current: 64% |
| [c] | Data Charts | 4 | ✓ | Original data charts from reproducible analysis (min 2). Current: 4 |
| [g] | Code | ✓ | ✓ | Source code available on GitHub |
| [m] | Diagrams | 3 | ✓ | Mermaid architecture/flow diagrams. Current: 3 |
| [x] | Cited by | 0 | ○ | Referenced by 0 other hub article(s) |
Score = Ref Trust (81 × 60%) + Required (4/4 × 30%) + Optional (5/7 × 10%)