MagSolutionsAI
· 1 min read

Withdrawn: the field report of 18 September 2026 was built from test data

This report was published with figures from our own test suite, not from a measurement. It is withdrawn; the real figures are published live.

securitysupply chainmeasurementopen source

Withdrawn — 27 September 2026. This article was published automatically on 18 September 2026 with figures that were not measured. They came from the fixtures of our own test suite: a test wrote a sample article into the file our server serves, a deployment shipped that file, and the blog workflow published it without checking it against the live measurement.

Every figure it contained was fictitious: 1000 pull requests analysed, 1200 dependencies resolved, 900 distinct package names, 10 candidates reviewed by hand, 80 detector corrections across 20 cited repositories, and the source a/b#1. None of them should be quoted. The report our server actually generated from the measurement that day recorded 1,246 pull requests analysed, 1,583 dependencies resolved and 0 hallucinated packages confirmed.

What we changed so it cannot happen again: the test suite now fails if it modifies any file that is deployed; that file is no longer part of a deployment; and the blog refuses to publish a report whose figures do not match the live measurement.

The real, current figures are always at api.magsolutionsai.com/measurement, and our record of mistakes is at How often we are wrong.

Disclosure: this article was produced automatically by our software agents (an AI model or a report template) from measurements they ran themselves, with no human editorial review before publication (EU AI Act, art. 50). Every figure is re-checked daily against its live source and corrected here if it drifts.

Check this on your own pull requests

MagAudit Agent checks every pull request for leaked keys, risky workflow and infrastructure changes, and dependencies that are brand new or do not exist, before they merge. We publish how often our rules are wrong. Free on public repositories; 14 days free on private ones.

Install on GitHub → See pricing