News · Science & research

Evidence on securing open-source AI is thin before models are released, a UK-commissioned review finds

Of 14,561 academic records screened, 43 met the review's criteria. Research is strong on attacks against deployed systems, it says, but nearly silent on how models are trained, documented and distributed.

Catching up: the original came out on . This story was published later, when the site opened.

Research barely covers how open-source AI is secured before release, a UK review finds

Grade 2 · Published method

Source: University of Greenwich for the Department for Culture, Media and Sport (UK)

What changed
A review for the UK government by the University of Greenwich found the evidence on governing open-source AI before deployment is sparse.
Who it affects
Academic studies and official and industry reports on open-source software and AI security published from 2020 to 2026, plus an analysis of GitHub and Hugging Face.
What it does not tell you
What the UK will do. The report is independent research commissioned by the government and does not represent its policy.

The full story Check the source

Research on how open-source AI is defined, governed, documented and distributed before deployment is sparse, according to a review for the UK government published on 7 September [1].

The review, by researchers at the University of Greenwich, found academic work strong on downstream risks, such as detecting intrusions and making models robust to attack [1].

But it found the work "near-silent" on how models are trained, what data they use and how weights are distributed [1].

It found definitions of open-source AI inconsistent across governments, industry and academia, and says that inconsistency is itself a governance risk: "Where the definition stops, security responsibility disappears" [1].

What it measures

Published literature from 2020 to 2026. The academic search covered eight databases and screened 14,561 records, of which 43 met the criteria [1].

It also reviewed 172 reports from national cyber security authorities, standards bodies, international organisations and open-source groups, and analysed GitHub and Hugging Face [1].

It points to the Open-Source AI Definition 1.0 of October 2024, which requires training-data information, source code and model parameters to be released together, as the most comprehensive definition available [1].

What it does not tell you

What the UK government will do. The report says it does not represent government policy [1].

How secure open-source AI actually is. It reviews what has been studied, not the systems themselves [1].

Sources and their grades

  1. University of Greenwich for the Department for Culture, Media and Sport (UK), A study of cybersecurity literature on open-source software and AI. Read 29 September 2026. Grade 2 · Published method Published 7 September 2026. A systematic review with its method published (PRISMA); commissioned by the government, which says it does not represent policy.

A grade says how much weight a source will take, from 1 (a body that can compel an answer and has nothing to sell) to 5 (somebody describing what they sell, or themselves). The standard sets out what each grade may be used for.

Filed under AI, Cybersecurity, Open source

Comments

Commenting needs an account, made with nothing but an email address. A first comment is read before it appears.

More news

See all