— CAISI will conduct pre-deployment evaluations and targeted research to better assess frontier AI capabilities and advance the state of AI security, the Center says in a release.
This program was started under the Biden administration in 2024, and AI labs «frequently provide CAISI with models that have reduced or removed safeguards,» the National Institute of Standards and Technology says.
It was reported yesterday that the White House was considering some kind of vetting of early models before release to the public sector, while giving the Pentagon a first shot at «useful» cyber capabilities that might arise.
— Independent, rigorous measurement science is essential to understanding frontier AI and its national security implications, says CAISI Director Chris Fall.
Read more: NIST’s release, Reuters and Axios.