"Can AI meaningfully help with bioweapons creation? On our new Virology Capabilities Test (VCT), frontier LLMs display the expert-level tacit knowledge needed to troubleshoot wet lab protocols."
OpenAI’s o3 now outperforms 94% of expert virologists." -- thread by a co-author, https://x.com/DanHendrycks/status/1914696657813561799
Paper: Virology Capabilities Test (VCT): A Multimodal Virology Q&A Benchmark
https://www.virologytest.ai/vct_paper.pdf
"Can AI meaningfully help with bioweapons creation? On our new Virology Capabilities Test (VCT), frontier LLMs display the expert-level tacit knowledge needed to troubleshoot wet lab protocols."
OpenAI’s o3 now outperforms 94% of expert virologists." -- thread by a co-author, https://x.com/DanHendrycks/status/1914696657813561799
Paper: Virology Capabilities Test (VCT): A Multimodal Virology Q&A Benchmark
https://www.virologytest.ai/vct_paper.pdf