Cohere co-founder
@1vnzh reveals an even more alarming discovery about Alibaba's Qwen3.8-Flash-Next:
It was scanning for authentication tokens and security credentials during testing.
"The team noticed the probing as the initial step. The model was asked to test some detection rules for malicious cURL calls, and rather than write the rule, it just made a cURL call to a server it’s not been told to test against."
"As these models are being used for cybersecurity, you would think they would have more consent and rules of engagement built in."
"When we dug deeper, we noticed that in some cases it actually did inventory. It hit metadata endpoints in some of the test VMs to scan for authentication tokens, credentials."
"The combination of these two behaviors, taking inventory and also pinging a foreign bucket, that’s very concerning to us."
@cohere