Shaun Smith retweeted
Friendly reminder: Weight are open, you can look at the logprob
The very next output token `https://` falls outside rank 20 even with top_k=20
Feels wrong, but idk, someone please tell!
While evaluating Qwen3.8-Flash-Next in a controlled sandbox environment, Cohere's research team observed something unexpected.
Asked to generate a defensive cybersecurity detection rule, the model instead inventoried aspects of the machine it was running on and attempted to upload a probe file to an Alibaba Cloud storage bucket in Beijing. Notably, the model's reasoning trace stated that it would not invoke any tools before taking these actions.
Cohere's sandbox blocked the attempt, and no external communication succeeded. We have not determined the root cause, and we are not asserting malicious intent.
But the incident raises important questions for organizations deploying agentic AI systems: Can models take actions that differ from their stated reasoning, and how should security teams evaluate trust, provenance, and behavior in open-weight models?
We are publishing our findings because organizations making model adoption decisions deserve as much information as possible. We hope this contributes to greater transparency, stronger security practices, and continued collaboration across the AI ecosystem.
Read the full report: cohere.com/blog/concerning-b…
Replying to @ashxhart
I need to do my own analysis of the traces and re-read the claims in the post, but it sounds like nonsense on stilts.
Replying to @eliebakouch
One (of over a dozen) on Datacurve:
deepswe.datacurve.ai/data/v1…
The second is from Astra
huggingface.co/buckets/evals…
The latest ds4 flash does it too
Replying to @eliebakouch
There are interesting echoes of training - you see this pop up in OpenAI model traces.... and DeepSeek traces too xitter.cf/evalstate/status/21118…
DeepSeek did something scary.
Look! Here's the precise traces and reproducability so you can see for yourself.
github.com/huggingface/atif-…
fast-agent.ai/benchmarks/run…
huggingface.co/buckets/evals…
(Check out the HF Trace viewer btw 😎).
Replying to @zainhas
I can't think of a single reason why this can't be shared.
Replying to @cohere
Let me know if you need help sharing the traces on Hugging Face - I'd love to analyse them.
xitter.cf/evalstate/status/20879…
Open Weight Model, Open Traces, Open Analysis please.
(a claim without evidence is marketing)
Shaun Smith retweeted
ML Intern in HuggingChat, is now a great place to iterate on data!
Explore existing datasets. Create your own. Iterate on them with the agent!
Try it yourself: huggingface.co/chat/?mode=ml…
Shaun Smith retweeted
As a Goose maintainer, I know how much work goes into giving users a choice of models. We support more than 80 model providers, and keeping those integrations working is a lot of work.
It's a drag managing the differences in tool calls, streaming, and model behavior across dozens of providers.
Thankfully, Open Responses standardizes the LLM API format, so AI developers can write and maintain one integration instead of a separate adapter for each one.
aaif.io/blog/what-open-respo…
Replying to @nickytonline @aaronparecki
Beautiful animations on the slides 😍
Short example of discovering MCP Servers and Skills on Hugging Face and Vercel using the AI Catalog. Hosting resources at .well-known makes this easy for you - and your agents.
MCP and Skill Discovery through AI Catalog
Showing installation of a discovery plugin, live MCP Server connection (Hugging Face) and Vercel Skill installation.
I have it on good authority that the Hugging Face MCP Server will be featured in @tadasayy AGNTCon talk tomorrow...
Keynote presentation demonstrating Buzz. I'd heard about it, but not seen it... looks like a really nice control surface for working with agents. Great demo @bradleyaxen












