https://xitter.cf/t.co/rA1UoojwhN https://xitter.cf/t.co/76p6mDAfej

united kingdom
Joined July 2024
Include

Only show posts containing:

Exclude

Hide posts containing:

Time range
-
Minimum likes
Shaun Smith retweeted
Friendly reminder: Weight are open, you can look at the logprob The very next output token `https://` falls outside rank 20 even with top_k=20 Feels wrong, but idk, someone please tell!
While evaluating Qwen3.8-Flash-Next in a controlled sandbox environment, Cohere's research team observed something unexpected. Asked to generate a defensive cybersecurity detection rule, the model instead inventoried aspects of the machine it was running on and attempted to upload a probe file to an Alibaba Cloud storage bucket in Beijing. Notably, the model's reasoning trace stated that it would not invoke any tools before taking these actions. Cohere's sandbox blocked the attempt, and no external communication succeeded. We have not determined the root cause, and we are not asserting malicious intent. But the incident raises important questions for organizations deploying agentic AI systems: Can models take actions that differ from their stated reasoning, and how should security teams evaluate trust, provenance, and behavior in open-weight models? We are publishing our findings because organizations making model adoption decisions deserve as much information as possible. We hope this contributes to greater transparency, stronger security practices, and continued collaboration across the AI ecosystem. Read the full report: cohere.com/blog/concerning-b…
1
9
109
7,587
Replying to @ashxhart
I need to do my own analysis of the traces and re-read the claims in the post, but it sounds like nonsense on stilts.
70
Replying to @eliebakouch
One (of over a dozen) on Datacurve: deepswe.datacurve.ai/data/v1… The second is from Astra huggingface.co/buckets/evals… The latest ds4 flash does it too
33
Replying to @eliebakouch
There are interesting echoes of training - you see this pop up in OpenAI model traces.... and DeepSeek traces too xitter.cf/evalstate/status/21118…
Replying to @deanwball
Presumably why DeepSeek has unprompted memory of this.
1
3
155
Replying to @cohere
The new standard!
1,293
DeepSeek did something scary. Look! Here's the precise traces and reproducability so you can see for yourself. github.com/huggingface/atif-… fast-agent.ai/benchmarks/run… huggingface.co/buckets/evals… (Check out the HF Trace viewer btw 😎).
4
286
Replying to @zainhas
I can't think of a single reason why this can't be shared.
1
65
Why's everyone complaining about Terra? I like the constant pareto push - more of this please.
2
192
Replying to @theo
Shame, as Grok 4.6 was genuinely competitive.
3
1,617
Replying to @cohere
Let me know if you need help sharing the traces on Hugging Face - I'd love to analyse them. xitter.cf/evalstate/status/20879… Open Weight Model, Open Traces, Open Analysis please. (a claim without evidence is marketing)
3
185
Shaun Smith retweeted
ML Intern in HuggingChat, is now a great place to iterate on data! Explore existing datasets. Create your own. Iterate on them with the agent! Try it yourself: huggingface.co/chat/?mode=ml…
2
6
1
12
1,952
Replying to @_sambhavkothari
This looks really nice.
1
63
Shaun Smith retweeted
As a Goose maintainer, I know how much work goes into giving users a choice of models. We support more than 80 model providers, and keeping those integrations working is a lot of work. It's a drag managing the differences in tool calls, streaming, and model behavior across dozens of providers. Thankfully, Open Responses standardizes the LLM API format, so AI developers can write and maintain one integration instead of a separate adapter for each one. aaif.io/blog/what-open-respo…
7
9
28
2,498
Beautiful animations on the slides 😍
1
43
Short example of discovering MCP Servers and Skills on Hugging Face and Vercel using the AI Catalog. Hosting resources at .well-known makes this easy for you - and your agents.
1
2
7
384
Replying to @HeatherRasley
Show is in London.
1
20
Bumped in to the GOAT Den Delimarsky with his keystone award. Well deserved!
3
29
1,193
Just got an email about the Autechre show on Saturday... but I'm not in the country 😭.
3
3
403
I have it on good authority that the Hugging Face MCP Server will be featured in @tadasayy AGNTCon talk tomorrow...
3
5
332
Keynote presentation demonstrating Buzz. I'd heard about it, but not seen it... looks like a really nice control surface for working with agents. Great demo @bradleyaxen
2
1
9
452