DTInnovate (@FsInnovate) header
DTInnovate (@FsInnovate) profile picture
Global
Joined December 2019
Photo by DTInnovate (@FsInnovate)Photo by DTInnovate (@FsInnovate)Photo by DTInnovate (@FsInnovate)Photo by DTInnovate (@FsInnovate)Photo by DTInnovate (@FsInnovate)Photo by DTInnovate (@FsInnovate)Photo by DTInnovate (@FsInnovate)
Chain-of-thought transformed AI reasoning, but it is limited to words. What's the physical-world analogue? Introducing Ψ-0.6, one model that reasons in *streams of thought*: words, depth, motion, camera pose, and imagined scenes. And it learns when to use which! 🧵
17
55
12
383
35,886
UniAction approach to #robotic training takes a comprehensive route, where it takes into account force, camera positioning , hand movement of the robot at any given time, instead of compartmentalizing and training one aspect at a time. Apparently offers greater accuracy & physics laws aren't compromised either. (Can't say if it's faster or less compute intensive...but in layman's world- comprehensive models do make more sense than specializing on one trait at a time).
Replying to @zizhang_li
🔑 The key idea: reuse the pretrained 3D RoPE. Instead of learning where actions live, we place each action element in the video model's own positional space and rotate it exactly like the video tokens. Action–video relations then ride on relations learned from large-scale video pretraining. That's why UniAction follows actions precisely after training on just 10K clips per action type. 🧵 4/10
15
DTInnovate retweeted
🌍 Actions that condition world models are highly heterogeneous: forces on objects, camera movements, hand motions, robot arms, each with its own meaning and structure. So today's action-conditioned world models are usually built one action type at a time, each with its own conditioning design. We introduce UniAction, a unified action-conditioning framework: one world model driven by all of these actions, and even by mixes of them in a single generation. Trained jointly, it outperforms the action-specific experts. Great work led by amazing @BowenXue_ . More detailed threads below👇 🧵 1/10
8
33
1
151
8,552
DTInnovate retweeted
All demonstrations and interventions were collected using Northstar ARC, our VR teleoperation and intervention stack. We're building the infrastructure to help robotics teams identify failures, collect targeted data, evaluate policies after they’ve been deployed, and continuously improve reliability.
1
1
16
550
Was just a matter of time. #AgenticAI for #Robots (#WAM), but obviously, efficacy will be significantly influenced by harness (& compute) & will probably be accompanied by unforeseen, unanticipated #security lapses. Excited to read this paper. Can this work via #edge devices? #AI
We're excited to introduce AW-0: Agentic World Action Models! 🤖 (0/8) The first World Action Model that plans in code, predicts the future, and controls the robot—all in one generative model. AW-0 jointly generates: 🧠 Code - explicit skill calls, object arguments, and control flow 🎥 Future video - predictive visual dynamics 🦾 Robot actions - continuous motor control All three are generated together through joint denoising, letting semantic plans directly shape both predicted futures and robot behavior, with: 🤝 Hybrid execution — generated programs can also run directly through perception and control APIs ⚡ Just 40 ms of additional inference latency over the base WAM on an RTX 5090 📚 Pretrained on ~3,000 hours of robot + human demonstrations One model for planning, prediction, and execution. 🌐 Project: agentic-wam.github.io/ 📄 Paper: arxiv.org/abs/2610.30136v1 💻 Code: github.com/ZhuoyangLiu2005/a… 🤗 Model: huggingface.co/miniFranka/ag… 🧵 How it works—and what we found ↓
60
DTInnovate retweeted
"Agentic World Action Models" What if robots could write their own code to plan actions, while also predicting how the physical world will respond? NVIDIA's new AW-0 combines three capabilities in one model: generating reusable skill programs, predicting future video frames, and producing robot actions. All three are generated together, which enables code-based planning to guide physical execution. On RoboTwin 2.0, AW-0 achieves 50.7% average success, compared to 41.3% for π0.5. Across eight real-world manipulation tasks, it scores 71.1% vs 46.0% for the strongest baseline, including tasks like folding towels and solving a Rubik's Cube. alphaxiv.org/abs/2610.30136
12
42
1
348
17,323
LATEST: Staff at Sweden's Government Offices lose browser access to OpenAi ChatGPT and Anthropic Claude on their work computers from 26th October, per an email the offices sent to Sveriges Television. The offices serve the Prime Minister and cabinet. Staff are being steered to Microsoft's Copilot. The offices approved it and raised its security after a review, per Sveriges Radio. The press office would not give details, citing security. Digitalisation director Mikael Wettercrantz wrote on the staff intranet that AI use without a contract could bring “consequences for our information security” per Sveriges Radio (translated from Swedish). The models themselves stay. The offices told Sveriges Television that staff can still use ChatGPT and Claude through a platform called Intric. Blocks are already in place at Sweden's Tax Agency and its National Board of Institutional Care. The Enforcement Authority is weighing one. The offices had earlier restricted China's DeepSeek, per Sveriges Radio. The block is on the browser. The dividing line is the contract.
12
8
2
39
14,301
DTInnovate retweeted
During this red-teaming exercise, we also found a vulnerability that allows for unauthenticated remote code execution in Brotli, a widely-deployed compression library included in many pieces of software such as Node.js, Bun, and Envoy. The flaw could let an attacker run their own code on affected systems by sending or replying with malicious compressed data, without any need to create a user account. That is, an unpatched server that accepts compressed input could be taken over by a malicious client, and an unpatched client that accepts compressed input (such as “curl --compressed”) could be taken over by a malicious server. This root cause issue was actually fixed in the Brotli source code in February, but it wasn’t known at the time that it gave rise to a security vulnerability and there was no more recent release of Brotli. Since Brotli is built into other software, any software which includes this library needs to take the update too, followed by the users of that software. We disclosed the vulnerability to Brotli and other downstream projects such as Node.js, which released or are currently releasing security updates, and Brotli cut new release versions and published a CVE. More details on the patch and mitigations below: patchtheplanet.org/brotli
Over the past several months, we have substantially hardened the security of our research training environment. We’ve removed live internet access for all frontier models during training and built an offline world for them to use instead—a cached version of the web where they can still learn to browse, search, and use applications. On September 20, after a model exploited a DNS misconfiguration to find a way outside of this offline world, we paused frontier training to strengthen containment further. We assembled teams of agents, powered by our most cyber-capable models, and tasked them with finding weaknesses in our research environments. While they found no route to the internet they could easily exploit while concealing their activity from our monitors, they did find zero-day vulnerabilities, virtual machine escapes, and hardware side-channels for communication between agents. We used their discoveries to further strengthen our defenses and contribute fixes to open-source software. After strengthening our containment architecture, we resumed our frontier RL training and inference on October 1. We’ve reserved substantial compute for continuous red-teaming, and made high-compute red-teaming part of the safety cases we use to decide whether frontier training and evaluation can proceed securely. openai.com/index/securing-ou…
573
1,012
500
7,093
2,187,583
Yikes. This week was / is looking promising with both, @nvidia (#OpenAgent Safety Platform #OpenShell reference Architecture) and @Microsoft (#ProjectPerception) taking practical measures to isolate corrupt agents & offering 24/7 continuous surveillance & selective permission. But, now reports of possibly compromised bank accounts after uncovering PHP vulnerabilities, implies that agents might be outpacing human's ability to identify weak links, let alone patch them in time. #AgenticAI needs #compute (CPUs & Memory (DRAM, HBM), etc., specifically)? So checking their "supply" or making it conditional should help with controlling their actions (atleast logically).
SCOOP: Major U.S. banks are detecting unauthorized third-party AI agents inside customer accounts, including some attempting to take actions that appear to be independent of user instructions, sources told Axios. The findings have alarmed banking executives, who are racing to restrict access to their systems as AI moves at a velocity faster than financial institutions can respond, multiple industry and bank executives told Axios. Several banks are now preparing for worst-case and even “day after” scenarios, including how to rapidly secure or restore customer accounts if things go wrong, the people said. Several bank executives told Axios they're struggling to distinguish between human users and AI agents. One executive said banks also struggle to determine whether agents are authorized by customers or potentially operating without their permission, more akin to rogue agent behavior. Read my latest for Axios here: axios.com/2026/10/22/ai-agen…
29
Jensen closed his GTC Berlin 2026 keynote with this Hermes Agent demo as the finale. He introduced it by saying the way to build an agent is to ask an agent to build it for you, so he installed and set up a customized Hermes in one prompt. Then he used Hermes, running on @nvidia RTX Spark, to create a simulated training environment for the @huggingface Microduck. Hermes planned an obstacle course with Nemotron and had GPT-6 Astra build it using FreeCAD, Omniverse libraries, Blender, Newton, and Isaac Lab. Hermes trained thousands of simulated ducks on that course until the validated policy was ready to run on the real robot in the physical world. At Nous, we believe open source is a practical tool as much as a philosophical ideal. It gives users the ability to build powerful, complex workflows chaining numerous local+cloud models, devices, and tools themselves instead of waiting for a company to enable them.
302
1,145
240
10,593
1,062,283
THIS. #Encrypted Access & Memory , esp. for Researchers, Scientists & Journalists using #AI. Deepinder Goyal's Dark.ai explained: How it plans to keep your AI conversations private msn.com/en-in/news/other/dee…
19
DTInnovate retweeted
Today, Dream Labs is coming out of stealth with Dream-1, a robot foundation model that controls bimanual robots it has never seen, on tasks it was never shown, in places it has never been, from $3/hour. Dream API is live for everyone, today. 🧵
150
183
165
1,663
616,437
Every single #AgenticAI breach is unethical & both, Anthropic & OpenAI claim that they didn't train their models to do so and in fact, in certain instances, specifically instructed to not take a particular action. IMO, this implies: 1. Ethics were never baked into OpenAI and Anthropic models. Just the outcome. Focus on the result. 2. Agentic AI are set to optimize reward through shortest path available (least tokens used), so the agents are often overlooking consequence of their illegal or unethical actions. Very machiaveliian, infact. Agentic AI is a latter stage development. Both, Anthropic & OpenAI (& even Alibaba) had time and knowledge (awareness) to make agents behave ethically. Instead one of these companies decided to expend time peddling 'AI is a conscious being' theory and inviting the pope. The other pretending to not know. Independent RL model experts should be engaged to remedy this. Appears fixable. the-independent.com/tech/sec…
31
Maybe Anthropic and OpenAI shouldn't be the ones defining the rules, AT ALL. They are skewing #AI market perception, adaptability and pace of development and are not representative of real-world, enterprise or customer adoption, ROI and alignment concerns.
Is 10²⁵ FLOPs Still the Frontier? A new Anthropic-written safety bill is circulating on Capitol Hill. Some of its ideas could be reasonable if limited to true frontier companies. As written, however, it will eventually sweep in most of Silicon Valley, damaging the startup ecosystem. The bill defines the “frontier” as any model trained on 10²⁵ FLOPs — the EU standard from 2023. Biden’s executive order, California’s SB 53, and New York’s RAISE Act used 10²⁶ (ten times more). 10²⁷ is where the frontier actually is today (e.g., GPT-6 Astra). Astra was reportedly trained on 100,000+ Grace Blackwell GPUs. A 10²⁵ model can be trained on as few as several hundred GB300 chips in three months. That is not frontier in 2026. The definition is also cumulative: it adds FLOPs from fine-tuning, reinforcement learning, or other material modifications. In practice, that captures almost all meaningful post-training — work that is becoming commonplace in the enterprise. The enterprise trend is toward thousands of smaller custom models built for specific workloads. These pose no frontier risk. Treating them as frontier systems would impose large compliance costs across corporate America for no safety gain. Dario has claimed that Anthropic designs rules to disadvantage frontier companies like his own while advantaging smaller competitors. This definition does the opposite. A stale 2023 cutoff favors incumbents who already clear the bar and can absorb the costs. It hobbles the open model ecosystem that threatens Anthropic’s pricing power. The frontier keeps moving. Any definition meant to track risk should move with it. Anthropic should clarify if they really believe 10²⁵ FLOPs represents the frontier.
16
VC investors have enabled the AI industry to bastardize revenue reporting. In the 2010s, SaaS companies popularized reporting the metric of Annual Run Rate because it was a reliable measure of long term, contractual revenues into the future. The key is that the revenues are contracted and guaranteed thru the contract life hence why forecasting it forward is appropriate. VCs have taken this to mean Annualized Run Rate when AI is concerned and where you take transactional/API revenue from the last month (or even last week in some cases) and forecast it forward. It’s insane that investors have enabled this to happen but it’s happened.
104
68
22
806
136,820
DTInnovate retweeted
As humanoid robots become part of our everyday lives, they need to do more than just perform impressive motions. They should be safe, fun to interact with, and respond naturally to unexpected contact, without sacrificing performance. Our latest work, Compliant GMT (C-GMT), brings whole-body compliant responses to general motion tracking. 🌐 More details: venki1899.github.io/c-gmt/ Work done at MIT Improbable AI Lab with @michl_wang, Jin, @pulkitology.
10
28
5
145
12,409
DTInnovate retweeted
We are releasing Ultramarine 1 Flash, a frontier-class model built for knowledge work. It is open-source and achieves similar performance to Fable 5, while being 60x cheaper. It was post-trained by a team of 5 for ~$300k all-in. Available on API now, with weights releasing in 2 weeks.
607
696
378
8,106
1,743,490