Ryan Phillips retweeted
I've been working on something special lately...
"The interfaces we use to control models will be individual-specific instead of general. Not many to one, but one to one. Any form of control you can imagine. Any version of Runway you want. Soon."
What I Talk About When I Talk About Control
Making something and having the skill to make it used to feel tightly linked. Now the outcome no longer proves you have the skill. Or does it?
When text-to-video first started working, that’s what it felt like. All you had to do was type in a short text description, press a button, and voila. It was magic or cheating, depending on how you looked at it. The fact that it worked at all was a breakthrough, but it also didn’t look like the person making the thing had done very much. We’d created something like auto mode for generative video, and “auto” isn’t a word we associate with craft. Yes, prompting is a skill, but being a better “describer” of the thing you want to make isn’t something we’ve historically been satisfied with as skill, unless your craft itself was flowery prose.
As the models get more capable, the makers want more degrees of freedom to try things. New places to make choices become new places to exercise judgment, and enough judgment creates the possibility of craft. Creators start developing intuitions about the models, just like people have developed intuitions about cameras, editing software, or any other medium.
New capabilities show up before we can understand them. So we build whatever interface we can manage to. Minimum viable control and minimum interfaces to get started. That becomes the first auto mode for that new tool. Then people use it, push it against its limits, and give us pretty loud hints at what they want to be able to do next. It takes time to figure out which new primitives are powerful, and where users want more control.
People want more control. And they want more degrees of freedom. I believe that part of what makes models more controllable is that they become personal. AI is fundamentally a general purpose technology that can be shaped in any unique way you want. Models are generalization machines that can adapt to what you need. Everyone has a different way of using models. Different ways of finding them useful and productive.
I strongly believe that most of the interfaces we use to control models will be individual-specific instead of general. Not many to one, but one to one. Any form of control you can imagine. Any version of Runway you want. Soon.
Today, Runway is joining Claude Marketplace.
Enterprise teams already working with @claudeai can now put part of their Anthropic commitment toward Runway Creative, bringing video, image and audio generation into the same budget. Learn more at the link below.
Ryan Phillips retweeted
Replying to @modal
@modal and @GrayAreaorg are partnering to put the "art" back in "artificial intelligence".
We've sponsored a dozen projects by leading digital artists that will be shown at Gray Area next week.
Come thru on Thursday for a panel featuring @ideeplistening and @Ryphi10.
Register here: luma.com/modal-48ev
Ryan Phillips retweeted
Agents can now show their reasoning, not just describe it.
Visual Thinking is a new research harness that turns an agent's work into real-time video, so every step is visible and easier to follow, check and trust.
Ryan Phillips retweeted
Runway has been on a tear over the past couple months.
Viral HORSE Video contest
Solaris: the world's first Interface World Model
Praxis-1: open-weight World Action Model for robotics
Project Continuum: operating system research application built around real-time interfaces
A video model. An interface model. A robotics model. An operating system. Are you getting it? These are not separate pretrains. They’re different applications, built around the same General World Model backbone, with different post-training on top.
All of them are examples of what you can do when you can simulate any pixel.
So I asked co-CEO Anastasis Germanidis to co-write an essay with me explaining how video, interfaces, operating systems, and robotics all fit together, why video was the right starting point for World Models, where the world is heading if Runway’s bets are right, and whether or not, as someone who simulates worlds, he believes we’re living in a simulation.
Welcome to the future. Enjoy!
(Video, of course, made with Runway)
Ryan Phillips retweeted
Researchers at Harvard and Brigham and Women’s Hospital found that transplanted hearts shift toward the biological age of their recipients. Old hearts get younger in young bodies, and young hearts get older in older ones. Which is nuts.
Today, we're launching a partnership with our friends @runwayml to, among other things, bring one of the stories from each week's Dose to life in video. I'm not great at it yet, but not bad for a few prompts! And I'm excited to get better. I have zero talent in film/video, but I can write, which now means that I can make movies. Age of miracles.
Introducing Project Continuum by @runwayml_labs, a new operating system research application built around real-time video interfaces.
Today, we're sharing an early look at four new ways of interacting with your computer: Portals, Visual Thinking, Responsive Video Interfaces and Interactive Worlds. Interface World Models, like Solaris, are reimagining what an interface can be.
Ryan Phillips retweeted
Wrapping up the Runway AI Summit in San Francisco, many people asked me what I am most excited for. Attendees of the event got a special early preview but we will be sharing more very very soon.
Project Continuum.
Introducing Runway Ads, an autonomous engine for performance marketing.
Since July, we’ve used Runway Ads to:
-Scale ad volume 1,000% while doubling our return on ad spend
-Increase conversion by 34% with click-through rate holding steady
-Bring our cost per subscriber down 41%
-And add $100M ARR
Now, we’re making it available to select enterprise partners and will be rolling it out widely in the coming weeks.
Learn more and request early access: runway.com/news/company-news…
🤖 Made with AI
We're joining the @OpenAI Marketplace as a launch partner.
Starting today, you can access the best image, video, audio and editing models, and apply part of your OpenAI commitment toward purchases with Runway.
Learn more and start creating at the link below.
ElevenLabs v4 is now on Runway. The v4 model excels at narration and character dialogue with more expressiveness and natural intonation than ever before.
Available today alongside the world's best image and video models. Try it now at the link below.
🤖 Made with AI
Today we're launching DIFFUSE: a platform for agencies, brands and studios to search for, connect with and hire AI-native talent.
There's a lot of worry around AI displacing creatives but the reality we keep seeing is different: an entirely new creative workforce is emerging, and demand for it is accelerating. DIFFUSE connects that talent with this new landscape of opportunities. Register and learn more at the link below.
🤖 Made with AI
Ryan Phillips retweeted
We’ve been experimenting with responsive generative video interfaces. Real-time video models are reshaping responsive design. A thread 🧵
















