Simulon retweeted
We’ve had creators reaching out with some really interesting ideas for @Simulon Reality-Aware Rendering, asking what’s possible.
We want to explore these ideas together and learn how we can support the use cases that emerge from real-world experimentation.
So we’re opening up early access to a few creators this weekend, with credits to experiment, ahead of the public launch on Tuesday, October 27.
If you’ve got an exciting idea, sign up in the Simulon app and send us your username along with what you’d like to create.
Let’s explore what’s possible together!
Simulon is insanely good.
Anyone remotely interested in 3D, CG, and cinema should toy with it for fun.
You can do this in 3 minutes, app download included. Try it.
Here’s how @Simulon Reality-Aware Rendering works. I placed my raptor next to the water and dropped a stone in to see how he’d respond.
His 3D placement sets his starting position and scale. When the recording starts, he becomes a ghost, leaving me to shape the performance through actions, gestures and spoken instructions. Simulon uses the recorded scene to generate his behaviour and integrate him into the footage afterward.
Instead of typing a prompt, spinning the slot machine and hoping for the best, you can show it, say it and perform it. Your intent, timing and spatial context are right there in the recording. It’s a much more intuitive way to create.
This breakdown is generated procedurally, summarising the actual reasoning behind the result.
Simulon retweeted
Here’s how @Simulon Reality-Aware Rendering works. I placed my raptor next to the water and dropped a stone in to see how he’d respond.
His 3D placement sets his starting position and scale. When the recording starts, he becomes a ghost, leaving me to shape the performance through actions, gestures and spoken instructions. Simulon uses the recorded scene to generate his behaviour and integrate him into the footage afterward.
Instead of typing a prompt, spinning the slot machine and hoping for the best, you can show it, say it and perform it. Your intent, timing and spatial context are right there in the recording. It’s a much more intuitive way to create.
This breakdown is generated procedurally, summarising the actual reasoning behind the result.
Simulon retweeted
Meet Nigel. He’s not enjoying our cause-and-effect demo.
So I let him sit in the DeLorean. Still not happy.
I didn’t write his lines. What he says is generated from his personality and the context of the shot.
It’s an entirely new way to create: place imaginary characters in your world, record your performance, and let Simulon generate their reactions and realistically integrate them into your footage.
Reality-Aware Rendering is coming to @Simulon this week.
Simulon retweeted
This wasn’t animated by hand. And it wasn’t generated from a prompt either.
It was created from real world footage.
It’s something entirely new.
We call it Reality-Aware Rendering.
Coming to @Simulon next week.
Simulon retweeted
That first morning coffee just hits different. ☕️
Made this morning on my iPhone with @Simulon, at a real café. There’s something about being there and finding the frames yourself that you can’t get from a purely generative workflow.
Featuring the famous Cape Town wind, of course.
Simulon retweeted
I don’t know exactly what is going on @Simulon HQ but holy shit🤯
Simulon retweeted
First look at the new @Simulon.
Pt 2: Your designs. Your world.
Let’s make one of those viral stylised humans, but from my own sketch and in my own world.
You can turn a sketch into a neural asset in minutes, place it in the real world and bring it to life in seconds. All in Simulon.
Simulon retweeted
Cloned a quagga this time.
Extinct since 1883.
There’s something surreal about seeing it move through the museum where it’s on display.
First look at the new @Simulon.
Pt 1: You can clone reality now.
I photographed a vulture in a museum. Pulled it out of the display and brought it to life.
You can turn any photo into a neural asset and capture it with photorealistic detail. End to end on iPhone and Android.
Simulon retweeted
Another important thing to notice here: @Simulon is now coming to Android too.
First look at the new @Simulon.
Pt 1: You can clone reality now.
I photographed a vulture in a museum. Pulled it out of the display and brought it to life.
You can turn any photo into a neural asset and capture it with photorealistic detail. End to end on iPhone and Android.
Simulon retweeted
First look at the new @Simulon.
Pt 1: You can clone reality now.
I photographed a vulture in a museum. Pulled it out of the display and brought it to life.
You can turn any photo into a neural asset and capture it with photorealistic detail. End to end on iPhone and Android.
Simulon retweeted
The Future is Hybrid
Experiment 2: “Physically” pull back a tiny zombie in my hand like a wind-up toy, then release it to run across a real surface.
Workflow:
Simulon - Start/end states + shoot the running sequence (real-time, in-camera).
NanoBanana - create the “in-hand” interaction frame.
KlingAI - generate the hand interaction (holding the zombie, pulling back, placing it down).
DaVinci Resolve - smooth the transition (camera shake/retime/color).
Full breakdown on Substack.
open.substack.com/pub/divesh…
Simulon retweeted
The Future is Hybrid
Experiment 1: “Physically” picking up a virtual 3D figure and placing it in a new location.
Traditional VFX: very difficult.
GenAI-only: no intention, no control.
Hybrid: used @Simulon to lock placement/scale/lighting + start/end frames, then use @GoogleDeepMind Veo to generate the interaction between them.
Full breakdown + decision trail on Substack.
substack.com/@diveshnaidoo/n…
There’s a metric ton of GenAI media right now being made fast and shipped faster. Stuff that consumes attention without earning it. At the same time, the possibilities of the technology are too exciting to ignore.
So I’m starting a Substack series: The Future Is Hybrid.
substack.com/@diveshnaidoo/n…
I’ll be sharing workflow experiments mixing VFX, GenAI, and other tools with a focus on intentional and controllable results (not slot-machine outputs).
Post 1 is live and it lays out my approach and thinking. Experiment 1 will go live shortly.
Simulon retweeted
Reference vs Viewport vs Final rendered version of this Baby Rexy sequence I did for launch of @Simulon
Anim done in Maya and tracking,lighting,rendering etc was done using @Simulon app
You can get Simulon from the App store : lnkd.in/gDZ4xWbh
#animation #cgi #vfx #noAI









