
Co-founder @lightlyAI | Speaker | @ETH | Blogging about ML and data
Zurich
Joined March 2019
- Tweets521
- Following2.3K
- Followers1.5K
- Likes3.8K
Pinned Tweet
Last April I had the chance to give a TEDx talk about future threats and possibilities in AI.
youtube.com/watch?v=FU36Ep6sβ¦
In February I will give a talk at @FightFakeFacts about deepfakes!
#AI #deepfakes #DeepLearning
3D point clouds are coming to LightlyStudio π
MCAP support, different projections, point cloud accumulation, object tracking across frames, and more.
Still experimental, but getting close!
Working with 3D data? We'd love your feedback.
Sneak peek π
1
1
71
Model evaluation in LightlyStudio just got easier π
Run + rerun evaluations directly in the UI. Click a confusion matrix cell to inspect failures, or sort by FP/FN to find the worst cases.
No switching between notebooks and visualization tools.
eu1.hubs.ly/H0zBJyr0
1
1
87
LightlySSL v1.6 is out! π€
We're expanding our OSS framework from self-supervised vision learning to world models.
First up: LeWM. Predict future visual embeddings conditioned on actions, then use them for planning.
Includes a hands-on tutorial!
eu1.hubs.ly/H0zpWhg0
1
1
136
What if you could steer your embedding visualization with natural language?
Coming to LightlyStudio: text-guided axes for 2D embedding projections.
Explore your image and video datasets along concepts you actually care about.
Next release π
23
26
437
My daily routine now:
Wake up β check agents β breakfast β check agents β office β check agents β home β check agents β gym β check agents between sets π
Claude + Codex are great at scoped tasks, especially code optimization.
But manager agents? Often a flood of slop that's harder to clean up than doing the work yourself.
Feels like we've automated coding, but not yet managing the coding agents.
1
77
We've been improving model evaluation in LightlyStudio π
Compare predictions vs. ground truth, inspect errors, adjust IoU thresholds, and rerun evaluations. All directly in the UI.
Much easier to understand where your model fails.
Quick demo π
1
141
Coming in the next LightlyStudio release! π
β Star us on GitHub to stay up to date:
github.com/lightly-ai/lightlβ¦
17
AI-assisted labeling is coming to LightlyStudio π
First up: superpixel-based segmentation to make drawing masks much faster.
The cool part? Everything runs directly in your browser. No GPU servers, APIs, or complex backend.
More labeling features coming over the next few weeks π
82
Been playing around with EPIC-KITCHENS-100 in LightlyStudio.
Indexed 37K+ egocentric video clips and explored them using embeddings.
Pretty fascinating how quickly you can discover patterns, near-duplicates, and mismatches between narrations and actual video content.
Tutorial πeu1.hubs.ly/H0yZ_Wc0
3
95
New LightlyStudio tutorial π
Explore ~10K images using embeddings, select clusters with the lasso tool, review + bulk label them, and evaluate against ground truth.
Try it yourself π
docs.lightly.ai/studio/tutorβ¦
1
49
Pretty fascinating to watch agents optimize other agents.
Gave GPT-6 Astra the system prompt + tool descriptions for a cheaper flash model, an eval set + expected outcomes, and told it to iterate twice while keeping costs low.
2/7 β 5/7 β 6/7 satisfactory answers. Cost stayed basically flat.
Then I just let it work.
89
4.5M images in LightlyStudio π
Embeddings, interactive visualization, filtering and sampling, all on the same dataset.
Rust really paid off here, especially for performance + memory usage.
Weβve done 1M+ videos before. Next target: 10M+ samples.
Letβs see where it breaks π
65
We just added bulk labeling with embeddings to @LightlyAIStudio π
Open your data β embedding view β lasso a cluster β label the whole group.
Works for object embeddings too. Great for splitting classes (person β adult / kid) and annotation QA, where wrong labels often pop out as outliers.
Demo π
61
Doing some larger pre-training runs again at @LightlyAI. Pretty amazing how much the training stack has improved.
WebDataset, activation checkpointing, reduced precision, 8-bit optimizers, torch.compile... things that used to be painful are now surprisingly robust.
Stay tuned π€π¦
4
123
Iβve been a bit silent here, but definitely not idle π
Weβve been onboarding customers and shipping a lot at @LightlyAI. One thing I never got around to sharing: our revamped LightlyStudio docs.
Pretty proud of how far this has come π
1
4
475
πΈ Easy way to save money on GPT / Claude / Codex usage: stop using the same chat forever.
Old context = more tokens, more cost, more noise.
My rule: new day = new session, new topic = new session. For bigger projects, keep the state in a context markdown file.
I used 50M+ tokens in 7 days and still had ~50% of my weekly quota left.
166
The price of intelligence keeps collapsing.
DeepSeek V4 Flash is now nearly 20x cheaper than Gemini Flash 3.6 and around 100x cheaper than leading OpenAI and Anthropic models.
Soon, using an LLM to classify text may be cheaper than training a classifier.
1
4
184
When new backbones drop, everyone asks the same question: how well do they transfer?
We compared three on ADE20K segmentation using LightlyTrain:
π’ LingBot: 0.465 mIoU
π΅ EUPE: 0.456
β« DINOv3: 0.449
LingBot comes out on top π
And yes, all three are supported in LightlyTrain.
1
2
354
Open source doesnβt just release models. It distributes the optimization problem to thousands of smart people.
Kimi K3 is already being pushed onto Apple Silicon and lower-specced hardware.
Interesting project I saw on Hacker News today: eu1.hubs.ly/H0xh89L0
1
132







