Metaのスマートグラス使えばYOLOの物体検出リアルタイムで動かすくらいできるし、動画のメガネ改造部分はAI生成。特に新しいことは言っていないけど…
this is wild...
the guy reverse-engineered his smart glasses with Opus 5.5 into an AI object recognition device
you can hook it up to any smart glasses with a camera and they start naming every person, car and any object they see, live
it's free, open source and runs on a regular Mac
here's the full breakdown:
step 1 → install YOLO with one command: pip install ultralytics
step 2 → put on the glasses and start a WhatsApp video call to your own Mac
the glasses look at the street, and the Mac sees exactly what they see
step 3 → in OBS, capture the call window and turn on Virtual Camera
now the glasses feed shows up on your Mac like a webcam
step 4 → run the tracker on that feed: yolo track model=yolo26n.pt source=1 show=True
every object gets a box, a label and an ID that sticks to it from frame to frame
step 5 → keep only what matters to you: classes=0,2,16 for people, cars and dogs, conf=0.5 to drop weak guesses
step 6 → have a small Python script say what it sees with macOS say, routed into the call through a virtual mic like BlackHole: "car on your left". it plays right in your ear
step 7 → train it on your own objects: your products, your tools, your dog. swap coco8.yaml for your own labeled photos and run yolo train
step 8 → export it for your phone: format=coreml for iPhone, format=tflite for Android, so you don't need the Mac at all
under the hood:
→ YOLO looks at each frame only once and finds every object in that single pass, which is why it's fast enough for live video
→ tracking (ByteTrack by default) keeps the same ID on the same dog even when it walks behind a tree
→ 80 object types work out of the box, no training needed
github.com/ultralytics/ultra…
try it yourself
then read the guide on how to reverse-engineer any device with Claude:
4
331













