Programmers.App

this is wild... the guy reverse-engineered his smart glasses with Opus 5.5 into an AI object recognition device you can hook it up to any smart glasses with a camera and they start naming every person, car and any object they see, live it's free, open source and runs on a regular Mac here's the full breakdown: step 1 → install YOLO with one command: pip install ultralytics step 2 → put on the glasses and start a WhatsApp video call to your own Mac the glasses look at the street, and the Mac sees exactly what they see step 3 → in OBS, capture the call window and turn on Virtual Camera now the glasses feed shows up on your Mac like a webcam step 4 → run the tracker on that feed: yolo track model=yolo26n.pt source=1 show=True every object gets a box, a label and an ID that sticks to it from frame to frame step 5 → keep only what matters to you: classes=0,2,16 for people, cars and dogs, conf=0.5 to drop weak guesses step 6 → have a small Python script say what it sees with macOS say, routed into the call through a virtual mic like BlackHole: "car on your left". it plays right in your ear step 7 → train it on your own objects: your products, your tools, your dog. swap coco8.yaml for your own labeled photos and run yolo train step 8 → export it for your phone: format=coreml for iPhone, format=tflite for Android, so you don't need the Mac at all under the hood: → YOLO looks at each frame only once and finds every object in that single pass, which is why it's fast enough for live video → tracking (ByteTrack by default) keeps the same ID on the same dog even when it walks behind a tree → 80 object types work out of the box, no training needed github.com/ultralytics/ultra… try it yourself then read the guide on how to reverse-engineer any device with Claude: