this was fun to build
- fork of signal
- agent built with GDK
- using open weights model
- served via e2ee mesh-llm
- via private GPU TEE
- making private search tool calls
- paid for with ₿ over LN
a cool stack of permissionless & open source tech all working together!
An agent inside Signal using decentralized compute paid for with bitcoin
@moneyball demos a fork of Signal built by @matbalez using @Mesh_LLM and @lexeapp ↓
Timestamps:
0:00 - Demo: agent inside Signal
10:51 - The economics of decentralized compute
14:39 - Running inference at home
Right on - this is what we made MeshLLM for (well that and some procrastination: github.com/mesh-llm/mesh-llm
Metal, CPU, CUDA (various), ROCm, Vulkan, x86_64, arm, windows/mac/linux and appropriate combinations.
(fingers are sore).