Distributed inference for the people. Private and public mesh, sharing hardware for inference. https://xitter.cf/t.co/yqbhmITeYQ

github.com/mesh-llm/mesh-llm
Joined October 2026
Mesh LLM retweeted
this was fun to build - fork of signal - agent built with GDK - using open weights model - served via e2ee mesh-llm - via private GPU TEE - making private search tool calls - paid for with ₿ over LN a cool stack of permissionless & open source tech all working together!
An agent inside Signal using decentralized compute paid for with bitcoin @moneyball demos a fork of Signal built by @matbalez using @Mesh_LLM and @lexeapp ↓ Timestamps: 0:00 - Demo: agent inside Signal 10:51 - The economics of decentralized compute 14:39 - Running inference at home
13
23
4
145
149,011
Mesh LLM retweeted
Right on - this is what we made MeshLLM for (well that and some procrastination: github.com/mesh-llm/mesh-llm Metal, CPU, CUDA (various), ROCm, Vulkan, x86_64, arm, windows/mac/linux and appropriate combinations. (fingers are sore).
this is THE time to be revisiting distributed inference on heterogeneous hardware, software is collapsing the barriers of hardware incompatibility
2
1
47
Mesh LLM retweeted
Who wants ads? So great to have ads. Everyone wants ads. More ads. Should we put ads in?
2
1
131