Simone Toscani (@simoltos) header
Simone Toscani (@simoltos) profile picture

Essere umano da quando ho memoria

Tuscany, Italy
Joined November 2017
Replying to @antirez
This prefill may not be fast in absolute sense but, on thi hardware, is almost the double I can get running llama.cpp
1
3
828
I can't contain my excitement @antirez , I know that you and the community are used to far superior speeds, but I've neve ever imagine to be able to run a 35B model on a simple CPU, with only 14.4G of ram
2
37