tested four ways to run AI models on Intel's 32 GB Arc Pro B65. The fastest tool depends on the job:
• One person writing code: Intel's vLLM, 1.7× faster than llama.cpp
• 8 people at once: exl3xpu, 5.5× more total output
• A ~50-page prompt: exl3xpu, 2.5× sooner to start answering
• A huge 125B model on one card: Strata, 3.6× faster than llama.cpp
• Easiest to set up*: still llama.cpp
Every comparison is against llama.cpp at its fastest, with the same tests. Full numbers below.
*technically all are easy to setup when you just point your agent to the work 🤷♂️
have been playing around more with turning my old CarThing from Spotify into my dedicated @t3dotcodes notification thingy.
added in some useful full screen alerts for when a thread needs my attention.
actually liking this more than I thought I would.
definitely dont need to buy into those fancy "dedicated ai controllers"...just reuse old hardware and point your agent at it and let it rip.
Replying to @daradoescode @f4micom
T3 code info streaming to my Spotify CarThing.













