llmcontroller (@llmcontroller) header
llmcontroller (@llmcontroller) profile picture

llmcontroller

@llmcontroller

Self-hosted AI infrastructure for GGUF inference. Benchmarking, analytics, orchestration, and runtime control. NVIDIA • AMD • Linux • Windows

 Canada
github.com/tensioncore/llm-controller-ce
Joined June 2025
  • Tweets103
  • Following39
  • Followers32
4Media
Photo by llmcontroller (@llmcontroller)Photo by llmcontroller (@llmcontroller)Photo by llmcontroller (@llmcontroller)Photo by llmcontroller (@llmcontroller)
LLM Controller CE v1.4 is here. Local voice dictation. A better experience throughout.
2
69
LLM Controller Pro will bring scalable, brand-agnostic, AI inference with multi node model splitting, speculative decoding, automatic user routing and more!
Nick Dodd (@nickdodd) profile pictureNick Dodd
@nickdodd10h
The largest software project I've ever created is: - not completed yet - over 100k lines of optimized code - a scalable AI inference platform - LLM Controller Pro @llmcontroller
1
22
🚀 LLM Controller CE v1.6 is LIVE! Our biggest release yet! Persistent Memory, native Tools + Web Search, rebuilt Benchmarking V2, Enhanced Search, major stability improvements and MUCH more! 7 releases in 4 months. Local AI, under your control.
2
1
1
84
github.com/tensioncore/llm-c…
GitHub - tensioncore/llm-controller-ce: Local-first control platform for running, managing,...

GitHub - tensioncore/llm-controller-ce: Local-first control platform for running, managing,...

Local-first control platform for running, managing, chatting with, monitoring, and benchmarking GGUF language models on your own hardware. - tensioncore/llm-controller-ce

github.com
4
LLM Controller CE v1.6 is shaping up to be a big release. Enhanced tools with web search, Benchmarking v2, all-new Enhanced Search, and much more. Coming soon!
1
1
1
24
Benchmarking v2 was broken in v1.5 - it has been fixed and enhanced even further in this release!
4
Working on tool use and a better search!
7
Hard at work testing v1.5! We brought memory into v1.5! LLM Controller CE will remember you now!
1
36
If you have an @NVIDIA or @AMD GPU, or no GPU at all, you can run LLM Controller CE! Don’t want to set it up yourself? Point your AI assistant at our GitHub and let it handle the setup.
17
Working on adding memory to LLM Controller CE! We already have a Beta build running our custom integration of @mem0ai - Profile Memory, Project only Memory and no memory optional!
Image from llmcontroller (@llmcontroller)
1
1
51
🚀 LLM Controller CE v1.3.0 is live! Projects + Project Instructions, System Instructions, Docling document understanding, expanded image/file support, API Analytics, improved imports, security fixes, and a whole lot of polish. One of the biggest CE updates yet. 🔥
1
1
1
105
github.com/tensioncore/llm-c…
Release LLM Controller CE v1.3.0 · tensioncore/llm-controller-ce

Release LLM Controller CE v1.3.0 · tensioncore/llm-controller-ce

Projects, Document Understanding & API Analytics v1.3 is one of the largest LLM Controller CE updates to date, expanding how conversations can be organized, instructed, supplied with context, a...

github.com
11
LLM Controller CE v1.3 is almost ready. 👀 Projects + Project Instructions. Personal System Instructions. Document understanding with Docling. API analytics. A much bigger attachment pipeline. Final testing is nearly done. One last audit, then release.
1
65
LLM Controller CE v1.2 releases tomorrow. 🚀 • Multimodal image support • Better attachment handling • OpenAI-compatible API • Better title generation control • Expanded Model Management #LocalAI #OpenSource #LLM
1
1
27
LLM Controller CE v1.1 is available now! github.com/tensioncore/llm-c…
Nick Dodd (@nickdodd) profile pictureNick Dodd
@nickdoddJul 20
Replying to @kelvinbuildss @llmcontroller
LLM Controller makes it super easy and a new version is coming out today or tomorrow!
1
101
Update for LLM Controller CE v1.1 will be on github tomorrow! github.com/tensioncore/llm-c…
GitHub - tensioncore/llm-controller-ce: Local-first control platform for running, managing,...

GitHub - tensioncore/llm-controller-ce: Local-first control platform for running, managing,...

Local-first control platform for running, managing, chatting with, monitoring, and benchmarking GGUF language models on your own hardware. - tensioncore/llm-controller-ce

github.com
1
1
33
LLM Controller CE v1.1 is in final testing. Plan to update main in a day or 2! URL IDs, title search, better UX in several drawers, auto start/stop logs+monitor, bug fixes. #opensource #localLLM
31
UI improvements, Search and RAM usage. LLM Controller CE v1.1 is in production testing.
Image from llmcontroller (@llmcontroller)
Image from llmcontroller (@llmcontroller)
Image from llmcontroller (@llmcontroller)
1
49
LLM Controller CE v1.0 is here. Serious local inference starts with the hardware. LLM Controller puts your models, runtime, GPU, logs, performance, and controls where they belong: in your hands. #LocalAI #LLM #OpenSource github.com/tensioncore/llm-c…
GitHub - tensioncore/llm-controller-ce: Local-first control platform for running, managing,...

GitHub - tensioncore/llm-controller-ce: Local-first control platform for running, managing,...

Local-first control platform for running, managing, chatting with, monitoring, and benchmarking GGUF language models on your own hardware. - tensioncore/llm-controller-ce

github.com
92
v1.1 loading...
Nick Dodd (@nickdodd) profile pictureNick Dodd
@nickdoddJul 11
The night of launch and I'm already working on v1.1, a thorough refinement and useability update on @llmcontroller CE v1.0. I've been using this software to run inference for over a year; updates and improvements must continue! 😅 #opensource
29
Load more