Java Inference Tornado toolkit | Powered by @TornadoVM | https://xitter.cf/t.co/24V0XxmPMD
Joined September 2026
- Tweets14
- Following6
- Followers8
- Likes13
jitLLM retweeted
Great to see @tornadovm on the top of the @ycombinator today! The article has all of the latest work on accessing @nvidia libraries from Java!
jitLLM retweeted
Had so much fun at @JDD_Krakow 2026 in Kraków yesterday.
I presented “Java Goes CUDA-Native”: new @tornadovm features that let @jitLLM run LLM inference at GPU-native speed, from Java.
tornadovm.org
jitllm.io
#opensource #Java #TornadoVM #GPU #AI
jitLLM retweeted
The Devoxx Greece 2027 Call for Papers is OPEN! Join us in Athens (Apr 15-17). Propose a session across 8 tracks—from 15m bytes to 3h deep dives. First-time speakers welcome!
Submit by end of Nov: dvgr27.cfp.dev/
#devoxxgr #dvgr27
jitLLM retweeted
LLM Inference on GPU in Java?
@tornadovm and @jitllm at @Devoxx Belgium!
* Java writing Java that runs on the GPU. Java for the GPU, on the GPU!.
* A @QuarkusIO @langchain4j application reviewing it's future port to Quarkus 4 locally, all in Java on GPU!
youtu.be/HO5CpETzywk?is=_ws2…
jitLLM retweeted
96.65 tokens/sec for #Llama 3.2 1B – running through a pure-#Java GPU inference engine. @mikepapadim explores GPULlama3.java & #TornadoVM and how they bring GPU-accelerated #LLM inference to the #JVM.
See the code: javapro.io/2026/10/13/buildi…
#AI @langchain4j @QuarkusIO
jitLLM retweeted
#LangChain4j 1.22.0 is out!
Highlights:
- OpenAI Decisions API support
- AWS Bedrock batch inference
- Automatic prompt caching for Anthropic
Thanks to all contributors!
github.com/langchain4j/langc…
jitLLM retweeted
Yesterday my colleagues @MXekalaki and @mikepapadim showed live demos about using @nvidia cuFFT and cuBLAS with @tornadovm for signal filtering and @jitllm!
NVIDIA performance is a jar away from Java.
#Java #CUDA #TornadoVM
Optimized GPU libraries (e.g. cuBLAS, cuDNN, etc.) by @nvidia, now one jar away for your Java - without caring about JNI.
We also show demos with @ApacheFlink and @jitllm.
Watch our talk in @Devoxx 👇
youtu.be/6SPnBmQrYEk?si=3DI_…
#opensource #AI #TornadoVM #Java #GPU
jitLLM retweeted
Optimized GPU libraries (e.g. cuBLAS, cuDNN, etc.) by @nvidia, now one jar away for your Java - without caring about JNI.
We also show demos with @ApacheFlink and @jitllm.
Watch our talk in @Devoxx 👇
youtu.be/6SPnBmQrYEk?si=3DI_…
#opensource #AI #TornadoVM #Java #GPU
jitLLM retweeted
We are @Devoxx, getting ready for our first hands-on #GPU lab for #Java!
We will be in BOF2 room at 16:50, with live demos!
@tornadovm @jitllm
jitLLM is part of the @langchain4j 1.21.0 release! 🚀
Read more here: docs.langchain4j.dev/integra…
#opensource #LLM #GPU #Java #LangChain4j #Inference
#LangChain4j 1.21.0 is out! 🚀
Meet Decision Models: instant yes/no, choice and scale answers with probabilities.
Decision Services turn any Java interface into a classifier.
Plus model routing, re-ranking, tool selection, guardrails and agentic routing!
github.com/langchain4j/langc…
jitLLM retweeted
Excited to see our work reaching this point. ⚡
Pure Java LLM inference, seriously fast. Approaching - and in some cases exceeding - llama.cpp performance.
Can Java compete with llama.cpp/@ollama? YES! With @jitLLM!
jitLLM uses @nvidia CUDA libraries (cuBLAS, cuDNN) and reaches 0.90× to 1.12× of llama.cpp's throughput!
jitLLM is empowered by @tornadovm and will be soon in @langchain4j and @QuarkusIO.
github.com/beehive-lab/jitll…
Can Java compete with llama.cpp/@ollama? YES! With @jitLLM!
jitLLM uses @nvidia CUDA libraries (cuBLAS, cuDNN) and reaches 0.90× to 1.12× of llama.cpp's throughput!
jitLLM is empowered by @tornadovm and will be soon in @langchain4j and @QuarkusIO.
github.com/beehive-lab/jitll…
jitLLM retweeted
Next week we will be in @Devoxx and speak about @tornadovm, @jitllm and how we accelerate Java on GPUs, using @nvidia native libraries!
Come and talk to us, to learn more!
#opensource #Java #AI #TornadoVM #jitLLM #GPU
