
Founder of @openlit_io | Cyber security using AI @transilienceai https://xitter.cf/t.co/cz5Dr0pbHj
Noida
Joined August 2014
- Tweets90
- Following175
- Followers60
- Likes245
New @openlit_io demo: support-desk agent.
Scan the repo → fix unsafe tools → read traces + AI Analysis → stop duplicate tool calls.
Run cost: $0.0052 → $0.0002
Repo: github.com/openlit/openlit
youtu.be/mSOuJxW8cHs
GPU utilization is a vanity metric for LLM inference.
nvidia-smi and DCGM tell you the SM was busy. Not KV cache OOM, throttle, or zombie VRAM. What to SLO instead:
openlit.io/blogs/gpu-util-is…
Replying to @claudeai
@claudeai I saw this error suddenly while viewing code.claude.com/docs/en/agen… . What happened ?
I wrote about a hard truth in RAG:
👉 Retrieval doesn’t eliminate hallucinations.
Even with good context, models can still give wrong answers.
In this blog:
* Where hallucinations come from
* Why retrieval isn’t enough (Dont trust the model!)
🔗 openlit.io/blogs/how-to-dete…
Been working with LLM systems lately and one thing stands out:
We track latency, tokens, cost… but barely look at the GPU.
which is where all the work happens.
Most debugging pain I’ve hit comes from this gap.
I wrote this blog to connect the dots:
openlit.io/blogs/gpu-monitor…
🚀 Just launched on Product Hunt: Custom Dashboards in @openlit_io 🎉
🔍 Real-time dashboards for AI apps & agents — track latency, tokens, costs & traces.
⚡ 100% open-source & OpenTelemetry-native.
👉 producthunt.com/products/ope…
#AI #LLMs #OpenSource #GenAI
Replying to @jslovers_del
@jslovers_del Meet-up at @gradeupapp
Thanks to @ekaspreet93 @kushagrarora17
Awesome talks on Typescript and PWA...
Cc : @hellonehha @learn_n_share @sanjeev0291








