Building AI-native memory systems, from silicon to tokens. X-Mem™ Networked Memory Tier™.
Joined July 2024
- Tweets9
- Following60
- Followers33
- Likes7
Sparse attention reads less KV data. The full KV cache still needs fast, high-capacity memory.
Our XM-Sparse Pilot VM testbed with SGLang HiSparse + Netpreme X-Mem™ shows why bandwidth and capacity matter for LLM inference.
See the benchmarks.
netpreme.com/blog/xm-sparse-…
Sparse attention still needs the full KV cache.
Our XM-Sparse Pilot VM testbed with SGLang HiSparse and Netpreme X-Mem™ shows lower TPOT and higher peak decode throughput vs. host DRAM for LLM inference.
netpreme.com/blog/xm-sparse-…
#LLMInference #SGLang
Cracking the Memory Wall at #OCPSummit26: a lively discussion on AI inference, KV cache, and memory tiers. Thanks to Hanrui Wang (@hanrui_w), Sudeep Bhoja, Angela Yeung, Kartik Srinivasan, and Rakesh Cheerla (@RakeshCheerla) for joining us—and to Bob Brennan for moderating. #AIInfrastructure
#OCPSummit26: AI memory wall panel + happy hour.
Bob Brennan moderates Ryan Wang (@hanrui_w, @nebiusai), Sudeep Bhoja (@dMatrix_AI), Angela Yeung (@cerebras), Kartik Srinivasan (Napatech) & Rakesh Cheerla (@RakeshCheerla, @netpreme ).
Oct 14, 5:30–8:30 pm. RSVP: luma.com/sp6j7s7i
Heading to #OCPSummit26? Join Netpreme on Oct 14 from 5:30–8:30 pm for a panel and happy hour on the AI memory wall. Bob Brennan moderates a discussion with Ryan Wang (Nebius), Rakesh Cheerla (Netpreme) & others TBA. Space is limited. Request a spot: luma.com/sp6j7s7i
Speaker update: Angela Yeung, SVP and Head of Product at @cerebras, joins our Oct 14 AI memory wall panel with Ryan Wang (Nebius), Sudeep Bhoja (d-Matrix), and Rakesh Cheerla (Netpreme). Bob Brennan moderates. Request a spot: luma.com/sp6j7s7i
Speaker update: Sudeep Bhoja, co-founder and CTO of @dMatrix_AI, is joining our AI memory wall panel on Oct 14. We’re looking forward to hearing his perspective alongside Ryan Wang and Rakesh Cheerla.