8×3090s + 256GB RAM · EXL3 local AI Full-stack SaaS, weird infra, consulting, gaming, movies, thoughts

USA
Joined October 2022
Include

Only show posts containing:

Exclude

Hide posts containing:

Time range
-
Minimum likes
I haven’t finished the new cyberpunk season 2 yet but I’m on episode 8 So far I like the first season better
6
Replying to @westurbergin
haven't measured it yet. tensor parallel testing is next and i'll share numbers
2
Replying to @Yeghro
6 cards get their own slot, the bifurcated one splits between 2. haven't measured if that costs anything yet
1
7
Replying to @animetv_jp
2004 to 2026 and it actually got to animate the ending. most shows never get that
1
1
82
2,876
Replying to @jurlycat
keeping the hot experts in vram and letting the ssd hold the rest is a great trick. laptop gpus finally have a real job
1
2
21
glm 5.3 and qwen 3.8 already run at good quants on the new rig. deepseek is the boss fight
46
Replying to @QwenAIFans
not rich, just bought it one gpu at a time 😂
1
1
9
Send me your favorite Star Wars / Anakin edits; this is mine
Boomers love Star Wars cuz it’s democracy-slop Zoomers love Anakin cuz he’s a fascist incel
172
3,060
356
28,684
2,719,137
Replying to @Yeghro
threadripper 3975wx on a gigabyte mc62-g40. 7 slots, one bifurcated so all 8 fit
1
1
12
Replying to @castillogail
🤣🤣🤣🤣🤣
5
haven't benchmarked tensor parallel on it yet. testing it properly soon and i'll share numbers
1
15
day-vault parts list: - 8x RTX 3090 (3 Dell, 2 Zotac, EVGA, ASUS, FE), 160w cap - Threadripper PRO 3975WX (going in soon) - Gigabyte MC62-G40, one slot bifurcated - 224GB DDR4 (7x32, 8th slot dead lol) - 1600w + 850w PSU via add2psu - 4TB WD SN5000 + 512GB drive - new rack soon
1
79
Replying to @perfopt0
bought it piece by piece, all at once would be closer to 30k. 160w cap per card for now. glm 5.3 and qwen 3.8 run great, tok/s numbers coming
1
14
cards are capped at 160w each, so it's nowhere near the 2-3kw people are guessing 😄
10
Replying to @hamptonism
I could use a matcha
45
Interesting I may try this
10
dunk the lunk to the smartest guy in the mansion. hell of a glow up
1
69
6,145
under a second is where it stops feeling like a walkie talkie. the redo on a reply that breaks halfway matters just as much though, nothing kills a voice demo like it freezing mid sentence
43