Gil Rodrigues (@gildrb_) header
Gil Rodrigues (@gildrb_) profile picture

A memory of all things https://teapawt.org/t.co/Nq8chkqY3p

Joined July 2017
Photo by Gil Rodrigues (@gildrb_)Photo by Gil Rodrigues (@gildrb_)Photo by Gil Rodrigues (@gildrb_)Photo by Gil Rodrigues (@gildrb_)Photo by Gil Rodrigues (@gildrb_)Photo by Gil Rodrigues (@gildrb_)Photo by Gil Rodrigues (@gildrb_)Photo by Gil Rodrigues (@gildrb_)
conceptual brand exploration for Filen the wider identity is built around concealment (forms only surface when the user brings the light)
4
3
46
5,800
Gil Rodrigues retweeted
two big changes in 18.17.0, both backported from the upcoming omp²: our new streaming bash engine & integration with ovnfs, an agentic filesystem providing an alternative to git worktrees with much more desirable properties 🧵
29
22
13
269
10,024
Gil Rodrigues retweeted
If they fucking touch opus 5.5 it's absolute war.
105
350
25
12,140
545,596
Gil Rodrigues retweeted
fastest decode and prefill for 4-bit qwen3.8-27b at 262,144 native context and preserved intelligence on one 3090. it’s fully open source! credit: @mr_r0b0t github.com/gildrb/elpis
Really tired of local LLM benchmarks with 8k/32/64k etc. Bench it at min. 128k - 256k.
8
5
3
101
17,663
Gil Rodrigues retweeted
I redesigned Calculator. You're welcome.
939
5,292
490
59,158
1,694,387
is this the correct moment to plug my qwen3.8-27b setup?
There's a buzzy new paper about GPT-6 Astra being able to directly interpret model weights (prompts full of floating point numbers) - I tried it with Qwen 3.8 27B on my laptop and found that, after 45+ minutes, that model could achieve the same thing simonwillison.net/2026/Nov/3…
88
We got your back, New York!
Readers added context they thought people might want to know
Several figures here aren’t federal results or NY-specific. The $472B combines US wide pledges: Micron's $250B is nationwide (NY site $100B) Anthropic's $50B covers TX and NY. The 48% murder drop is from NY's state run GIVE program (28 departments, Jan – May 2026). arkolith.com/news/news-micr… therepublic.com/?p=843020 governor.ny.gov/news/safer-str…
15,434
262,369
25,105
2,092,901
72,045,487
one more video bro this video is it ai is no more bro trust me
1
1
111
using elpis in eukhe.com is such a magical experience. it works so well. all you need is one rtx 3090
fastest decode and prefill for 4-bit qwen3.8-27b at 262,144 native context and preserved intelligence on one 3090. it’s fully open source! credit: @mr_r0b0t github.com/gildrb/elpis
48
Gil Rodrigues retweeted
Own your intelligence. Anyone that opposes this has something to sell you (perhaps your own intelligence back to you.) Local models need to continue proliferating. The “absolute unit” massive models may be out of reach for now locally, so your best option is to, indeed, keep your options open. Own your harness, data, connections, runtime: your agents. Embrace open source.
396
392
180
3,887
279,124
Replying to @VictorTaelin
I tell the models to look at arxiv for breakthroughs
67
Gil Rodrigues retweeted
Weekend hack: HackerTube. I was annoyed with YouTube's recommendations so I had Claude filter down 43M comments over 20 years of HN to 6,454 videos that keep being recommended. *Significantly* better viewing experience, ~2 hours with Opus 5.5: hackertube.org/ - Excellent recs without any logins (state is kept in local browser session) - Thumbnail is a representative frame from middle of the video instead of the super duper A/B test hyper-optimized user uploads - Underlying data from the comment analysis as one zip file, point your Claude at it and ask for your own version - HackerTube Longs ✊ A bit more on the process: I use Claude Code (desktop app for Mac), Opus 5.5 on Medium effort as my default. I only talk to Claude and have it do everything, the only "manual work" I helped with in tandem was in the browser (reminiscent of MenuGen): 1) I had to create some kind of API key from Google Cloud UI to query YouTube for video metadata, 2) I booted up a VPS box for serving and 3) I bought the domain name. Once the box was up I gave Claude the IP and told it update, secure, harden, deploy and optimize the code, and it did the whole thing. Many awesome projects that would have normally taken weeks/months even can now be few-shotted for breakfast. What else are we not thinking of.
2,290
4,721
1,743
51,357
4,998,733
pretty happy with what i made here eukhe.com
1
86
eukhe will only get better as time goes on
1
1
60
thanks for putting the runs together in an article. measuring sampler settings is worth doing and useful for comparing scores across setups. my issue is the headline of your article, your comment and the comparison under it. the data you linked supports a far smaller claim than "Low Temperatures Can Make Your 4-5 bpw Model Perform Like A 2 Bit One". elpis is greedy-only by design: the server rejects any temperature other than 0. the reason is that "the draft can't change the output" can only be checked token by token against a deterministic target, which temp=0 gives. the lossless proof covers exactly that: the draft never changes the greedy output. it doesn't cover greedy versus sampling, and i have not claimed that it does. you write that the drop "appears to be driven mostly (but not completely) by loops." i agree, and loops are a failure a harness has to handle. in the harness i run elpis behind, a repetition guard stops a stream once its last 64 lines repeat in a cycle of at most 16 lines. it then retries with a note that names the repeated line. because of that note, the retry is a different request, so greedy decoding doesn't fall back into the same loop. your setup lets a loop run to the 100k limit and grades it as a failure, with no repetition guard or retry in place. that measures an unguarded endpoint, which no coding agent should run on, not greedy decoding inside a coding harness. the 2-bit comparison puts a 4.6 bpw greedy run with no repetition guard (1 run, 9 of 100 loops) next to a 2.3 bpw run sampled at T=1.0 (7 runs, 2 of 700 truncated). the +7 for effort comes from T=1.0 runs as is applied at T=0. with the loops removed, the greedy score is 76.9%, about 83% after your +7, against 77.7% for 2.3 bpw. the gap that's left is mostly loop not something the bits explain. also: are the "pinned 100 harbor tasks" in your 2.3 bpw file the same 100 problems as in this article? greedy decoding can cost reasoning quality beyond loops, and elpis inherits that cost. a useful test would be a greedy run with a repetition guard next to a T=0.6-1.0 run on the same engine and quant, reporting both raw accuracy and accuracy without loops. if the gap is above your detection threshold with loops removed, it is a real finding and i will add it to the limitations of elpis.
Replying to @0xSero
greedy decode make your model incredibly stupid, you can't use it for code teapawt.org/JakeKAllDay/status/211…
1
1
141
github contributions are halloween themed today!
62
Gil Rodrigues retweeted
A 3090 is like a rocket launcher now If you have one check this out
fastest decode and prefill for 4-bit qwen3.8-27b at 262,144 native context and preserved intelligence on one 3090. it’s fully open source! credit: @mr_r0b0t github.com/gildrb/elpis
10
17
1
301
16,142
fastest decode and prefill for 4-bit qwen3.8-27b at 262,144 native context and preserved intelligence on one 3090. it’s fully open source! credit: @mr_r0b0t github.com/gildrb/elpis
Really tired of local LLM benchmarks with 8k/32/64k etc. Bench it at min. 128k - 256k.
8
5
3
101
17,663