@matsonj

excel user & data enthusiast. living the dream at MotherDuck

 Seattle, WA
hotdogbench.com
Joined July 2008
  • Tweets33.6K
  • Following2.1K
  • Followers8.9K
3.4KMedia
whomst among us
9
11
2
399
27,371
we are so back
Jacob Matson
@matsonj9h
> check my nba box score site for first time this season > api calls are 403ing > look into it > nba has blocked all vercel IPs
1
12
740
claude is funny though "oh well, lets use the espn api instead"
5
249
> check my nba box score site for first time this season > api calls are 403ing > look into it > nba has blocked all vercel IPs
2
1
38
2,366
are there any excel zero days any more or did that end in the early 2000s
1
15
871
this was my first car
lusso
@luusssso14h
The extraordinary organic futurism of British designer Ross Lovegrove Creator of the most remarkable objects of the late 1990s and early 2000s
4
17
918
i regret not getting an iPhone Duo so i could do this bit
Daniel Storm@DanielStormApps18h
Texting is really nice on the Duo
18
1,314
is this marketing? 🦋
Jacob Matson
@matsonj14h
my first act as head of PMM at MotherDuck is putting an ad on hotdogbench
5
15
706
my first act as head of PMM at MotherDuck is putting an ad on hotdogbench
2
2
20
1,275
exactly! this is why i made hotdogbench
Hamel Husain
@HamelHusain18h
BenchmarkGate is a real thing Don’t blindly trust benchmarks even popular ones We need to be doing evals on our evals
2
19
667
hotdogbench.com

hotdogbench.com · Hot dog. Not hot dog.

A rigorous benchmark for an unserious question: seven AI models, 1,000 photos, hot dog or not hot dog. GPT-6 Astra wins for top dog. Accuracy, speed and cost by model.

hotdogbench.com
1
2
82
Jacob Matson retweeted
Joel Grus 🤠
@joelgrus18h
she's a 10 but that was supposed to be a random 384-bit number
44
1,377
27
23,775
246,860
I’m going to fix this
shaurya
@shausethOct 21
excel sheets are a dying art form
4
1
22
870
xitter.cf/matsonj/status/2112924…
Jacob Matson
@matsonj19h
in celebration of duckdb 2.0 launch, the bones of a spreadsheet that runs on duckdb. target: 100m rows. same shortcuts as excel. an AI integration that makes it fast to understand how a spreadsheet works, with atomic rollback & replay.
104
in celebration of duckdb 2.0 launch, the bones of a spreadsheet that runs on duckdb. target: 100m rows. same shortcuts as excel. an AI integration that makes it fast to understand how a spreadsheet works, with atomic rollback & replay.
10
9
4
114
5,572
Jacob Matson retweeted
Farhan Thawar
@fnthawarOct 20
You can just do things
Readers added context they thought people might want to know
This is not built by Farhan, instead it is a screenshot of a video from the original creator @trunarla. x.com/trunarla/statu…
96
89
37
2,582
415,824
Jacob Matson retweeted
Andrea
@iiiitsandreaOct 20
nothing will ever come close to the feeling of a crisp Diet Coke and we should just accept this and move on:
Andrea
@iiiitsandreaOct 20
maybe making thousands of prebiotic sodas was a dumb idea
20
15
165
7,101
sir a second plane has landed
doomer
@uncledoomerOct 20
oh shit, oh fuck
1
1
20
1,342
deepseek flash update pretty decent on the connections eval. very cheap, but pretty slow (typical problem with these OSS models is they don't have good ways to control how many tokens they consume)
1
9
737
for a "single source of truth", there seems to be many versions of the truth
Sebastian Aigner 📫@sebi_ioOct 19
For a technology called *Single* Sign On, I sure find myself signing in a lot
1
1
26
1,537
Cool work but also, many such cases
Jennifer Zhou
@chem_safetyOct 19
We looked at TerminalBench 4.0 and found a lot of issues. After fixing the issues Sonnet 5.5 scores 89.2%. So, TerminalBench is already mostly saturated. Along the way we found a lot of crazy stuff, including reward hacks in the published transcripts.
3
16
1,286
It’s hard to write good evals!!
1
114
Load more