teapawtteapawt
$
ValenceForge (@valenceforge) header
ValenceForge (@valenceforge) profile picture

ValenceForge

@valenceforge
San Francisco
valenceforge.com/
Joined February 2022
  • Tweets196
  • Following46
  • Followers101
  • Likes565
  • Tweets
  • Tweets & Replies
  • Reposts
  • Media
  • Search
ValenceForge retweeted
Jack Morris (@jxmnop) profile picture
Jack Morris
@jxmnop18 Nov 2024
more fun open-source research news - new paper drops (nGPT) - claims 4-20x training speedup over GPT - shocking - very cool - very valuable - community tries to reproduce - doesn't hold up - turns out baseline was busted - another cool new research idea oneshotted by github anon
Image from Jack Morris (@jxmnop)
Image from Jack Morris (@jxmnop)
Grad (@Grad62304977) profile pictureGrad
@Grad6230497718 Nov 2024
Replying to @francoisfleuret
Bcs the baseline by the looks of it was wrong github.com/NVIDIA/ngpt/issue…
GPT baseline block computation error · Issue #1 · NVIDIA/ngpt

GPT baseline block computation error · Issue #1 · NVIDIA/ngpt

Hello, thank you very much for open sourcing nGPT. I have found an error in the block computation of the GPT (use_nGPT=0) baseline. The computation being done is : x = norm(x) + attn(norm(x)) x = n...

github.com
12
38
8
631
132,315
ValenceForge retweeted
Lucas Beyer (bl16) (@giffmana) profile picture
Lucas Beyer (bl16)
@giffmana14 Nov 2024
Image from Lucas Beyer (bl16) (@giffmana)
yobibyte (@y0b1byte) profile pictureyobibyte@y0b1byte14 Nov 2024
lakera.ai/blog/visual-prompt…
The Beginner's Guide to Visual Prompt Injections: Invisibility Cloaks, Cannibalistic Adverts, and...

The Beginner's Guide to Visual Prompt Injections: Invisibility Cloaks, Cannibalistic Adverts, and...

Learn about visual prompt injections, their appearance, and top defense strategies against these attacks.

lakera.ai
26
67
8
838
116,186
Load more