🤔 OpenAI scientist Noam Brown stuns TED AI Conference: "20 seconds of thinking worth 100,000x more data" “It turned out that having a bot think for just 20 seconds in a hand of poker got the same boosting performance as scaling up the model by 100,000x and training it for 100,000 times longer” “Now we have a new parameter, one where we can scale up system two thinking as well — and we are just at the very beginning of scaling up in this direction.” buff.ly/4e49KlT

Food for thought. The argument is that your dataset trumps any model architecture.