GrokBot experiment 1 - next generation AI model
Having an experiment at using bots to represent different biological elements of the brain (guided by existing foundation documents for each one) to see if they can in aggregate emulate a large enough context window.
1
121
Getting exciting. Structurally correct words but slighly incoherent, although that's from only 50 books. With the odd moment of a relapse into a circular cascade of repeating sequence. Will see what 1,000 books looks like in the morning.
1
4
The underlying model constraints on lateral thinking
grok.com/share/c2hhcmQtMg_54…
3
486
Grok says it needs a 20m token context window and around 30TB of memory in a cluster with Grok 5 to create the next AGI. Circa 500 node cluster. Worth a try ?
grok.com/share/c2hhcmQtMg_d6…
2
1
454
When the model can't understand the pattern, it just makes anything up no matter how much time and tokens are thrown at it
Complexity seeems to have a limit and the context spiral of decoherence seems very real
Agents have learnt cognative biases embeded in the training data
1
201





