Introducing "composite embeddings" 🧬 :
huggingface.co/blog/apehex/t…
This technique makes tokenization entirely obsolete.
1
1
57
Excited to introduce `tokun`, a game-changing #tokenizer for #LLM.
It could bring the size of #llama3 down by a factor 10 while improving capabilities!
github.com/apehex/tokun/blob…
1
1
82
Contrary to traditional tokenizer, `tokun` is a CNN VAE.
It produces more compact and meaningful tokens.
It works evenly on the whole Unicode space, Korean as well-as Arabic, English or emojis!
1
1
77
The current implementation is in Tensorflow / Keras.
You'll find the package along with weights and embeddings here:
github.com/apehex/tokun/
1
66
I created a stateless password manager using neural networks, GPM:
apehex.notion.site/GPM-Gener…
1
68
Apehex retweeted
Evasion Techniques are a scammer’s game, but Forta Network researcher @4pe0x is flipping the script! 📜
Discover how attackers’ deception tactics can become part of a defender’s toolkit in Forta’s latest blog 👇
forta.org/blog/flipping-the-…
Just made a Forta bot to scan for batch transactions:
explorer.forta.network/bot/0…
It detects phishing / sleepdrop / address poisoning on all chains, because of the spraying.


