Thinh Truong retweeted
i hate ML conference reviewers. i take back everything bad i ever said about ACL. every ACL reviewer i ever got was at least literate
also got interrogated at melbourne airport after 30 hrs on the plane. This sucks so much 馃檭.
This quoted post is unavailable.
Thinh Truong retweeted
馃毃 New paper on Subword Tokenization 馃毃
- umLabeller, a new tool, classifies subword tokenization into morph 馃す or alien 馃懡
- alien tokenization 馃浉 leads to poorer generalizations than morphological tokenization for 3 downstream tasks. arxiv.org/abs/2404.13292 (1/7)
0-shot evaluation is important (if not more meaningful) when evaluating general capabilities of LLM.
Paper accepted to NAACL 2024 main conference.
arxiv: arxiv.org/abs/2404.02421
In this work, we explore the interaction between two bottlenecks of LLMs: negation and tokenization (quoting @karpathy: "tokenization is the root of suffering").
10/ We see that models could clearly understand negation despite incorrect tokenization. This could be an interesting phenomenon to look at when discovering LLM interpretability. Also, as English is poor in morphology, we are eager to extend this analysis to other languages.
11/ Please have a look at the paper if you find this interesting.
Big thanks to my co-author and supervisors: @YuliaOtmakhova, @karinv, Trevor, @eltimster. Finally, I will be at NAACL (my first in-person conference after almost finishing my PhD). See you in Mexico!