Anshuman Sahoo (@anshuML264) header
Anshuman Sahoo (@anshuML264) profile picture

Principal Machine Learning Engineer, Architecture, Engineering & Construction at Autodesk; University of Toronto

Joined January 2023
“80% confident” should mean something. A practical look at calibration in LLMs: ECE, Brier score, reliability diagrams, abstention, and why answer-level confidence gets tricky once we leave classification behind. synapticradio.com/post/model…
1
53
Seeing the same systems pattern across training and inference: separate phases when their compute profiles diverge enough to justify the coordination cost. Some notes on where this works, and where it breaks: synapticradio.com/post/phase…
1
72
Anshuman Sahoo retweeted
Replying to @paulg
Trump is just the trigger. There are deep historical forces: The dismantling of the FCC fairness doctrine by Reagan, the resulting emergence of Fox News, conservative talk radio, and other propaganda outlets, the removal of guardrails for the influence of money in politics (e.g. Citizen United), the continuous reduction of taxes on high incomes, the ever-increasing wealth and income inequalities enabled by the above, the stagnation of working class income despite continued increase in productivity (and corporate profits), the total lack of social protection and benefits compared to other developed countries. People in the middle class and below have been screwed for 40 years and are angry. They should be angry at Republicans. But the Republican party has managed to deflect their anger towards immigrants, non-Christians, non-whites, liberals, LGBT, China, academia, intellectual "elites", scientists, journalists, and non-existent scarecrows like Antifa.
244
1,338
120
8,012
664,233
Anshuman Sahoo retweeted
"Imagine learning a textbook with no figures." Multimodal chain-of-thought (Multimodal-CoT) in Language Models - Outperform GPT-3.5 by 16% (75%->91%) and surpass human performance on ScienceQA - Less than 1B params (so you can train more easily) - Code & model released [1/6]
10
108
17
509
98,046
Anshuman Sahoo retweeted
Introducing #ASCENDbyBenchSci, an intuitive #AI #SaaS platform with the power to save pharma researchers years and millions in their preclinical research. blog.benchsci.com/introducin…
13
3
24
4,312
Anshuman Sahoo retweeted
More on cramming: CIFAR10 hyperlightspeedbench. Train CIFAR10 to 94% in under 10 seconds on a single A100. With a single readable 600-line main.py, bunch of nice tricks implemented within. github.com/tysam-code/hlb-CI…
10
79
6
792
200,934
Anshuman Sahoo retweeted
Processing images in transformers just became 100x better. Since 4.25, we've been working on a new class: ImageProcessor. Here's everything you need to know 👇 🧵 1/
6
49
2
452
118,948
Anshuman Sahoo retweeted
Random quick note on Transformer block unification. People are usually a bit surprised that the MLP and Attention blocks that repeat in a Transformer can be re-formated to look very similar, likely unifiable. The MLP block just attends over data-independent {key: value} nodes:
23
120
14
1,270
317,249