Ph.D. student @umdcs @ClipUmd NLP, Retrievers, Human-AI, Efficient Methods Past: @ContextualAI @Cohere @GoogleAI @theteamatx ๐Ÿš€ he/him ๐Ÿณ๏ธโ€๐ŸŒˆ

College Park, MD
Joined January 2011
Can you spot when AI bluffs?๐Ÿค– Can you outguess AIโ€”or work with one to dominate trivia?๐Ÿ ๐Ÿ† We are hosting the first Humanโ€“AI coop trivia (Quizzing) competition. ๐ŸŽฒPlay, ๐Ÿ› ๏ธbuild, or โœ๐Ÿผwrite questions... ..and win prizes ๐ŸŽ. ๐Ÿฅณ Itโ€™s fun, free, and happening this June ๐Ÿง ๐Ÿค–๐Ÿ‘‡
1
15
3
19
3,557
Maharshi Gor @ ACL2026 ๐Ÿ๏ธ retweeted
๐Ÿšจ New Paper! ๐Ÿšจ Multiple-choice benchmarks use accuracy (boring), but education has way cooler scoring schemes! ๐Ÿคฉ ๐Ÿ‘Ž Lose points if wrong ๐Ÿ” Try until you're right ๐Ÿƒ Wager points At #EMNLP2026, we show these schemes shift LLM ranks, align with LLM Arena, + unmask LLM quirks
5
21
1
95
3,413
Maharshi Gor @ ACL2026 ๐Ÿ๏ธ retweeted
๐Ÿšจ New Paper! ๐Ÿšจ Your agent is writing code faster than you can understand it ๐Ÿ˜ฌ In our controlled online study, coding agents helped users finish tasks quickly, but reduced how well they understood the code they just โ€œwroteโ€ We also find three ways to avoid this tradeoff ๐Ÿ‘‡๐Ÿงต
5
40
2
128
9,623
Maharshi Gor @ ACL2026 ๐Ÿ๏ธ retweeted
Introducing Voice Arena STT Leaderboard. LibriSpeech is older than the transformer. FLEURS is people reading translated Wikipedia sentences aloud. This is still how the industry ranks speech models. In 2026. Today we're releasing the Voice Arena STT Leaderboard - a human-verified benchmark for STT accuracy on real, spontaneous conversation, across 7 languages: ๐Ÿ‡บ๐Ÿ‡ธ US English, ๐Ÿ‡ฎ๐Ÿ‡ณ Hindi, ๐Ÿ‡ง๐Ÿ‡ฉ Bangla, ๐Ÿ‡ง๐Ÿ‡ท Brazilian Portuguese, ๐Ÿ‡ป๐Ÿ‡ณ Vietnamese, ๐Ÿ‡ท๐Ÿ‡ด Romanian & ๐Ÿ‡ธ๐Ÿ‡ฆ Arabic ๐Ÿงต US English Leaderboard โฌ‡๏ธ
4
100
2
76
4,304
๐Ÿ“ Presenting this on July 5 at 11:00 AM in Poster Session A at #acl2026nlp. ๐Ÿ“œ: arxiv.org/pdf/2605.28255 Come chat about when humans should let AI take the wheel, when they should push back, and what live human-AI collaboration reveals that static benchmarks miss.
๐Ÿงต Trusting AI is not one decision. In our ACL 2026 paper, expert trivia players had to decide when to let AI answer, when to ignore it, and when to change their minds because of it. The main failure mode was not blind trust.
2
9
726
Maharshi Gor @ ACL2026 ๐Ÿ๏ธ retweeted
We made a trivia game that has humans and computers cooperate: humans could let AIs buzz in for them to answer trivia questions (complete delegation) and then they worked with computers to answer other trivia questions collaboratively. Come to #acl2026nlp Poster Session A!
3
3
11
805
๐Ÿงต Trusting AI is not one decision. In our ACL 2026 paper, expert trivia players had to decide when to let AI answer, when to ignore it, and when to change their minds because of it. The main failure mode was not blind trust.
2
3
1
5
1,141
๐Ÿ› ๏ธ We distill 5 guidelines for human-AI systems
1
1
27
๐Ÿ™ Huge thanks to everyone without whom this wouldn't be possible: my amazing co-authors: @YooYeonSung1, @houyu0930, @enfleisig, Irene Ying, @zhoutianyi, and @boydgraber; the UMD CLIP group; all participants and question writers/editors.
1
39
Maharshi Gor @ ACL2026 ๐Ÿ๏ธ retweeted
Earlier this month I successfully defended my PhD and graduated from UMD! ๐Ÿข Thanks to everyone who played large or small role in making these last 5 years an amazing experience. Next stop, Toronto! Defense recording: youtu.be/j8YIv25ge9Q
5
7
62
3,414
Maharshi Gor @ ACL2026 ๐Ÿ๏ธ retweeted
Our work on human-computer QA is the cover of UMD's Enterprise Magazine, featuring the work of @YooYeonSung1 , @enfleisig , @maharshigor, @h__j___han, @EntilZhaPR , @ihsgnef, @MohitIyyer (and many others). Links below. We need people for next competition!
1
5
15
1,013
Maharshi Gor @ ACL2026 ๐Ÿ๏ธ retweeted
How2Everything will appear in ICML 2026! See you in Korea ๐Ÿซก We mine the web's procedural knowledge to better evaluate & train LLMs to generate valid step-by-step instructions, read more at: ๐Ÿ”— arxiv.org/pdf/2602.08808
LLMs often generate step-by-step instructions, from real-world tasks (how do I file taxes?) to plans for AI agents. Improving this is hard: outputs can sound fluent for steps that don't work, and current datasets cover few domains. How2Everything evals/trains for this at scale. ๐Ÿงต
7
1
71
10,662
Maharshi Gor @ ACL2026 ๐Ÿ๏ธ retweeted
Can you spot when AI bluffs? Can you outguess AI or work with one to dominate trivia? Can you make an AI that can figure out tricky visual questions?
1
14
2
19
9,977
Maharshi Gor @ ACL2026 ๐Ÿ๏ธ retweeted
Super grateful to have four papers at #ACL2026 main! Thanks to all my co-authors from UMD, NYU, Ai2 + more ๐ŸŽ‰๐Ÿฅน Expect lots of "๐Ÿšจ NEW PAPER" posts coming from me soon ๐Ÿ˜…
3
3
1
90
4,210