Cofounder and CRIO of AMI Labs. Chair Professor of ECE, HKUST. Fellow of AAAI, ACL, IEEE, ISCA.

Paris, France
Joined August 2010
Pascale Fung retweeted
为什么现在的顶尖大模型说话越来越“拗口、难懂”了? NYU 和 UT Austin 刚刚发了一篇非常扎心的心理语言学论文,直接扒开了现代大模型“不好好说人话”的底牌。 研究人员把 Claude Sonnet 5 / Opus 5.5、GPT-5.6、GLM-5、Kimi K2.5 等 9 款前沿模型拉出来做全方位句法解剖,发现了 3 个反直觉真相: 1️⃣ 顶尖 AI 正在滥用 6 种“高认知负荷”句式 相比真实人类写作和同义回译文本,前沿模型极度偏爱:省略 that 的宾语从句、多重名词硬堆叠(如 reader-patience budget)、名词强行作动词(如 calendar it / footnote it)、无生命主语配动作动词,以及超长句法依存距离。这些特征在心理语言学里全是消耗人类短期记忆的“阅读杀手”。 2️⃣ 根源在于“人类大脑”与“推理后训练”的错位 人类语言遵循“均匀信息密度(UID)”——为了照顾听众有限的工作记忆,我们会本能地加入过渡词把信息摊平。而现代大模型经过大量数学、代码和推理(RLVR)后训练,只追求在有限窗口内最大化“信息密度”。 3️⃣ 一个简单的长度惩罚,就能复刻这种“反人类文风” 团队在微调实验中加入长度惩罚(Length Penalty),逼模型少用 Token,结果模型立刻学会了砍掉连接词、堆叠名词,瞬间变成那股熟悉的“高密度 AI 味”。 当模型为了解题效率疯狂压缩 Token 时,你觉得未来的 AI 应该区分“高密度推理模式”和“人类友好沟通模式”吗?
78
162
52
1,569
117,362
The ugly truth about France and some of the other European countries currently in turmoil - and which none of the politicians want to admit because it'd be political suicide - is that you can't solve the problem by going after immigrants (as the right asserts) or the rich (as the left asserts), but you could solve it by going after the old. One extraordinary statistic for you: people over 60 in France, a quarter of the population, own 60% of France's wealth, non-financial and financial (ofce.fr/pdf/revue/2025/3-192…). And here is another crazy statistic: that same quarter of the population, those above 60, receive nearly two-thirds of all social spending by the French government (previssima.fr/actualite/prot…) - which is famously among the highest in the world (France's government spending is an insane 57.3% of GDP). Last statistic: they make up about 40% of voters because they're a third of registered voters (insee.fr/fr/statistiques/266…), and they turn out far more than anyone else (franceinfo.fr/elections/sond…). Put our 3 statistics together and there's almost a bit of an apartheid situation here: the old own most of the country's wealth, collect most of the social spending and have the political power to keep it that way. Which makes them a de-facto rentier class, living off assets and transfers paid for by younger generations. And, of course, at the risk of stating a truism, the future is built by the young. Yet France keeps effectively taking money away from them to give it to those whose working lives are already behind them - and need the money far less since they already own the country's wealth. What about inheritance, I hear you ask? That's the funniest/saddest aspect: given that life expectancy has kept rising, the French now inherit a home at 54 on average. The most common case is someone in their 80s leaving it to heirs in their 50s, in effect the very old transferring wealth to the about-to-be old (insee.fr/fr/statistiques/fic…). You can add this to our earlier apartheid statement: on top of all the rest, even when the old finally let go of their wealth, it stays within their own "camp". That's my personal situation, incidentally: I'm 42, my father is 71 and he is starting to look at ways to pass things on to me and my siblings, when our professional lives are already well settled, so it'll arrive when it changes things the least, which is pretty much the French system in a nutshell. Now, I get that there'd be some unfairness in going after them: they paid into the system their entire working lives, playing by the rules of a social contract that told them if they paid up they'd collect at the end. Changing the rules now means breaking that promise, which is admittedly unfair. But there's no magic wealth tree in any society: you can only take it where it is. That's the way most major societal transformations end up happening. They're often triggered by a catastrophic event (the so-called "four horsemen": mass-mobilisation war, revolution, state collapse, plague) BUT what really drives change is a transfer: wealth gets pried from the privileged class who've been sitting on it and handed to those who'll build what comes next. So, in theory and in an ideal world, you can do without the catastrophic event and directly proceed with the transfer... The fact that in France, and elsewhere in Europe, it's the youth protesting is probably no coincidence - even though they don't frame it as a generational fight. And even though, cruel irony, the left politicians many of them march behind promise to bring the retirement age back to 60 (lcp.fr/actualites/legislativ…), which would make the situation even worse. Let's say they understand intuitively that the system is stacked against them, even if they haven't yet figured out how. And politicians are obviously doing what politicians do, meaning pandering to the people who actually vote, while pointing the young towards easier - and politically convenient - scapegoats. To be clear I'm not saying it's the only problem in France, VERY far from it. I'm also not saying that all old people in France live a lavish lifestyle at the expense of younger generations: there are also plenty of very poor retirees who, if anything, would deserve more. What I am saying is that it's probably the biggest elephant in the room: everyone can see it, nobody dares mention it - no politician, from any side, wants to run on cutting grandma's pension - and it makes every other problem harder to fix.
899
1,950
387
11,070
1,499,757
Met the goat @ylecun Ty @amilabs for the lovely event~ so many lovely amazing people <3
10
4
14
279
178,110
Pascale Fung retweeted
WIRED
@WIREDMar 10
Meta’s former chief AI scientist has long argued that human-level AI will come from mastering the physical world, not language. His new startup, AMI, plans to prove it. wired.com/story/yann-lecun-r…
50
125
12
559
71,769
See our paper on arXiv (arxiv.org/abs/2601.10592) -- Action100M: A Large-scale Video Action Dataset by Delong Chen (@Delong0_0), Tejaswi Kasarla (@tkasarla_), Yejin Bang (@yejin_bang), Mustafa Shukor (@MustafaShukor1), Willy Chung (@willyhcchung), Jade Lei Yu, Allen Bolourchi (@AllenBolourchi), Théo Moutakanni (@TheoMoutakanni), and Pascale Fung (@pascalefung). Dataset can be acceesed from this repo: github.com/facebookresearch/… – at Paris, France
1
2
24
2,649
We release Action100M, the hero behind VL-JEPA. It is a large dataset with O(100 million) dense action annotations on HowTo100M procedural videos. We hope it serves as a robust data foundation to advance physical world modeling research.
Meta just released Action100M on Hugging Face A massive video dataset with 100M+ hierarchical action annotations. Every video includes tree-of-captions with action labels, brief and detailed summaries.
9
37
10
341
103,879
Thanks @_akhaliq for sharing! More about our VLWM: - Non-pixel-generative world model that reasons in abstract semantic space - Learned from 20k hours of unlabeled egocentric / web procedural videos with 5.7M action steps - System-2 planning with reasoning by cost-guided plan search Congrats to the whole team! @TheoMoutakanni @willyhcchung @yejin_bang , @ZiweiJi184538 @AllenBolourchi @pascalefung
Planning with Reasoning using Vision Language World Model
1
7
1
31
7,819
Pascale Fung retweeted
Announcing the newest releases from Meta FAIR. We’re releasing new groundbreaking models, benchmarks, and datasets that will transform the way researchers approach molecular property prediction, language processing, and neuroscience. 1️⃣ Open Molecules 2025 (OMol25): A dataset for molecular discovery with simulations of large atomic systems. 2️⃣ Universal Model for Atoms: A machine learning interatomic potential for modeling atom interactions across a wide range of materials and molecules. 3️⃣ Adjoint Sampling: A scalable algorithm for training generative models based on scalar rewards. 4️⃣ FAIR and the Rothschild Foundation Hospital partnered on a large-scale study that reveals striking parallels between language development in humans and LLMs. Read more ➡️ go.fb.me/q5l4cz
63
309
84
1,527
900,048
Chair Professor and Director, Center for Artificial Intelligence Research, Prof. Pascale Fung (@pascalefung) emphasised that developments in AI and technology should be inclusive, encompassing the Global South and underrepresented communities.
1
1
9
1,766
This is quite simply the best ad I've ever seen. #BlueWave2024
350
5,985
575
14,739
915,343
As a reminder, The US has had 46 presidents. Among them, there have been 91 criminal felony charges indicted. Those charges are distributed among the presidents as in the following list: 1/2
2,614
31,291
1,324
217,371
8,344,284
WOW! I’ve seen a lot of campaign ads during my time in politics, and @KamalaHarris’ latest one is 🔥🔥 Video via @MeidasTouch #HarrisWalz2024 #NotGoingBack #VoteBlue
254
5,410
369
14,500
624,355
Why are we endorsing Kamala Harris? She has run an impressive campaign and seems to appreciate the need for centrist politics in America today. But, more importantly, a second Trump term comes with unacceptable risks. We explain why she gets our vote econ.st/48vkFUw

979
1,914
180
5,161
446,300
Very excited to share our latest open source advancements in embodied AI from Meta FAIR: new work across touch perception, dexterity, and human interaction with robots. Crucially important capabilities on the journey towards Advanced Machine Intelligence. ai.meta.com/blog/fair-roboti…
4
27
148
33,154
Please retweet this brand new ad from Kamala Harris
260
8,618
322
13,577
481,034
I voted for @KamalaHarris without hesitation. When it comes to policy and personal integrity, the contrast could not be clearer, and I hope undecided voters with a history of supporting candidates in both parties join me. bloombg.org/4ecs0cX
9,629
15,209
1,056
81,905
2,603,646
The Economist is endorsing Kamala Harris. By making Donald Trump leader of the free world, Americans would gamble with the economy, the rule of law and international peace. Voters who minimise the risks are deluding themselves econ.st/4fluZAw 👇
1,213
4,867
477
13,601
1,010,165
Pascale Fung retweeted
Trump has unfathomably idiotic policy proposals. Many of them are impractical, illegal, or against the constitution. But because he is an unfathomable idiot himself and because only idiots are willing to work with him, he is also totally ineffective when it comes to implementing his proposals, even those that are not illegal.
This Post is from an account that no longer exists. Learn more
126
151
11
1,268
185,538