Research Scientist, Isomorphic Labs

London, England
Joined December 2016
New work with @lars__schaaf, @WillLin1028, @wanggrun, and @philiptorr: We optimize neural networks to smoothly represent minimum energy paths and predict transition states for chemical reactions. Compared to the traditional approach, our method shows (i) improved resilience to the initial guess, (ii) easy adaptability to escape local minima, (iii) the ability to capture a complex path on its own, and (iv) potential to generalize to unseen systems. This offers a flexible alternative to discrete methods that could unlock building a universal reaction path predictor. Our paper should appeal to anyone interested in machine learning to advance computational chemistry. Preprint: arxiv.org/abs/2502.15843.
1
7
17
1,380
Are RGB inputs good enough for open-world generalization of object detection? Excited to share our #ICLR2023 paper GOOD -- we show that geometric cues can significantly boost the performance for the task! arxiv.org/abs/2212.11720 (Joint work with @AutoVisionGroup @isDanZhang )
3
20
1
56
10,776
How can we leverage successful pretraining techniques from transformers to improve purely convolutional networks? The answer is *Sparse Convolutions*! Let's see what happens when purely convolutional networks are pretrained with 1.28 million unlabeled images ... 1/7
9
101
5
482
146,872
Designing BERT for convolutional networks: sparse and hierarchical masked modeling Keyu Tian, Yi Jiang, Qishuai Diao, Chen Lin, Liwei Wang, Zehuan Yuan tl;dr: create image, which looks to CNN same, as transformers -> MIM starts working arxiv.org/abs/2301.03580.pdf
4
25
1
116
25,355
The paper designs a working MLM style pretraining for convnets! Huge if this really works.
Designing BERT for convolutional networks: sparse and hierarchical masked modeling Keyu Tian, Yi Jiang, Qishuai Diao, Chen Lin, Liwei Wang, Zehuan Yuan tl;dr: create image, which looks to CNN same, as transformers -> MIM starts working arxiv.org/abs/2301.03580.pdf
1
2
847