David Tao (@Taodav) profile picture

final year phd reinforcement learning

Joined January 2010
Photo by David Tao (@Taodav)Photo by David Tao (@Taodav)Photo by David Tao (@Taodav)Photo by David Tao (@Taodav)Photo by David Tao (@Taodav)Photo by David Tao (@Taodav)Photo by David Tao (@Taodav)Photo by David Tao (@Taodav)Photo by David Tao (@Taodav)Photo by David Tao (@Taodav)
lol this paper is what happens when we get rid of peer review
Replying to @rikiyatakehi
4/6 Writing from scratch: given MinAtar game rules and code, Astra wrote a Breakout network's weights in a single reply. With zero training or tools, it scored 20× higher than PPO trained for 500M steps!
14
5
414
32,241
peer review should come back with both writing and reviewing done by humans
12
914
THIS. If you can’t even explain it in your own words, then how could you possibly take responsibility for the work?
New blogpost: my lab's AI policies and norms. I'm trying to figure out how researchers should make use of AI to accelerate discovery without letting it replace human understanding or falling off the "slop cliff." Here are some ideas. babieslearninglanguage.blogs…
1
2
23
1,805
cosmic horrors exist in the real world, and they take the shape of Elizabeth Holmes and her relationships
1
8
491
What is TMLR doing under a 300% increase in submissions? - Suspensions of >150 authors - Publicly naming major violations - Submission quotas distinguishing slop patterns - Desk rejections 6% → 53%; focus on clarity - AI reviews evaluating soundness blog.tmlr.org/2026/adapting-…
4
82
19
642
71,396
should submitting slop papers/reviews be considered academic dishonesty?
1
6
474
they made Alien
"Most powerful foundation world model" hallucinates like crazy
1
587
the +1 in the middle is insane
Demo showing how you can coordinate agents with Durable Actors! This almost won me the @ycombinator demo showcase. lost in the finals to a robotic arm playing Doom 😭
4
369
finished my Amazon internship last week. Toilet Paper is solved folks
3
2
28
1,471
Check em out!!!
Terse is joining the YC F26 batch! We are the open-source alternative to Cloudflare's Durable Objects, with configurable compute, data residency guarantees, direct access to Sqlite storage, a multi-tenant environment and concurrency safety by default. And it's very fast!
3
335
I'm excited to share Erik's work! Mastering Atari 2600 Games with Discovered Options We have a general-purpose option-discovery method that works w/ high-dimensional observations, tabula rasa, using a single stream of experience! It outperforms DreamerV3, Rainbow, and IQN! 1/9
4
46
6
282
16,137
David Tao retweeted
Excited to be back at @Cohere_Labs for a talk! It’s been a couple of years since I was last there! Looking forward to sharing what I have been working on in AI for mathematics:) Thanks to the organizers for the invitation!
Our ML Math group, led by @KatrinaL2899 and @neel_ghoshal will host @Robertljg for a session focus on Building Trustworthy AI for Mathematics and Science on Monday, October 5th! 🔥 Learn more and register: luma.com/jfw5wkkc
3
1
24
1,953
pace the frontier uwu
Your dot is ready to meet you.
2
274
为什么一个那么亲切的东西可以摆出如此恐怖的姿态
2
225
dang
We are again recruiting @bold_lab_ai - please share the love 🙏. We are looking for: 1) Postdocs (my.corehr.com/pls/uoxrecruit…) -- deadline 9th of Oct at noon 2) research assistants (my.corehr.com/pls/uoxrecruit…) -- deadline 9th of Oct at noon 3) Strategic Partnership Project Manager (my.corehr.com/pls/uoxrecruit…) -- deadline 14th of Oct at noon
127
221
42
6,840
607,002
dang this has popped off. I’m looking for a job (doing rl) folks! graduating from my phd soon check me out and pay me more than this postdoc taodav.cc
1
1
14
2,202
After playing around with Jev, I'm not convinced it has "solved" system 1 decision making. Here's the intuition in a generated graphic:
🤖 Made with AI
2
6
1,298
they should call the third party evaluators scythes
We Must Pace the Frontier: I’ve written a new essay on why the AI industry should slow down, with a three-part plan for doing so. Anthropic is unilaterally committing to the first of these steps. We’ll provide third-party evaluators with permanent, employee-level access to our systems, so that they can verify adherence to our safety measures, report on incidents, and assess models’ alignment during training. You can read the full post here: darioamodei.com/post/we-must…
3
643
Insane. What’s next, a doc by Eric Andre feat. Jho Low?? They are pushing boundaries
YOU CAN SEE EVERYTHING, a documentary by Nathan Fielder and Lance Oppenheim. Featuring Elizabeth Holmes. Only in theaters this October.
4
870
I’ve started coding again. Don’t let them deprive you of process knowledge
4
288