
owning evals and agents @AikidoSecurity | prev @Hacktronai building pimi for myself
in.ur.computer
Joined July 2017
- Tweets3.8K
- Following804
- Followers608
- Likes9.7K
Pinned Tweet
pretty happy with how my custom harness is evolving! some highlights:
- editor mode to edit, browse and review code LSP on the go with support for annotations for agents
- same-thread provider switch so rotate between diff providers and models without losing context
- PR review built-in so no need to use the abomination that is g*thub
- attack mode that does UI/UX QA testing or whatever you want. uses browsers, terminals, and desktop app testing (alfa)
- first-class annotation support for web and desktop apps. select what u want tested for the edge case rubbing against ur OCD and the agents will test exactly that
OSS forever, vibeslopped but 💖optimized💖
Sooo Java4Shell dropped and the first thing i thought was waait could Deep Review have found it and so....
I went back in 2021 to test it!
Deep review
- found the EXACT bug for java4shell
- proposed the equivalent correct fix for it too!
wild. Read the writeup and see the PR: aikido.dev/blog/dee-review-f…
oops wrong link, right one 👇 aikido.dev/blog/deep-review-…
3
368
Debarshi retweeted
Nice argument, but I’ve already released a 12M-line lean formalization that you are the soyjack and I am the chad.
update
cooked my agent orchestrator some more:
- connect to multiple remote hosts over ssh/tailscale
- spaces as a home for your mind. store papers, links, videos and reference them in chats
- ask pimi. just ask her to do things and be nice (non negotiable)
- delegate tasks from chat to different providers and switch providers in-chat seamlessly
- track tasks and updates automagically get shit done
- some nice new and live themes for those eyes chico
- view how you (ab)use your clankers, what u got done and how you can save tokens
1
54
cooked my agent orchestrator some more:
- connect to multiple remote hosts over ssh/tailscale
- spaces as a home for your mind. store papers, links, videos and reference them in chats
- ask pimi. just ask her to do things and be nice (non negotiable)
- delegate tasks from chat to different providers and switch providers in-chat seamlessly
- track tasks and updates automagically get shit done
- some nice new and live themes for those eyes chico
- view how you (ab)use your clankers, what u got done and how you can save tokens
is it worth it to get ps5? ofc for gta vi. i've never had a console.
in my country ps5 pro isn't available but I might be able to get it from EU. not sure if worth it tho is ps5 can already handle gta vi w stable fps
3
3
427
it's a pleasure working with the @Google team on these evals! stay tuned for more :)
Replying to @pilvar222
full leaderboard: aikido.dev/aikido-arena
also shoutout to my colleague @iminurputer for the wonderful work he's doing on these benchmarks :)
3
242
Debarshi retweeted
please have a good day. If your day is not good yet meybe it will be good later, or maybe your tomorrow will be a good day. Thank you
i have been building my own agent orchestrator as a fork of another project and holyshit! Supply chain is hell!
so many ways to get pwned so many vectors!!!
doesn't help that the project i forked used dependencies like rainwater anywya ive cleaned up and maintain minimalism
4
188
Debarshi retweeted
man, who should i trust? a bunch of nerds who made linux run on apple silicon, reverse engineering that pesky gpu isa among a gazillion other things, all pre-ai.
or the guy who thinks having your agent rewrite shitty rust he never looked at in x86_64 is excellence?










