jasperanders retweeted
Did you ever see someone flipping the sign of your loss, and achieve great results? Well, this summer, we did. Some papers (refs below) suggested to reverse the self-distillation loss, i.e, move away from the teacher.
We wrote a blogpost on our investigation and our findings.
Self-distillation with privileged context shifts behavior and can hurt reasoning. Repulsion reverses the shift but becomes unstable. In our experiments, contrasting both signals improves reasoning while keeping training stable.
Blog: self-distillation.github.io/…
jasperanders retweeted
We needed VR teleoperation for intervention-based learning.
So Aurel implemented the entire stack within two days.
He now wrote an extensive blog post on the design decisions and embedded math for Pieper IK.
We also open-sourced the code.
Highly recommend for anyone into IK.
jasperanders retweeted
es tut mir so leid, dass auf den Essigessenz-Flaschen immer Gemüse drauf ist…Bro…du kommst in keinen Salat…du entkalkst meinen Wasserkocher…
jasperanders retweeted
Today we’re releasing DeepSWE, a new standard for agentic coding benchmarks.
On public leaderboards, top models often look relatively close in capability. DeepSWE shows where they actually diverge, reflecting the realistic experience of developers in their day-to-day work.
jasperanders retweeted
Makes so much sense to share things this way in a AI native era.
I built .bdf to easily share html directly from my agents.
I use Claude a lot to create html slides and documents, but sharing plain html with others is annoying.
.bdf gives you a shareable link in a single prompt.
give it a try: bdf.pub
jasperanders retweeted
Sharing our latest work: Reinforcement Learning via Self-Distillation
We introduce Self-Distillation Policy Optimization (SDPO), an on-policy RL algorithm that turns feedback into dense, token-level learning signals.
jasperanders retweeted
irgendwann hast du zum ersten Mal eine E-Mail empfangen und es hat seitdem nicht mehr aufgehört, es wird nie mehr aufhören, irgendwann hört dein Herz auf zu schlagen und die E-Mails werden weiterhin kommen
jasperanders retweeted
3/5
„Es ist jetzt sinnvoll die Menschen vor den Kauf von neuen Benzin und Diesel Autos zu schützen!“
jasperanders retweeted
I love finding New Yorker cartoons so dated that the joke is lost entirely and the cartoons become just descriptions of people doing normal things.
jasperanders retweeted
Noch mal zur Klärung:
Die BVG ist nicht das Bundesverfassungsgericht.
Wir halten Notbremsen aber ebenfalls für richtig.
jasperanders retweeted
DER @Tech4Germany JAHRGANG 2021 💙🥳🚀
@HBraun @BAMResearch @BMFSFJ @BMVI @Bundestag @ITZBund @lehnerpat @katja_anokhina @Lergin_ @GroteSophia @NilsThamm @sinado @BKorkmaz_KD @jasperanders3
jasperanders retweeted
FELLOWSHIP 2021 🚀🥳💙
Die 7 Projektteams für das diesjährige Fellowship stehen fest! 🤝
28 Fellows & 28 Verwaltungsmitarbeitende werden in nur 3 Monaten nutzer:innenzentrierte #Software-#Prototypen für Bundesbehörden entwickeln.
Alle Infos hier 👇
🔗: tech.4germany.org/fellowship…






















