Internet man with personal thoughts. Pseudo scientist through Gฬถoฬถoฬถgฬถlฬถeฬถ AI.

30.83001,108.355886
Joined May 2008
Fresh reset. Fresh coding workflow. ๐Ÿš€ Try StudioCat! ๐Ÿˆ studiocat.app/
Day 23/ Much requested iCloud Main & Calendar plugins. Just kidding, today is a reset. Still much requested though!
1
1
60
้—ฎๅ›ไธบไฝ•ๅคœ็‹ฌ่กŒ๏ผ
53
ๆŠŠๆ‰€ๆœ‰็š„่ฎพๅค‡้ƒฝๅ‡็บงๅˆฐ 26.7.2๏ผŒ่ฏดๆ˜ฏ็‰ˆๆœฌๅง๏ผ
192
Faster AI. Smarter agents. ๐Ÿš€ Now give them a real workspace. StudioCat turns GPT Chat into a local coding workspace on your Mac. ๐Ÿˆ Try studiocat.app/
Day 22/ Terra is back! Our first model that is significantly better at writing, personality and nuanced understanding of requests. Packs a punch across the board, very good at computer use, and gives 2X more usage than 6.1 Sol across API and subscriptions.
1
3
159
๏ผˆ็™ฝ๏ผ‰ๆฏ”๏ผˆ้ชจ๏ผ‰็ฟผ๏ผˆ้กถ๏ผ‰้ธŸ๏ผˆ้ธก๏ผ‰
56
่ฟ™ๅฐฑๆ˜ฏๅšๅ‰็ซฏๅ’ŒๆœๅŠก็ซฏ็š„ๅŒบๅˆซ๏ผ
Tibo็š„28ๅคฉ่ฎกๅˆ’็š„ๆ”นๅŠจ๏ผŒๅซ้‡‘้‡ๅˆฐๅบ•ๆœ‰ๅคš้ซ˜ๅ‘ข๏ผŸ ๆˆ‘่ฟ™ไนˆ่ฏดๅง๏ผŒ ๆ‰€ๆœ‰็š„ๆ”นๅŠจ้ƒฝไธๅฆ‚ๅทฆไธ‹่ง’๏ผŒ ่ฟ™ไธชๆ–ฐๅขž็š„้ขๅบฆๆ˜พ็คบๆŒ‰้’ฎ่ฎฉๆˆ‘ๅฐ่ฑกๆทฑ...
1
1
161
ๅ…จไฝ“้ƒฝๆœ‰่ฟ›ๆญฅๆœบไผšไบ†ๅ“ˆ๏ผ
"A Fix for Softmax and Cross-Entropy" Turns out two of the most fundamental functions in deep learning have numerical bugs that can actually destabilize training. This paper proposes simple fixes to softmax and cross-entropy that prevent tiny gradients from incorrectly rounding to zero, or remaining nonzero when they should vanish, as these errors can cause sudden loss spikes and interfere with knowledge distillation. On small-scale grokking benchmarks, the fixes eliminate Slingshot loss spikes and improve test accuracy from 94.3% to 100% in one setting. They also prevent student models from drifting away from their teachers during distillation, without requiring higher numerical precision. alphaxiv.org/abs/2610.31642
89
็”จ studiocat.app ้€š่ฟ‡ #ChatGPT ็ผ–็จ‹่ฟ™ไนˆไน…๏ผŒ็ฌฌไธ€ๆฌก็œ‹ๅˆฐ้…้ขๆ็คบไบ†๐Ÿ˜‚ PS๏ผš็กฎ่ฎค RESET ๆ—ถ้—ดๆ˜ฏไธŽ #Codex ไธ€่‡ด๏ผŒไฝ†้ขๅบฆๆ˜ฏ้š”็ฆป่ฎก็ฎ—๏ผ
1
153
๐–’๐–ˆ๐–˜๐–•๐–—๐–Ž๐–“๐–Œ retweeted
Replying to @thsottiaux
Try studiocat.app if you want to scale your #ChatGPT abilities!
1
27
GPT ็š„่ฎฐๅฟ†้‡Œๆˆ‘็š„็”Ÿๆดป่ฟ˜ๅพˆไธฐๅฏŒ๏ผ
56
๐–’๐–ˆ๐–˜๐–•๐–—๐–Ž๐–“๐–Œ retweeted
"The pace, and the expectations that came with it, felt almost as jarring [in China] compared with America as America's pace does compared with Europe. Everyone was just on it, all the time." world.hey.com/dhh/seven-yearโ€ฆ
116
103
45
1,248
198,858
้š็€ AI ่ฎฉๆฏไธชไบบ้ƒฝๅฏไปฅๅˆ›ไฝœ่‡ชๅทฑ็š„่ฝฏไปถ๏ผŒๆœชๆฅ 10 ๅนดๅœจ็บฟๆ•ฐๆฎๆœๅŠก๏ผŒๅฆ‚้Ÿณไนใ€็Ÿญ่ง†้ข‘ๅ’Œ็”ตๅ•†็ญ‰๏ผŒๅฐ†ๆˆไธบไธ‹ไธ€ไธชๅทจๅคด่ฏž็”Ÿไน‹ๅœฐ๏ผ
64
๐–’๐–ˆ๐–˜๐–•๐–—๐–Ž๐–“๐–Œ retweeted
Replying to @thsottiaux
RESET SOON?
1
15
ๅผบๅฆ‚ #OpenAI ้ƒฝๆ— ๆณ•ๅœจๆ— ้™ๅผน่ฏ๏ผˆTokens๏ผ‰ไธ‹ๅฎž็Žฐๆฏๆ—ฅๆ›ดๆ–ฐ๏ผŒๅพˆๅคšไบบ่ฟ˜ไปฅไธบ่‡ชๅทฑ็š„ไบงๅ“ๆ— ๆณ•่พพๅˆฐ็›ฎๆ ‡ๆ˜ฏๅ› ไธบ tokens ไธๅคŸ๏ผ
๐Ÿค– Made with AI
57