Andrea | πŸ‡ΈπŸ‡ͺπŸ‡ͺπŸ‡ΈπŸ‡»πŸ‡ͺ (@aicoding_) header
Andrea | πŸ‡ΈπŸ‡ͺπŸ‡ͺπŸ‡ΈπŸ‡»πŸ‡ͺ (@aicoding_) profile picture

Computer Vision Engineer currently working as a Machine Learning Engineer. https://teapawt.org/t.co/xLVKLO30rv https://teapawt.org/t.co/DiKrU5Eya5

Joined July 2016
Andrea | πŸ‡ΈπŸ‡ͺπŸ‡ͺπŸ‡ΈπŸ‡»πŸ‡ͺ retweeted
Introducing Critique Fine-Tuning (CFT): a more effective SFT method for enhancing LLMs' reasoning abilities. πŸ“„ Paper: arxiv.org/pdf/2501.17703 CFT is simple: instead of training models to directly answer questions, we train them to critique noisy answers. What's fascinating is that while most approaches focus on using generative critique or reward models to provide feedback for policy models, these critique models can themselves serve as policy models: directly answering questions with stronger reasoning. Interestingly, we also found that CFT saturates quickly: overtraining on critiques can even degrade problem-solving performance. Work led by @YuboWang726 and collaborated with @WenhuChen
11
69
2
304
23,182
Andrea | πŸ‡ΈπŸ‡ͺπŸ‡ͺπŸ‡ΈπŸ‡»πŸ‡ͺ retweeted
Run DeepSeek-R1 (671B) locally on @OpenWebUI - Full Guide No GPU required. Using our 1.58-bit Dynamic GGUF and llama.cpp. Tutorial: docs.openwebui.com/tutorials…
16
174
12
828
67,743
Andrea | πŸ‡ΈπŸ‡ͺπŸ‡ͺπŸ‡ΈπŸ‡»πŸ‡ͺ retweeted
You don't need a reasoning model like R1 or o3, just use this .cursorrules with Claude Sonnet to add a thinking step, works 100x better.
79
268
29
4,819
558,757
Andrea | πŸ‡ΈπŸ‡ͺπŸ‡ͺπŸ‡ΈπŸ‡»πŸ‡ͺ retweeted
πŸ”₯ o3-mini-high beats deepseek r1 and o1-pro! in a p5.js challenge! 03-mini result is so good that deserves a video on its own. deepseek r1 (bad result) and o1-pro (better) in comments below. Prompt in last comment. 1/4
68
120
31
1,162
463,580
Andrea | πŸ‡ΈπŸ‡ͺπŸ‡ͺπŸ‡ΈπŸ‡»πŸ‡ͺ retweeted
Transformers can overcome easy-to-hard and length generalization challenges through recursive self-improvement. Paper on arxiv coming on Monday. Link to a talk I gave on this below πŸ‘‡ Super excited about this work!
19
137
18
990
166,865
Andrea | πŸ‡ΈπŸ‡ͺπŸ‡ͺπŸ‡ΈπŸ‡»πŸ‡ͺ retweeted
o3-mini is out! smart, fast model. available in ChatGPT and API. it can search the web, and it shows its thinking. available to free-tier users! click the "reason" button. with ChatGPT plus, you can select "o3-mini-high", which thinks harder and gives better answers.
1,569
1,921
673
25,580
3,161,254
Andrea | πŸ‡ΈπŸ‡ͺπŸ‡ͺπŸ‡ΈπŸ‡»πŸ‡ͺ retweeted
what up guys, I made a one-page comparison of MHA and MLA from @deepseek_ai for those who skipped the DS-V2 paper. pls correct me if I'm wrong.
4
49
1
356
39,301
Andrea | πŸ‡ΈπŸ‡ͺπŸ‡ͺπŸ‡ΈπŸ‡»πŸ‡ͺ retweeted
πŸ“šπŸ€– Advanced RAG + Agents Cookbook A comprehensive open-source guide delivering production-ready implementations of cutting-edge RAG techniques with AI agents. Built with LangChain and LangGraph, it features advanced implementations like Hybrid, Self, and ReAct RAG. Learn more: github.com/athina-ai/rag-coo…
5
160
6
695
61,209
Andrea | πŸ‡ΈπŸ‡ͺπŸ‡ͺπŸ‡ΈπŸ‡»πŸ‡ͺ retweeted
Fuck it, today we're open-sourcing the codebase used to train SmolVLM from scratch on 256 H100sπŸ”₯ Inspired by our team's effort to open-source DeepSeek's R1 training, we are releasing the training and evaluation code on top of the weights 🫑 Now you can train any of our SmolVLMsβ€”or create your own custom VLMs!
34
208
18
1,266
98,764
Andrea | πŸ‡ΈπŸ‡ͺπŸ‡ͺπŸ‡ΈπŸ‡»πŸ‡ͺ retweeted
OpenAI o3-mini System Card
11
69
6
358
46,668
Andrea | πŸ‡ΈπŸ‡ͺπŸ‡ͺπŸ‡ΈπŸ‡»πŸ‡ͺ retweeted
Letter-dropping physics comparison: o3-mini vs. deepseek-r1 vs. claude-3.5 in one-shot - which is the best? Prompt: Create a JavaScript animation of falling letters with realistic physics. The letters should: * Appear randomly at the top of the screen with varying sizes * Fall under Earth's gravity (9.8 m/sΒ²) * Have collision detection based on their actual letter shapes * Interact with other letters, ground, and screen boundaries * Have density properties similar to water * Dynamically adapt to screen size changes * Display on a dark background
150
247
64
2,558
604,098
Andrea | πŸ‡ΈπŸ‡ͺπŸ‡ͺπŸ‡ΈπŸ‡»πŸ‡ͺ retweeted
AI Agents for Computer Use This report provides a comprehensive overview of the emerging field of instruction-based computer control, examining available agents – their taxonomy, development, and resources.
15
137
5
650
65,565
Andrea | πŸ‡ΈπŸ‡ͺπŸ‡ͺπŸ‡ΈπŸ‡»πŸ‡ͺ retweeted
Gemini 2.0 doesn’t get nearly enough credit. I just dumped all my workers-qb source code into it, hit it with a simple, humble prompt, and boom => it one-shotted the docs. Not just good docs, way better than what I had before, packed with examples. Kinda insane.
29
58
13
705
115,487
Andrea | πŸ‡ΈπŸ‡ͺπŸ‡ͺπŸ‡ΈπŸ‡»πŸ‡ͺ retweeted
OpenAI o3-mini just one shotted this prompt: write a script for 100 bouncing yellow balls within a sphere, make sure to handle collision detection properly. make the sphere slowly rotate. make sure balls stays within the sphere. implement it in p5.js
135
390
69
4,181
815,354
Andrea | πŸ‡ΈπŸ‡ͺπŸ‡ͺπŸ‡ΈπŸ‡»πŸ‡ͺ retweeted
Finished a run (R1 style) GRPO on Qwen-2.5-0.5B (base model) yield +10 accuracy points on GSM8K. Literally just works. Base model scores 41.6% as reported on qwen paper vs 51%~ GRPO
41
107
8
1,110
107,881
Andrea | πŸ‡ΈπŸ‡ͺπŸ‡ͺπŸ‡ΈπŸ‡»πŸ‡ͺ retweeted
for people learning gpu programming and especially triton should check out liger kernel by linkedin it was released last year and built on top of triton to provide pre-optimized, ready-to-use implementations gpu optimization techniques specifically tailored for llm training
9
60
610
33,899
Andrea | πŸ‡ΈπŸ‡ͺπŸ‡ͺπŸ‡ΈπŸ‡»πŸ‡ͺ retweeted
Excited to announce text-to-api.ai A website that turns any website into a get API with @firecrawl /extract endpoint. Data on the web has never been more accessible! Thanks to @devdigest, for starting this fabulous trend. Check out his GitHub repo below!
37
192
15
2,100
235,321
Andrea | πŸ‡ΈπŸ‡ͺπŸ‡ͺπŸ‡ΈπŸ‡»πŸ‡ͺ retweeted
OpenAI o3-mini is a good model, but DeepSeek r1 is similar performance, still cheaper, and reveals its reasoning. Better models will come (can't wait for o3pro), but the "DeepSeek moment" is real. I think it will still be remembered 5 years from now as a pivotal event in tech history, due in-part to the geopolitical implications but for many other reasons too. All this discussed in 5 hour technical podcast I just recorded on the state of AI industry. Out tomorrow (hopefully).
962
981
171
12,892
1,511,313
Andrea | πŸ‡ΈπŸ‡ͺπŸ‡ͺπŸ‡ΈπŸ‡»πŸ‡ͺ retweeted
OpenAI’s o3-mini is here - a significant jump forward from o1-mini Initial results (full benchmarking coming soon): ➀ Artificial Analysis Quality Index of 89, matching DeepSeek R1 and just below o1 ➀ Cheaper - $1.1/$4.4 input/output pricing per million tokens, lower than many DeepSeek R1 APIs (higher than DeepSeek’s first party R1 API) ➀ Fast - similar speed to o1-mini at 170 tokens/s, although that means 2000 tokens of β€˜thinking’ time will still take ~12 seconds
24
60
14
395
79,796
Andrea | πŸ‡ΈπŸ‡ͺπŸ‡ͺπŸ‡ΈπŸ‡»πŸ‡ͺ retweeted
When working with o1/o3 models, I always have this feeling that I'm leaving a lot on the table with my prompting. Creating a long sequence of prompts for regular LLMs is good practice. This is because you don't want to overload what an LLM can process (or it'll lead to hallucinations). But Large Reasoning Models (LRMs) are different.
21
76
3
520
54,423