Juma retweeted
We can't be called @team_gpt anymore 💔
@OpenAI doesn't want us to 🪦
Juma retweeted
A 9.9 CVE has been announced for Linux 👀 Remote code execution. No details yet. Heartbleed was 7.5, for reference. This is one of the worst in history. All GNU/Linux systems impacted.
Juma retweeted
Discover @team_gpt for efficient AI adoption & team collaboration: buff.ly/4g5vEqY
#AI #BusinessTools #TeamGPT
Juma retweeted
ChatGPT is down, switch to @team_gpt
chat.team-gpt.com/
Juma retweeted
Announcing "ChatGPT for Work: The Interactive Course" on ProductHunt!The course is completely FREE because we believe everyone should have the opportunity to be 20 times more productive thanks to AI. Check it out here: producthunt.com/posts/chatgp…
Your support is vital!
Juma retweeted
We're launching ChatGPT for Work: The Interactive Course on @ProductHunt cc @ValchanovIliya @yavorbelakov producthunt.com/posts/chatgp…
Juma retweeted
Switching to token-based GPT-4 usage combined with @team_gpt has been a game-changer for us ✨ 😍👏 🚀
From $20 per OpenAI account ($40) and near-impossible collaboration
→ to shared & personal chats, folders & resources at intensive usage for ≤ $20
buff.ly/468rPMk
Juma retweeted
While integrating the new Paddle Billing API we've found out that there's no published SDK for Node.js, so we've spent some time to create one for all of us.
Feel free to raise issues, contribute and help us build it even better 🚀
github.com/team-gpt/paddle-b…
Juma retweeted
Turkish is so beautiful 😍
... And so is @Team_GPT 🦾😉✨
Juma retweeted
I can't believe I've just fine-tuned a 33B-parameter LLM on Google Colab in a few hours.😱
Insane announcement for any of you using open-source LLMs on normal GPUs! 🤯
A new paper has been released, QLoRA, which is nothing short of game-changing for the ability to train and fine-tune LLMs on consumers' GPUs.
In a few words:
QLoRA reduces the memory usage of LLM fine-tuning without any performance tradeoffs compared to standard 16-bit model fine-tuning.
This method enables 33B model fine-tuning on a single 24GB GPU and 65B model fine-tuning on a single 46GB GPU. This is incredible! 😍
More specifically, QLoRA uses 4-bit quantization to compress a pre-trained language model. The LM parameters are then frozen, and a relatively small number of trainable parameters are added to the model in the form of Low-Rank Adapters.
During finetuning, QLoRA backpropagates gradients through the frozen 4-bit quantized pretrained language model into the Low-Rank Adapters. The LoRA layers are the only parameters being updated during training. Read more about LoRA in the original LoRA paper (arxiv.org/abs/2106.09685). 🤓
QLoRA has one storage data type (usually 4-bit NormalFloat) for the base model weights and a computation data type (16-bit BrainFloat) used to perform computations. QLoRA dequantizes weights from the storage data type to the computation data type to perform the forward and backward passes, but only computes weight gradients for the LoRA parameters, which use 16-bit bfloat. The weights are decompressed only when they are needed, therefore the memory usage stays low during training and inference. Beautiful!😱
QLoRA tuning is shown to match 16-bit finetuning methods in a wide range of experiments. In addition, the Guanaco models, which use QLoRA finetuning for LLaMA models on the OpenAssistant dataset (OASST1), are state-of-the-art chatbot systems and are close to ChatGPT on the Vicuna benchmark. This is an additional demonstration of the power of QLoRA tuning.
Their Guanaco models are reaching 99.3% of the performance level of ChatGPT while only requiring 24 hours of fine-tuning on a single GPU. You can actually do it in Google Colab.
📚 Links-
QLoRA Paper - arxiv.org/pdf/2305.14314.pdf
Colab for inference - colab.research.google.com/dr…
Colab for fine-tuning - colab.research.google.com/dr…
GitHub Repository- github.com/artidoro/qlora
Use it with HuggingFace - huggingface.co/blog/4bit-tra…
















