Machine Learning Engineer - @HuggingFace / Paris 🇫🇷
Paris
Joined May 2012
- Tweets316
- Following313
- Followers1.6K
- Likes829
Your local AI just got more Windows-native 🦙
Llama for Windows v0.13.0 is out!
🖼️ Share images & text to Llama
⚡ Speculative decoding support
💻 See which models likely fit your hardware
🔗 llama:// deep links
Give it a spin 👇
github.com/ggml-org/Llama-Wi…
Hey @Windows users, local AI is for you too🥳
Llama for Windows v0.12.0 is out!
🖥️ llama.cpp in your Windows 11 tray
🤗 Download models in one click
😎 Improved UX flow
👉 github.com/ggml-org/Llama-Wi…
Local AI has never been easier for Windows users.
Open source. Truly local. Zero cloud.
Llama for Windows runs llama.cpp models entirely on your hardware — download & manage models, chat from anywhere with Alt+Space
Your prompts never leave your machine
🦙github.com/ggml-org/Llama-Wi…
Serving @OpenAI Whisper, powered by @vllm_project, deployed on @huggingface Inference Endpoint, with astonishing @Gradio demo ... What else? 😎
AI community is all you need to create blazing fast whisper transcriptions 💥🚀
More in our blog 📰 huggingface.co/blog/fast-whi…
What's next? Let us know what you'd like to see supported!
✍️ huggingface.co/spaces/hfendp…
Qwen3 235B is now available on HuggingChat! And you know what? It's blazing fast✌️
👉hf.co/chat/models/Qwen/Qwen3…
Anyone looking to deploy LLMs in production,🤗got something for you👀
@huggingface TGI is expanding its capabilities to bring support for different inference backends (vLLM, TensorRT-LLM, llama.cpp, etc. etc.) 🏋️
🗞️ More info in our last blogpost huggingface.co/blog/tgi-mult…
TensorRT-LLM, from our partner @nvidia, is the first backend we will be shipping. We are currently wrapping up the last parts.
It'll bring cutting edge float8, quantization & sparsity support🤏
We'll soon publish a part 2 with more in-depth about this integration, stay tuned!
Want to leverage @AMDInstinct MI300x GPUs for LLMs? Check out how easy it is and the performance in our blog post! 🚀
👉huggingface.co/blog/huggingf…
Still hungry?🧐Register for the next HuggingCast on June 6th 🎙️streamyard.com/watch/iMZUvJn…
PS: Deploy these GPUs on @Azure right now! 😱
Hello @Free_1337 👋🏻, plus de fibre depuis le 19/12 sur Lessard le National (71530) est-ce que vous avez de la visibilité sur une résolution future ? 🤗🙏🏻
We just released🤗optimum-nvidia 0.1.0b2 which brings many quality-of-life improvements, should ease the developer experience & extend NVIDIA GPU architectures coverage to Volta and Turing!
Check it out! 🚀
Release notes 📜: github.com/huggingface/optim…
🚢Docker Hub image has been update to it's latest version for an easy start hub.docker.com/repository/do…
In the coming release we will focus on:
- Making optimum-nvidia pip installable
- Enabling GPTQ/AWQ models from the @huggingface hub
- Officially supporting Mistral models
Stay tuned! 🤗
On-prem datacenter user? @huggingface is coming to you thanks to this new partnership with @DellTech 🤝.
Let's go team! 🚀
You’re unable to view this Post because this account owner limits who can view their Posts. Learn more