Dad of 3 and Co-founder at @OctoAICloud - Enabling developers to build GenAI powered applications.
Seattle, WA
Joined May 2009
- Tweets231
- Following486
- Followers526
- Likes620
And we're just getting started. Applying int4 optimizations on top of this are looking 🤯🚀
This Post is from an account that no longer exists. Learn more
Looking forward to seeing your results too! AITemplate still wasn’t available as a baseline last I checked as well.
The baseline compared against here is what you find from hosted SDXL services. We also have <5s results available but at a higher price point if that’s what you’re interested in.
Jason Knight retweeted
@OctoML Profiler uses the latest PyTorch 2.0 compiler technology to give developers insight into ML model performance, optimize deep learning applications, and right-size hardware choices without leaving the dev environment!
Check it out 👉 hubs.la/Q01K2R2v0
Jason Knight retweeted
Stable diffusion models are fun and usually take a server to run. Today we are happy to share the Web Stable Diffusion project, which brings SD models from @huggingface and @pytorch to browser clients through @WebGPU support. Checkout mlc.ai/web-stable-diffusion for our demo!
Excited to see PyTorch 2.0 announced around compiler support and for @ApacheTVM to be included as a torch.compile and Dynamo upstreamed backend!
We just introduced PyTorch 2.0 at the #PyTorchConference, introducing torch.compile!
Available in the nightlies today, stable release Early March 2023.
Read the full post: bit.ly/3VNysOA
🧵below!
1/5
Really excited to have Lip-Bu Tan join our board! Can't wait to learn from his extensive experience, and he is such a caring human role model as well.
This Post is from an account that no longer exists. Learn more
Let me know if you're at #reMARS and are interested in chatting about deploying ML more easily and efficiently.
This Post is from an account that no longer exists. Learn more
@brendandburns pushed this concept in “Metaparticle” exploring this concept but it seemed to lose steam. Would love to know why? github.com/metaparticle-io/p…
Interesting historical discussion about taking
@deno_land's VM level permissions and extending them to per-library/module. Still NotImplemented, but V8 VM level is definitely better than nothing:
github.com/denoland/deno/iss…
Minimalism for the mind. A fantastic read that I'm now looking forward to digesting for the rest of the weekend. h/t to @coffeephoenix
Subtraction, Not Addition, by @ibringtraffic andyjohns.substack.com/p/sub…
Haven’t used it myself, but I wonder if there’s a Feast library component that would serve your need of decoupling your source and sink in a principled way: docs.feast.dev/how-to-guides…
Looks like the movement in computing from vacuum tubes to integrated circuits (see pictures of both setups at end of thread).
Best way to ring in the new year! @erika_alden_d and I are excited to share our story on high-throughput continuous evolution, available now in @naturemethods. We've added a ton to the story since the preprint, and hope you'll check it out! thread 1/n... nature.com/articles/s41592-0…
Some of the coolest work I have seen in a while. Now we just need to compile these continuous neural CAs into genetic regulatory networks for some synbio breakthroughs.
distill.pub/2020/growing-ca/ <- one and only Distill. A nice introduction to how neural CA works and how it may be a potentially useful model of morphogenesis and regeneration processes in developmental biology.
@zzznah
2/