
Voice AI Research @meta super intelligence labs | Previously PlayAI
San Francisco, CA
Joined May 2011
- Tweets1.1K
- Following1.1K
- Followers1.4K
- Likes10.5K
Pinned Tweet
Come see our work on "Training Language Models under Resource Constraints for Adversarial Advertisement Detection" today at 8:10 AM IST (19:40 PDT)
We explore weak supervision, curriculum learning and multi-lingual training.
PDF: aclweb.org/anthology/2021.na…
@NAACLHLT #naacl2021
Thanks for hosting @EveraertDante !
Looking forward to the next one 🚀
Last week we hosted our first Research Night at @DecagonAI with @Accel! The room was packed and a lot of people stuck around way after we wrapped, so we'll def do more of these.
This first one was everything voice - I talked about why duplex models are such a pain to train (the better your model gets, the harder RL gets, since a good model mostly agrees with itself).
And big thanks to my fellow speakers @nishnik and @chongz for great talks on post-training voice models and evaluating on full conversations!
3
18
633
I have muse ‘dictate and send’ on my action button, and it works freaking well, even at random places.
Replying to @moseskagan
PSA: you can use Muse instead of wispr flow
the muse mac app has wispr functionality built in and is good
2
15
787
Looking forward to this! Should be a fun night 🎙️
I'm hosting a voice/audio research night with @DecagonAI and @Accel on Nov 9. @nishnik from Meta Superintelligence Labs, @chongz from Cartesia, and I are each giving a quick talk then it’s just hanging out with other speech people
if you work on voice in SF come through!
luma.com/j3ddfdsw
3
16
787
Nishant Nikhil retweeted
I'm hosting a voice/audio research night with @DecagonAI and @Accel on Nov 9. @nishnik from Meta Superintelligence Labs, @chongz from Cartesia, and I are each giving a quick talk then it’s just hanging out with other speech people
if you work on voice in SF come through!
luma.com/j3ddfdsw
👀👀 Designing voice!
I just noticed voice call functionality popped up on @Muse for me.
The onboarding to the feature is simple and it asks if you want to change the voice. If you do, it’ll give you options to pick from based on your description.
The voice interaction is really good and sounds natural. And there’s a running transcript that happens in the chat.
I ended up talking to it a lot during my workout on the treadmill this morning. 🤣
I got no official notice that the feature was available and I’m not sure how it’s rolling out.
☎️🦾
Francis Halzen won today's Physics Nobel for IceCube: a cubic kilometer of Antarctic ice turned into a neutrino telescope.
I made a 5-minute explainer on how they catch a ghost particle. 🧊👻
It’s my new favourite way of consuming content.
8
32
1,171
Hosting 2nd edition of Voice research Club San Francisco w/ @shobhitbanga and @rjrshr
Attaching a small teaser of my talk. :) Link to join in comments.
Visit us while you are here for COLM or SF tech week.
Link to luma: luma.com/yd93ae7y
1
176
LFG 🚀🚀
We're going against OpenAI.
We built something miles ahead of Dots & Space, and it's open source.
OpenAI's dot cannot:
→ Work with your whole team. Only you work with your dot
→ Learn from everyone on your team
→ Be the same teammate everyone reaches on Slack, WhatsApp or email
→ Work behind the agentic apps and automations your team needs for the job: a CRM, a ticket desk, a hiring board, a returns tracker and more
A Lemma teammate does all of this. And it's open source and free to start. 🧵
Nishant Nikhil retweeted
In <4 weeks you're gonna be so dead sick of "in short" it's going to make your head spin
Found a @Musecases in the wild!
at a YC Paper Club event about neuromorphic computing
i didn’t understand most of it but thanks to @Muse i’ll watch the video podcast it created for me later 🥹
7
575
I got my @Muse to generate a full explainer video with deep research.
I think this is an emerging way for thoughtful content consumption.
It right now has to work hours to come up with this, and these code generated videos need a place in the mid-training stack!
@Musecases
Nishant Nikhil retweeted
Introducing Parallax: a small, hackable async RL repo with all the bells and whistles of a modern Async RL library.
Mixed policy rollouts (pipelineRL), NCCL M2N learner-to-sampler weight streaming, gradient accumulation, and chunked cross-entropy.
Core functionality is ~3,000 lines of Python making it easy to read and ~40k tokens – easily fitting into the context window of even local LLMs.
Built for 0 friction to try out new ideas across algorithms, systems, and data.
Also, obligatory: Parallax Speedrun -- teach Qwen3-0.6B to multiply two five-digit numbers as quickly as possible. Perfect for weekend hacking and autoresearch.
[1/8]
Here's what I have got my @Muse to do in the last week:
- Check in and generate boarding pass
- Create a game (link in comments - it is v SF centric though)
- Create a tasks file, and a live page to track tasks, and research the internet automatically to what can help me close it (see how it got MBFS details)
DM for Muse invite. 📥
Link to the smol game: muse.ai/s/subway-surfers-sil…
Very bullish on this being the next interface for computing. And excited for the next updates 👀👀
1
115
It already created an activity artifact for it.
Pro tip: add crons in there and connect it to Google drive.
Replying to @nishnik
Setting up the LLM wiki. See how it created the folders.
I’ve already started putting resources there.
My current implementation for this is an EC2 server, running Tailscale and an app having an interface for creating these notes - and a live Claude code session.
2
359
This is v cool, Kei’s @Muse - Mochi - is subscribing to all the research news he goes through - a custom RSS feed, arxiv daily … and creates this video podcast everyday! 🚀
Mine added word-timestamps too!
try asking Muse to do video podcasts!
will need to iterate on the prompting but this is just me asking to make my daily research paper digest as a video
1
5
505
I have been tinkering with muse recently, and all this is crazy unlock:
- Setting up Karpathy’s LLM wiki
- Asking it to setup and run random repos
- Generating a video podcast
- Doing research
- Financial news as a reel
Setting up the LLM wiki. See how it created the folders.
I’ve already started putting resources there.
My current implementation for this is an EC2 server, running Tailscale and an app having an interface for creating these notes - and a live Claude code session.
But implementation inside muse is also v fast. (Also you can modify the wiki to show activity, maybe geotag, it’s a new way to create your own note app)
5. Here is a video podcast based on my tickers.
Pro tip to add this as a cron job inside @Muse (ask it to)
5
92




























