
AI & Music Data Scientist @moises_ai | prev. @c4dm
Joined June 2014
- Tweets2.3K
- Following1.9K
- Followers2.9K
- Likes19.7K
Pinned Tweet
soundcloud.com/hel9000/espel…
For this year's edition of the @aisongcontest we explored the Studio in @moises_ai and paired human vocals with brutal Portuguese generated screams!
Jazz dataset alert! 🚨 Introducing JSIR (Jazz Standards dataset for Information Retrieval), an audio-aligned dataset of jazz recordings containing beat/downbeat, chord, and structure annotations. Repository, demo, and preprint out now: github.com/MALerLab/JSIR
Pedro Sarmento retweeted
as a runner, moving to SF meant improvising a run (as I often did in London/Santa Monica) could send me up a small mountain ... so I built: flattensf.com
Pedro Sarmento retweeted
in our upcoming ISMIR paper, Learning Jazz Pianist Style with Cross-Attention Conditioning, we ask whether a transformer can learn to play in the style of twelve giants of jazz piano. here our model continues one prompt in the styles of four of my favorite pianists. sound on! 🔊
Pedro Sarmento retweeted
if true, this is suuuuper interesting
the journalist quotes Jack Brody (chief product officer of Suno)
Suno is moving to models trained on music it has licensed. This is a big win for musicians, and likely wouldn’t have happened without the lawsuits of the last couple of years.
But they say the new models were still trained on “Suno user data”. This is worrying. It sounds to me like they have trained the new models on Suno output from previous models - output made with the old models, which were trained on musicians’ work without permission.
They also say the new models are trained on “preference learnings from its earlier models”. The same applies - if this is user preference data on existing Suno tracks, then they have it thanks to models trained on musicians’ work without permission.
If that is what they’re doing, it shouldn’t be allowed IMO. AI companies should not only shut off models trained on people’s work without permission - they should not be allowed to use the outputs or data generated from those models.
axios.com/2026/09/09/suno-v6…
Pedro Sarmento retweeted
#ISMIR2026 Tutorial Spotlight: “Introduction to #MusicInformationRetrieval: Three Perspectives”.
Be part of the ISMIR 2026 tutorial program in Abu Dhabi and connect with the latest topics shaping the music information retrieval community.
🔗 Learn more: ismir2026.ismir.net/tutorial…
Pedro Sarmento retweeted
What the what?? I hope this goes commercial.
David Wieland, Jonas Roth, Christoph Studer, "PolyMap: A 64-Channel Polyphonic Guitar Pickup System" arxiv.org/abs/2608.27522
Pedro Sarmento retweeted
📣 #ISMIR2026: Call for Sponsors!
Connect with leading researchers, innovators, and industry professionals shaping the future of #musictechnology.
🔗 Learn more: ismir2026.ismir.net/sponsors…
Pedro Sarmento retweeted
We already knew that "less is more" in music production, but turns out it's also true for bandwidth extension 🎶
Super cool findings by my teammates from @UMG, and definitely worth reading if you're interested in latent space geometry, music restoration or audio codecs 👀
New paper at #ISMIR2026! We discover that simple latent transport across multiple neural codec spaces can perform bandwidth extension "on par" with much larger models! How can we make use of this interesting latent geometry? Do we still need gigantic deep models for BWE?
Pedro Sarmento retweeted
Excited to share a new Preprint & LIVE DEMO! This is >2 years of my life building fast, lightweight CPU-friendly models to facilitate songwriters' iterative workflows, with Representations usable for Understanding and Generation, trained in a Self-Supervised way. First, the demo:
Pedro Sarmento retweeted
Call for Sponsors for the 27th International Society for Music Information Retrieval Conference (ISMIR 2026), taking place November 8–12, 2026.
Sponsoring ISMIR 2026 offers strategic value to your organization:
▪️Showcase Innovation
▪️Access Top Talent
ismir2026.ismir.net/sponsors…
Pedro Sarmento retweeted
Very proud to see our last work about Music Transcription released in open source. Go try it at muscriptor.kyutai.org
Inference code: github.com/muscriptor/muscri…
Paper: arxiv.org/abs/2607.08168v1
We're releasing MuScriptor, the best open model for multi-instrument transcription to date, created in collaboration with @MireloAI.
Give it a recording in any genre: pop, classical, metal, jazz, whatever, and it transcribes the individual instruments into MIDI. Link in 🧵
Pedro Sarmento retweeted
My thanks to Alex Ruger and TapeOp for a really fun interview- I enjoyed getting to talk about Roland Future Design Lab and my career with Roland, plus a trip down my own memory lane!
Behind The Gear with Roland's Paul McCabe tapeop.com/interviews/173/be… #tapeop via @tapeopmag
yeahh open source is fun 😜🤟
🥳 Announcing Stable Audio 3 🍕
🏆 fastest music models ever
💻 runs on MacBookPro M-series
🧪 break it plz
🧠 LoRA finetune in < 1h
📷 Sm = faster, Medium = qualityer
⚡ 59x realtime on M5 Pro
One-liner fast install:
curl -LsSf dadabots.com/_/sa3-mac | bash
Pedro Sarmento retweeted
Fresh off teaching my graduate course on Multimodal Generative AI.
I open-sourced the entire thing on GitHub: lectures + labs on vision/audio models, multimodal alignment, RAG, and agentic systems.🔥
Free for anyone building in this space.
Link in comments
#GenerativeAI
Pedro Sarmento retweeted
🤯 big update to our flow map language models paper!
we believe this is the future of non-autoregressive text generation.
read about it in the blog: one-step-lm.github.io/blog/
full details in the paper: arxiv.org/abs/2602.16813
we introduce a new class of continuous flow-based language models and distill them into their corresponding flow map for one-step text generation.
we beat all discrete diffusion baselines at ~8x speed!
v2 gives a complete theory of the flow map over discrete data, with three equivalent ways to learn it (semigroup, lagrangian, eulerian). it turns out you can train these with cross-entropy objectives that look very similar to standard discrete diffusion — but without the factorization error that kills discrete methods at few steps.
beyond improving results across the board, we showcase properties that are unique to continuous flows. in particular, inference-time steering and guidance become straightforward. autoguidance brings generative perplexity down to 51.6 on LM1B, while discrete baselines completely collapse at the same guidance scale.
we also show reward-guided generation for steering topic, sentiment, grammaticality, and safety at inference time — and it works even at 1-2 steps with our flow map model. simple, well-understood techniques from continuous flows just work incredibly well in practice for language.
we’re extremely excited about the future of this class of models.
stay tuned for results on scaling, reasoning, and reinforcement learning-based fine-tuning. 🚀
Pro Musicians, Not Amateurs, Are Leading the AI Music Revolution according to new Water & Music x Moises Study bit.ly/4lFFvqX #aimusic #aimusicproduction #ai #musicians #musictech
bit.ly/4lFFvqX
a vague sense of prog, AI and friendship
youtu.be/sumZL0Mx1-I?si=3Lk8…




























