Bernardo Torres retweeted
We just released the full training code, as well as our best pretrained model! 🎉
Feel free to use our SOTA checkpoint in your own project with 3 lines of code, or to retrain on your own data using our Lightning+Hydra+Dora codebase ⚡️🐍
🌐 github.com/sony/sampleid
The PESTO extension paper was published in TISMIR!
Here's the link to the publication:
transactions.ismir.net/artic…
It features several improvements to the model, larger cross dataset evaluation, and a real-time implementation.
Estremamente felice di annunciare that our new PESTO recipe has been published in the famous TISMIR cookbook 👨🍳🤌
With chef @torres_be_, we revisited this traditional sauce invented at ISMIR 2023 in Milan with some Brazilian flavours 🇮🇹🇧🇷
transactions.ismir.net/artic…
1
1
161
Bernardo Torres retweeted
🔉New paper out!
Recent audio codecs typically learn compression and quantization jointly, limiting the choice of quantization layers, non-differentiable by definition.
What if we used powerful neural quantizers like Qinco2 and trained them offline?
arxiv.org/abs/2503.19597
We’ve added fresh ingredients and cooking tricks to make the best, lightest, and fastest neural pitch estimator even better! 🌿🔥
Shoutout to all collaborators and to the amazing chef & SSL titan, @howariou
PESTO 2.0 è rilasciato! 🥳🥳🥳
With Brazilian chef @torres_be_ (and others), we revisit this traditional italian sauce, invented in Milan at @ISMIRConf 2023 🇮🇹
And you can taste it in REAL-TIME at home (~5 ms latency) ⏱️
1/6
Bernardo Torres retweeted
PESTO 2.0 è rilasciato! 🥳🥳🥳
With Brazilian chef @torres_be_ (and others), we revisit this traditional italian sauce, invented in Milan at @ISMIRConf 2023 🇮🇹
And you can taste it in REAL-TIME at home (~5 ms latency) ⏱️
1/6
Bernardo Torres retweeted
🌟My keynote at the @c4dm workshop about "Models of Musical Signals: Representation, Learning & Generation" is now on YouTube, giving an overview on developments in self-supervised learning for audio since 2020, low-level representation learning, audio (stem) generation and much more 🧵👇
youtube.com/watch?v=ixHfBPXS…
@SonyCSLMusic @SonyCSLParis
Bernardo Torres retweeted
Interested in ill-posed learning tasks, uncertainty prediction, conditional density estimation or multi-head deep neural networks ?
In our new paper, accepted at #ICML24, we tackle these challenges by exploring the Winner-Takes-All (WTA) training scheme.
[1/n]
Signals with a high degree of autocorrelation (such as pitched signals) make the training of convnets on raw audio unstable. For Gaussian initialization, the greater the input’s autocorrelation, the greater the variance of the output.
Huge relief seeing these kinds of papers <3
Training convnets on waveforms is hard—far harder than on magnitude spectrograms.
"Instabilities in Convnets for Raw Audio" approaches this phenomenon from the perspective of sensitivity to initialization.
IEEE Signal Processing Letters vol. 31
preprint: hal.science/hal-04528116
Great stuff!
arxiv.org/abs/2404.07970
The paper preprint is out! We'll make an official announcement soon but feel free to have a look first! :)
1
3
202
Happy to share some work accepted to ICASSP :)
We experiment with a loss function inspired by optimal transport to compare spectra.
We test it on a synthesis-based frequency localization (and F0 estimation) toy task using a harmonic synthesizer.
Paper: arxiv.org/abs/2312.14507
10 papers from the Audio group @tp_adasp of Télécom-Paris will be presented at @icassp2014 @ieeeICASSP.
---
Paper #1: Bernardo Torres et al. "Unsupervised Harmonic Parameter Estimation Using Differentiable DSP and Spectral Optimal Transport"
We call this loss Spectral Optimal Transport (SOT). Compared to L1 and L2 spectral losses on sinusoidal signals, SOT has a very nice convex curve leading to the right oscillator frequency.
Its gradient also does not vanish when the frequency difference is high.
1
1
226
Bernardo Torres retweeted
🥳 We present our #ICASSP2024 paper:
A diffusion model that generates production-quality (bass) audio stems to any audio input. 😎🎸 According to our experience, that's more useful to artists than generating full mixes. 🙃
📜Paper: arxiv.org/abs/2402.01412
🎶Demo: tinyurl.com/bass-acc-demo
by @marco_ppasini 👈💪@SonyCSLMusic #MusicAI
Congratz @howariou , @deeplearnmusic, @gaetan_hadjeres , @GeoffroyPeeters on the best paper award with PESTO at @ISMIRConf !!!!
Bernardo Torres retweeted
Huan had her visa to travel to Italy for @ISMIRConf rejected - for the second time in a row, despite having papers to present both years, which is incredibly unfair! If anyone can help, please get in touch 🙏
Bernardo Torres retweeted
Oldies but goldies: H. Kuhn, The Hungarian Method for the assignment problem, 1955. The most celebrated algorithm to solve efficiently (almost cubic time) the assignment problem. en.wikipedia.org/wiki/Hungar…
























