@jvanbalen

ML researcher @Spotify • previously, recsys & MIR @AppleMusic @UAntwerpen @UUtrecht • also at @jvanbalen@sigmoid.social

 BE
jvbalen.github.io
Joined September 2012
  • Tweets1.3K
  • Following536
  • Followers703
137Media
👉 @jvanbalen@sigmoid.social
1
4
Jan Van Balen retweeted
Jameszoo@Jameszooo15 Apr 2025
See you tomorrow 👁‍🗨👁‍🗨
Jameszoo@Jameszooo10 Apr 2025
Next week.. @BRAINFEEDER
1
4
360
Jan Van Balen retweeted
C4DM at QMUL@c4dm15 Dec 2023
We are looking for 2024 fall PhD students! C4DM website: c4dm.eecs.qmul.ac.uk/news/ne… AIM website: aim.qmul.ac.uk/apply/
1
12
3
28
6,991
Jan Van Balen retweeted
Josh G@jpgard12 Oct 2023
🐣 🎶  Excited to share LLark: A Multimodal Foundation Model for Music! LLark is a 12B parameter model that produces text responses from (text + audio) inputs. 📖 arxiv.org/abs/2310.07160 🔊 bit.ly/llark 💻 github.com/spotify-research/… 🧵
3
42
3
161
22,288
NL people: there’s a string of shows coming up where Jameszoo and band, plus the amazing Asko|Schönberg ensemble, will perform alongside a generative music system I helped build ✨ VERY excited for this one. More: askoschoenberg.nl/performanc… I’ll be there for Rotterdam and Den Bosch
Screenshot of text: ‘Blind’ for ensemble and nonexistent soloist https://jameszoo.com/about 04/10/2023 de Doelen, Rotterdam (NL) 14/10/2023 Korzo, Den Haag (NL) 19/10/2023 Muziekgebouw aan 't IJ, Amsterdam (NL) 01/11/2023 Oosterpoort, Groningen (NL) 09/11/2023 Podium Azijnfabriek, 's-Hertogenbosch (NL)

ALT Screenshot of text: ‘Blind’ for ensemble and nonexistent soloist https://jameszoo.com/about 04/10/2023 de Doelen, Rotterdam (NL) 14/10/2023 Korzo, Den Haag (NL) 19/10/2023 Muziekgebouw aan 't IJ, Amsterdam (NL) 01/11/2023 Oosterpoort, Groningen (NL) 09/11/2023 Podium Azijnfabriek, 's-Hertogenbosch (NL)

1
7
770
I just published a small package I’ve been using to work with real-time MIDI in Python, for a personal project: github.com/jvbalen/midifx I wanted to make it easy to implement custom MIDI effects that support real-time I/O🎹—including controls like knobs and sliders 🎛🎚

GitHub - jvbalen/midifx: Approximately real-time MIDI manipulation for Python, macOS

Approximately real-time MIDI manipulation for Python, macOS - jvbalen/midifx

github.com
1
1
22
1,466
more replies
Most of all though, this lets you play with python ML music tools in real-time🕺 E.g., a version of this, hooked up to some Markov chains and three Disklaviers, ran more or less continuously for about a month at an art gallery last winter: xitter.cf/Jameszooo/status/16130…
Jameszoo@Jameszooo11 Jan 2023
3 more weeks of ‘Telephone’ at @Nestruimte together with Philip Akkerman. Works with @jvanbalen Paul van Twist, Cas Dekker and Ruimtetijd. Installation 📷 by Charlott Markus nestruimte.nl/en/exhibition/…
1
268
Let me know if this seems useful to you! E.g. over at @jvanbalen@sigmoid.social🙂
107
Jan Van Balen retweeted
Rachel Bittner@r4b1tt9 Jun 2023
I'm proud to share that our team's work at @SpotifyResearch on audio-lyric alignment by Simon Durand, Daniel Stoller, and @sebastian_ewert was awarded the best industry paper award at #ICASSP2023 . More details in 🧵
2
10
3
94
11,357
Jan Van Balen retweeted
Jameszoo@Jameszooo11 Jan 2023
3 more weeks of ‘Telephone’ at @Nestruimte together with Philip Akkerman. Works with @jvanbalen Paul van Twist, Cas Dekker and Ruimtetijd. Installation 📷 by Charlott Markus nestruimte.nl/en/exhibition/…
1
1
4
979
“More generally, in AI applications, the sophistication of the algorithm is rarely the limiting factor. The quality of the design, the data, and the people that make up the system all tend to matter more.”
Arvind Narayanan
@random_walker15 Dec 2022
TikTok users feel its algorithm is eerily accurate. But from everything we know about the algorithm, it's a pretty standard recommender system of the kind that every major social platform uses. TikTok's real innovation is something else. Just posted: knightcolumbia.org/blog/tikt…

TikTok’s Secret Sauce

knightcolumbia.org
1
3
437
one design thing that’s very relevant to the algorithm: showing one full-screen video at a time really helps with attributing implicit feedback to individual videos—without that, explore-exploit is a lot more difficult
2
174
New release!👇 Some really useful things in here, that I’ve been using for every TF project for a while now.
Peter Sobot
@psobot16 Dec 2022
As if today wasn't already fun enough - my team just open-sourced a new library! Say hello to realbook, a Python library that makes it easier to train audio-based machine learning models with TensorFlow: github.com/spotify/realbook

GitHub - spotify/realbook: Easier audio-based machine learning with TensorFlow.

Easier audio-based machine learning with TensorFlow. - spotify/realbook

github.com
2
321
Bitter but true. However there are compelling reasons for KG’s in particular to be folded back into ChatGPT-level models, in some form. (1/n)
Jack Rae
@jack_w_rae9 Dec 2022
A new episode of the “bitter lesson”: almost none of the research from ~2 decades of dialogue publications, conferences and workshops lead to #ChatGPT. Slot filling ❌intent modeling ❌ sentiment detection❌ hybrid symbolic approaches (KGs) ❌
2
1
2
(KG’s as in Knowledge Graphs)
2
Having done some work on large-scale recommender systems, I don’t see this scale to conversations about millions of entities without a more structured representation feeding into or wired into the model, at least not any time soon (4/n)
1
1
That said, exciting times… (5/5)
Screenshot of a ChatGPT conversation. me: My top five artists this year were: Feist, The Beatles, Kendrick Lamar, Rosalía and Moses Sumney. What are some similar, lesser-known artists for me to listen to next? chatgpt: Some similar, lesser-known artists for you to listen to next could be: 1. Little Dragon - a Swedish electronic music band with a similar indie pop and electronic sound to Feist. Tame Impala - an Australian psychedelic rock band with a retro, psychedelic sound similar to The Beatles. 3. Noname - an American rapper and poet with a soulful, introspective sound similar to Kendrick Lamar. 4. C. Tangana - a Spanish rapper and singer with a fusion of flamenco and trap music similar to Rosalía. 5. Perfume Genius - an American singer-songwriter with a haunting, ethereal sound similar to Moses Sumney.

ALT Screenshot of a ChatGPT conversation. me: My top five artists this year were: Feist, The Beatles, Kendrick Lamar, Rosalía and Moses Sumney. What are some similar, lesser-known artists for me to listen to next? chatgpt: Some similar, lesser-known artists for you to listen to next could be: 1. Little Dragon - a Swedish electronic music band with a similar indie pop and electronic sound to Feist. Tame Impala - an Australian psychedelic rock band with a retro, psychedelic sound similar to The Beatles. 3. Noname - an American rapper and poet with a soulful, introspective sound similar to Kendrick Lamar. 4. C. Tangana - a Spanish rapper and singer with a fusion of flamenco and trap music similar to Rosalía. 5. Perfume Genius - an American singer-songwriter with a haunting, ethereal sound similar to Moses Sumney.

1
1
Load more