Silly question but how is the Vector quantization reduction of the encoded Floats to quantized Ints a representation of music that is more able to be treated like text? In other words, how is the constant stream of Ints more Text like than the vector of Floats, when speaking abstractly? Do you mean because we use ASCII and already use a stream of Ints for language on computers, and that is the natural form rather than encoding language into tokens? - Matt Jackson
@julian_d_parker7 ай бұрын
@@soma808 Yes, I probably should have explained that distinction better. Text (at least in the context of transformer-based models like LLMs) is usually represented as a stream of integer 'tokens' which are derived from the input text using a tokenizer (usually not with a 1:1 correspondence to characters, but rather common groups of characters). LLMs are learning the categorical probability distribution over this discrete set of tokens given the previous tokens, very much like an advanced autocomplete. You could do the same with float vectors, but it doesn't usually work as well because you have to make assumptions about the continuous distribution which results in a much less expressive model. There's also a bunch of nitty-gritty architecture reasons why integer tokens work well with transformers. So ignoring the deeper philosophical aspect, the answer is basically "Ints work better for text in practice".
@musicarroll8 ай бұрын
GPT-4o is a cacodaemon.
@starguy27188 ай бұрын
I've been studying solitons, and this looks just like a type of soliton called a "breather", from the illustrations in my textbook.
@aleksdizhe8 ай бұрын
Thanks!
@paulalanputnam4592 Жыл бұрын
Super interesting lecture. We who are obsessed with Strads and Guarnieris learned a lot with it. Please if you have another one, tell the sound guy to put a clip microphone on you.
@aladin7339 Жыл бұрын
add subtitles !!!!! french accent isn't clear enough for non natives
@leoarzeno Жыл бұрын
my kind of crazy
@toddmarshall7573 Жыл бұрын
40:32 "... you have to remember and take this and reflect it... ": Then how do you explain this motion of a plucked string: kzbin.info/www/bejne/lYmaY6Kka6iGgpI
@omridrori3286 Жыл бұрын
Source code?
@maxwellrosenfeld81662 жыл бұрын
there is something therapeutic about his voice and the ums
@ippo80572 жыл бұрын
thanks a lot for posting this
@twohorizons34362 жыл бұрын
Buy this domain. LOL. Yeah, I though it was too good to be true LULZ.
@twohorizons34362 жыл бұрын
Wow this is pretty dated now. 2016? Must be pretty good by now. I wonder how they've progressed? Please let us know. One of many alternatives to MODO GUITAR, the hypothetical unicorn virtual guitar instrument that has yet to be released...or may never be...no one knows. No call no show on this one. What a shame.
@synarkmusic92862 жыл бұрын
There's some really good transience in this video, gonna see what kind of bass synths can be made from this
@flaguser41962 жыл бұрын
thankfully i watch youtube with a studio monitor headset
@flaguser41962 жыл бұрын
looks like budget cgi
@ivansannikov34623 жыл бұрын
Thanks for sharing this knowledge!
@betterpol3 жыл бұрын
Cool.😎
@etnrednal3 жыл бұрын
The string animation doesn't make a lot of sense. When a guitar string is excited, the wave doesn't propagate through the string, but the entire string starts to vibrate at the same time as the tension of the string transfers the highest peak of the wave to the exact middle of the string. The animation used in the video cannot produce harmonics.
@vuommc2 жыл бұрын
Not true, the travelling waves form of the solution and the Fourier solution are equivalent
@anthonymetcalf6602 жыл бұрын
Watch a slow motion video of a guitar string being plucked.
@benlou62043 жыл бұрын
Fascinating!
@shrammstorm3 жыл бұрын
Any news/progress since then?
@johnperryanco3 жыл бұрын
lots of ums
@Maniclout2 жыл бұрын
yeah it's kind of annoying
@dissdad87443 жыл бұрын
Any plans to convert these synthesis models to playable virtual instrument plugins (eg VSTs)?
@dissdad87443 жыл бұрын
Does a plugin implementation (eg VST) for DAWs of this exist? Would make it much more accessible to the general user!
@TheReeTree3 жыл бұрын
I dream of a drum set in front of a large lens schlieren setup
@davidvoyance45223 жыл бұрын
I cannot hear the sound!!
@mattiacolombo62464 жыл бұрын
Thank you so much for uploading this! Very well presented.
@BruceTheSillyGoose4 жыл бұрын
i had no idea that string synthesis had not already accomplished the sound of bowed/pizzicato strings.
@albedoshader3 жыл бұрын
The Korg Z1 and other Physical modeling synthesizers from the 1990’s had already plucked and bowed string models. Here is a Korg Z1 demonstration of the bowed string model: kzbin.info/www/bejne/jqrWgHp5eKqGmLc And another demostration that pushes the parameters to the limit: kzbin.info/www/bejne/laSak6V4mdNjpLs&pbjreload=101 The sophistication of the NESS model is obviously higher, almost 20 years later.
@mariobajardi4 жыл бұрын
Thanks :)
@uhoh0074 жыл бұрын
Wonderful presentation
@davidgooding96794 жыл бұрын
As ever, an entertaining, clear and exemplary exposition from the master of the HTS.
@shshshshshshshshshsh27524 жыл бұрын
Thank you!
@BosleymusicCentral4 жыл бұрын
Is this the paper? pdfs.semanticscholar.org/14bc/876fae55faf5669beb01667a4f3bd324a4f1.pdf?_ga=2.58053034.1810944373.1585552929-1392378971.1585552929
@lxuaes69154 жыл бұрын
The Future
@_savesomeone5 жыл бұрын
this is awesome, great stuff
@zurnu745 жыл бұрын
Hi AAG. I need to simulate a guitar string movement to show the harmonics. Can you share this file?
@wurnotantmlb5 жыл бұрын
why they won't show up this so called computer musicians within macs¿? what are they suppossed to have been learning all the way? or even worse to teach us?¿?they use real toys to make real bussines and we are spected to hold they shit. no way
@jameshopkins35415 жыл бұрын
SI NO EXPLICAN DEBEN INDICAR CLARAMENTE CUAL ES CUAL
@UNIF0RM5 жыл бұрын
this was useful
@atomictraveller5 жыл бұрын
thank god it was part of that project instead of the making normal people more informed and capable project. i love physical modeling: 1995, julius orion smith III, 2019, we forgot about that shit, use synth1 and pay $300 for a load of douchebag samples. lets keep humanity stupid, incapable, and fucking broke.
@johndozesoph41364 ай бұрын
I read your user as atomictwat for a second then. was about to say. very fitting
@atomictraveller4 ай бұрын
@@johndozesoph4136 you developed a youtube post! <3
@tyrealsan82345 жыл бұрын
Awesome
@TayfunCaba5 жыл бұрын
bir kişide yorum yazmamış bu adam ne yapıyor diye Julius Smith sayın profesör. analizi ve metafizik tarzı bu modellemeyi yapabilen benim gözümde tek insandır. sanal ile gerçekliğin metamatiksel ölçümlerle yaptığı synth sistemini bukadar iyi yapabilen bir insan daha yoktur. Swam Aşkı Bir Başkadır I Love You SWAM
@scarmsaniiaggrey16466 жыл бұрын
please elaborate!
@SlebenGates6 жыл бұрын
I'm applying for this course withiin the next days... Just so you know. I'm from Mexico. Wait a little more... =D
@philosyche2 жыл бұрын
how did it go?
@SlebenGates2 жыл бұрын
@@philosyche I had to gather 1 million Mexican pesos and even with the 3 scholarships I was granted with I was short 200k, I had everything else placed except the money, so I'll live a bit frustrated by that the rest of my life jaja
@philosyche2 жыл бұрын
@@SlebenGates Aw, I'm sorry! I am certain it was their loss! I was a bit curious, the university website lists the fees to be £26,300 for international students, which seems less than a million Mexican pesos. Were you trying out for the BSc program by any chance? That would be more expensive than the MSc.
@SlebenGates2 жыл бұрын
@@philosyche I had to pay the travel, the staying and the expenses of each month such as traveling, food, clothing for that weather and documentation fees for the VISA and national documentations (passport, national/international permits). Even working in the Library or the cafeteria as they suggest you do I would have still been cut short and probably having to retire. It is worth noting that at that time I couldn't apply for a scholarship that required mortgaging a house since I didn't have anyone owning a house that could have lended it to me. Thank you for your kind words
@philosyche2 жыл бұрын
@@SlebenGates ahh yes, that sure was quite the bill. Thank you so much for your replies! Hope you are doing well!
@danieldombrowski8236 жыл бұрын
The trumpet appearing is cool but I don't get this video plus I WAS LOOKING IMFORMaTION FOR MY MUSIC HOMEWORK. That's a minute I'll never get back and wait why am I trying this then?
@Arnd2it6 жыл бұрын
Really needs English subtitles.
@eliav36 жыл бұрын
GREAT demonstration thanks!!!
@ALEXISGNFR6 жыл бұрын
Why you did this conference in the reverberation chamber ? :(