My Problem With (Most) Spectrograms

  Рет қаралды 26,155

Au5

Au5

Күн бұрын

Get Minimeters: minimeters.app/
Spectrum Reassignment articles:
en.wikipedia.o...
people.ece.cor...
arxiv.org/pdf/...
hal.science/ha...
Follow Au5:
TW: / au5music
FB: / theau5
SC: / au5
IG: / au5_official
Store: au5.bigcartel....

Пікірлер: 290
@skybreakedm
@skybreakedm 9 ай бұрын
I love that wave candy is in the bottom left corner just dunking on these inferior ones the whole video 🤣😅
@zweizweidreizweidreinull
@zweizweidreizweidreinull 9 ай бұрын
Hey, audio plug-in dev here! I'm currently working on a plug-in UI component library and I'll definitely check out how spectrum reassignment is implemented. I've always wondered how the really clean spectrum analyzers and spectrograms that retain so much detail in the bass frequencies work. Thanks for this awesome video!
@Mefistofy
@Mefistofy 9 ай бұрын
Heh, I just started playing with the vst3 dev kit, coming from audio DSP, mostly in research. I guess this is something I might want to try as my next project. Possibly interesting to learn Vulkan.
@nexusobserve
@nexusobserve 9 ай бұрын
all i can say is check our airwindows, he stream his coding
@kanzakimusic
@kanzakimusic 9 ай бұрын
Let's goooo
@Tsarpf
@Tsarpf 9 ай бұрын
@@Mefistofyprobably better off learning CUDA rather than Vulkan if you just want to parallelize stuff. Numpy (jax) are close to matlab if you know that and just want something more convenient. The thousands of lines of boilerplate to create a single triangle in Vulkan is not really worth the time unless you are a big team creating a game engine or something. For OpenGL its only two hundred but still rarely worth it. Use libraries!
@beardyman
@beardyman 9 ай бұрын
Ooooh?
@RaquelFoster
@RaquelFoster 9 ай бұрын
I'm a developer and I've done a lot of signal processing work. Reassignment is not a secret, and neither are the tradeoffs. It's doing multiple DFTs and using the phase derivative to estimate the frequency. It takes a lot more CPU, and all those estimations turn into error when you add harmonics or multiple sinusoids. It totally falls apart vs. white noise. But if you want a sharp spectrogram of a monosynth, definitely use reassignment. Spectrograms are kinda like compressors. Everybody just wants them to work, but dialing them in is very situational.
@razvanrusan9319
@razvanrusan9319 7 ай бұрын
This needs to be higher up. In case another devs want a reason as to why it hasn't gotten more research (and widespread implementation in VSTs) already.
@ninethirtyone4264
@ninethirtyone4264 2 ай бұрын
When you mentioned that it takes a lot more CPU, how much comparitively? Would it be even viable to implement this in an embedded application or the processor required to make this possible would competely blow up the cost?
@NathanWhitehead
@NathanWhitehead 19 күн бұрын
@@ninethirtyone4264 If you just want frequency reassignment it is 2 FFTs instead of 1, so about double the cost.
@MrBillsTunes
@MrBillsTunes 9 ай бұрын
"today i'm not gonna do a tutorial" *does a tutorial*
@au5music
@au5music 9 ай бұрын
lol “Today’s tutorial: how to get frustrated over sub-par spectrograms”
@diegomanrique4716
@diegomanrique4716 7 ай бұрын
@@au5music kzbin.info/door/u5jfQcpRLm9xhmlSd5S8xw
@diegomanrique4716
@diegomanrique4716 7 ай бұрын
@@au5music www.youtube.com/@LofiGirl
@diegomanrique4716
@diegomanrique4716 7 ай бұрын
@@au5music kzbin.info/www/bejne/b4awqY2lm7KBmKM
@diegomanrique4716
@diegomanrique4716 7 ай бұрын
@@au5music www.youtube.com/@ChillhopMusic
@robiaster
@robiaster 7 ай бұрын
Just a note, Image-Line didn't discontinue the VSTs to restrict people to FL Studio, but because we couldn't justify the maintenance effort required for them. All of the VSTs had significant bugs which took ages to get fixed, because the 2 devs who could work on them were Miro, who does all of the UI stuff, and Frederic, who is the lead dev for FL Studio. The plugins made barely any money compared to Fl Studio and we didn't want to continue selling something broken at the time. IL has stated on multiple occasions that they were planning to re-introduce the VST plugins, but they just never have. I hope they might someday. Especially if it enables compatibility with the DAW project format or importing into Bitwig in future or something. I fully agree with the sentiment though.
@jenbanim
@jenbanim 9 ай бұрын
5:25 this is actually quite literally the uncertainty principle. In quantum mechanics, the position of a particle is related to the momentum of that particle by a fourier transform, just like how an audio file's waveform is related to its spectogram. The tradeoff between frequency resolution and time resolution in these VSTs exists for exacty the same reason that there is a tradeoff between knowing where a particle is and how fast it's going in our universe
@au5music
@au5music 9 ай бұрын
i know, its crazy!
@LarsWilms
@LarsWilms 9 ай бұрын
That is so cool
@jorgepeterbarton
@jorgepeterbarton 9 ай бұрын
Its more than that in the quantum world. Wee don't affect the observed object here, its just a tradeoff. In quantum systems your measurement actually collapses the particle into a state of one variable measured which causes another variable to become uncertain probability. It occurs with spin measurements too, due to the effect of things at scale being affected by measurement and observation. Spin doesn't use fft yet its still operating under uncertainty principle because what we are measuring is collapsed into a condition of that variable due to being fundamentally so small, plus particles can not have continuous values of spin so measuring in new direction orients the particle in a new way . Here its continuous and doesn't change the state by observing its just our knowledge of the continuous state. It definitely just a classical uncertainty.
@morgan0
@morgan0 9 ай бұрын
@@jorgepeterbarton it’s still about wave properties, just with the added issue of only getting one measurement. if the wave isn’t affected by the measurement, each measurement has this tradeoff, but you can just do it more than once
@Bobbias
@Bobbias 9 ай бұрын
​@@jorgepeterbartonthat's only one interpretation of QM though. Not everyone agrees on that interpretation. What we see does appear that way, but there are other possible explanations for that behavior beyond the wave function collapse theory.
@deadpixel2907
@deadpixel2907 9 ай бұрын
Honestly the person who coded Wave Candy (Didier Dambrin aka "Gol") is just a Savant, so I'm not surprised to see it here. I mean all the major FL Plugins were coded by him; Sytrus, Maximus, Harmor, etc. It's a shame he's no longer really involved with the company, but they are still delivering solid content.
@robiaster
@robiaster 7 ай бұрын
He's happily playing with Lego nowadays :) I highly respect the dude, but I think it's a good thing he moved on eventually, since it allowed Image-Line to work a lot more on user requested features. He laid a really really solid foundation with a really unique singular vision.
@ethanlkelly
@ethanlkelly 9 ай бұрын
I rarely comment on videos, but as a musician, mathematician, DSP lover, and general fan of your videos, this information has been too absolutely mind-blowing to NOT leave a comment. I'm definitely going to check out minimeters ASAP! Love your music and can't thank you enough for the awesome videos!
@alexwang007
@alexwang007 4 ай бұрын
Hey Au5! I'm doing engineering master's in control systems right now, been listening to you since 13. I am tackling the same problem, lots of people implement spectrograms very, /badly/, where some people directly use FFT even though the results do not correspond to our ears. I've been developing a code for the longest time that has every aspect of the spectrogram controllable, such as window length, hop size, and yes, it has reassignment method implemented, as well as harmonic summation. It can also do correlation spectrogram which doesn't generate higher harmonics and easily allow you to determine the fundamental frequency. This is also implemented in hardware that can do this in realtime with a mic or audio source. Keep in touch if you'd like to receive updates or programs/hardware to try!
@heddshot87
@heddshot87 Ай бұрын
AU5 needs to see this, very cool
@Holovegram
@Holovegram 9 ай бұрын
Your first plugin SpectrAu5 ⚡✌🏻
@xtrullor
@xtrullor 9 ай бұрын
Really weird how long I've been sleeping on Wave Candy even though I've known about it for ages. Never knew how good it actually was, just took it for granted.
@SlvYT
@SlvYT 8 ай бұрын
I have the same, lol
@JakeFoster01
@JakeFoster01 9 ай бұрын
Shoutout to Direct for creating MiniMeters! Amazing producer
@jesseeatsbrains
@jesseeatsbrains 9 ай бұрын
For Ableton and other daw users it’s basically all we’ve ever wanted for an alternative to wave candy. Also i have a Mac on 10.14 still, and he still supports the OS, what a king.
@SjarMenace
@SjarMenace 9 ай бұрын
He didnt create it . The external vst builders dis…
@SjarMenace
@SjarMenace 9 ай бұрын
Minimeters was perfect if the osciloscope wasnt so small
@LarsWilms
@LarsWilms 9 ай бұрын
​@@SjarMenace what do you mean by small
@SjarMenace
@SjarMenace 9 ай бұрын
@@LarsWilms you cant change the osciloscope like oszilloscope from ben schulz
@dwnetwrok
@dwnetwrok 9 ай бұрын
I use Wave Candy on my default template. Glad to see someone showing the love it deserves
@NathanWhitehead
@NathanWhitehead 10 күн бұрын
I'm not gonna lie, for the first 9 minutes I was ready to hurl my computer out the window thinking all this was some proprietary super hacky algorithm. Then you said the algorithm, and gave references, and I was in shock. I spent the next couple days implementing it, and it absolutely works. Reassignment should be much more widely known as a standard technique. THANK YOU for this video.
@filipenicoli_
@filipenicoli_ 9 ай бұрын
For those interested, the FFT groups ranges of frequencies inside "bins" (basicaly ranges) and those bins are linearly spaced in frequency. Since when dealing with frequencies we tend to use log scales, you're basically zooming in at low frequencies and what you see there is "pixelated". You'll have the same amount of bins between 0-1kHz and 10-11kHz. Increasing the FFT size increases the amount of bins and thus the "resolution" improves, but the FFT size is correlated with the amount of samples the FFT uses.
@DJPastaYaY
@DJPastaYaY 9 ай бұрын
Interesting to hear this. You don't see many videos covering this topic!
@glenfoxh
@glenfoxh 4 ай бұрын
The hype for things can be unforgivable, once you find the truly good stuff. It's like some developers, have no idea that we have eyes of our own, to see what is good or not for ourselves. They merely wish we didn't, so their hype talk would work as well as they hope it will. It's frustrating at times to see. Thank you for showing us the truly good stuff.
@nathanempty
@nathanempty 9 ай бұрын
This is an EXCELLENT video. this has always driven me nuts and I have never known there was a better alternative until JUST now. THANK YOU
@sentinelav
@sentinelav 9 ай бұрын
There's a recent reassignment method called Synchrosqueezing that would be dope to see implemented in spectrum analysis. Thanks for bringing awareness to the issue!
@au5music
@au5music 9 ай бұрын
Oh I believe I’ve seen this in Steinberg Spectralayers
@Derpcat
@Derpcat 9 ай бұрын
its about time more people start to give a shit bout the spectrogram standards, Wavecandy is ahead of the curve, seems like a pattern with Image Lines plugins, they always been ahead of the curve, insane stuff!
@jeff-meyer
@jeff-meyer 9 ай бұрын
@Au5 if you have any interest, i threw together a really simple M4L device which will hide the IL Wave Candy vst when the Hint/Info box isn't showing. This way it automatically goes away and gets out of the way when you are scrolling through the library and such on the left side of the screen. It only appears when the bottom "Devices/Midi/Audio" area is visible, which is when the Hint/Info box is visible.
@zesterfrost_music
@zesterfrost_music 9 ай бұрын
The frustration in finding a good spectrogram is so relatable. Like you realise how valuable simple and powerful plugins like Wave candy and Harmor are once you switch to a different DAW. As always, thanks for the valuable insight Austin.🙌
@TollsterMensch
@TollsterMensch 6 ай бұрын
Simple? Harmor?
@zesterfrost_music
@zesterfrost_music 6 ай бұрын
@@TollsterMensch Yes. Unlike other plugins, Harmor is very good in coming up with new and unique sounds.
@dohpam1ne
@dohpam1ne 9 ай бұрын
So happy that you pointed out how this is similar to the uncertainty principle. The mathematical reason is exactly the same for both. Unfortunately, better plugins won't be able to get rid of this tradeoff :)
@_Polymorphiq
@_Polymorphiq 9 ай бұрын
I love your videos so much man. I literally just bought Vision 4x. 30 minutes ago and came across this video...... wish I viewed it before. Also I am one of those who have also wondered what spectrogram you use in your videos.
@donotoliver
@donotoliver 9 ай бұрын
Finally someone is talking about this One more thing! Edison is even better than Wave Candy! Along with enhanced frequency, it has 'enhanced time' (shortcut: T) which totally sharpens up the transients, at no expense
@DANETRONICMUSIC
@DANETRONICMUSIC 9 ай бұрын
No wonder why I couldn’t find that spectrogram. This was very informative thanks for sharing!
@jack_digital
@jack_digital 9 ай бұрын
JEEEEZZZZ,,,, you are just exactly when and where i need you to be. I sat down with the intention of buying minimeters last night and just when i did i saw this video thumbnail. Soooo,, thank you Mr, Perfect timing.
@hanshanshansans
@hanshanshansans 8 ай бұрын
Thanks for making us aware, I always figured that mind of low end resolution must simply be imposible, didnt even bother looking
@Terrapastel
@Terrapastel 9 ай бұрын
Incredible. I have 4x and thought it was the best thing out there. Seems IL Wave Candy already nailed it, although sadly obsolete. It's amazing that mathematicians and scientists have found a way to analyse the phase to get super accurate frequency measurement using FFT, with magnitude as a trade-off. I'm going to get Minimeters while it's still in beta. Looks great.
@ebrann
@ebrann 9 ай бұрын
As someone who works as a sound analyzer under 3khz we have to change our sample size many times throughout an analysis. If I am working with board-band frequencies we have to change our spectrum output to get more detail as opposed to a narrow-band frequency source. The short of it is don't rely on a single processer setting and move through the options provided to get the detail you want.
@CmoIsDaNam3i
@CmoIsDaNam3i 9 ай бұрын
Dang. Honestly shows how much IL plugins are ahead of their time in some regards but also can agree with that they should be more open to where you can use it. :/
@rynabuns
@rynabuns 9 ай бұрын
I've been waiting for a VST version of Vocodex for nigh on a decade 😅 Someday my prince will come
@lmaoanatorhilarious2582
@lmaoanatorhilarious2582 9 ай бұрын
@@rynabuns I think I’ve actually run vocodex on ableton before
@talgy2671
@talgy2671 7 ай бұрын
​@@rynabuns what's so special about Vocodex
@haidenmorgan
@haidenmorgan 2 ай бұрын
I wish I could have fl whole library of plugins and effects on Ableton as vsts and sample libraries. I'd pay for the whole software lol
@ravarcheon
@ravarcheon 9 ай бұрын
ive been annoyed about this for years! thank you for this video and spreading awareness
@7minutesdead
@7minutesdead 9 ай бұрын
Extremely helpful. I haven't been using spectrograms at all and I really should because I lose sense of my mixes so often and so quickly Now I gotta figure out how to get the wave candy version for Windows since I'm on Ableton too lol
@gursach4435
@gursach4435 9 ай бұрын
12:32 you designed that sounds to look like a bifurcation plot in a spectrogram? crazy also... watching this video just made me realize a link between the content of THREE courses I'm taking at school. Fourier transforms, how they are a more fundamental cause of the uncertainty principle in QM due to position and momentum being conjugate, and how this sense of being conjugate is like the sense of conjugate variables in the Hamiltonian formalism of classical mechanics. And I have no business learning about audio production tools, I just watched this video because I like your music. Insane.
@darklight8774
@darklight8774 7 ай бұрын
that's actually not hard! there are plugins that can generate sounds using pictures, and the picture is shown in a spectrogram when analyzing the sound e.g harmor's image synthesis function
@mike777881
@mike777881 9 ай бұрын
legit working on my first DSP project and this seems very applicable for what I'm doing. Thanks for spreading the word
@_XRMissie
@_XRMissie 9 ай бұрын
Wavecandy enjoyer for years. I was grateful how good this is, but I didn't realise how crap the competition was lol
@andor3xy712
@andor3xy712 6 ай бұрын
thank you so much I hope this helps devs achieve a better standard for this. aguante image line!
@Ignight
@Ignight 9 ай бұрын
This has been driving me crazy for years! I just picked up minimeters a few weeks ago, didn't know there was a sharp setting. Absolutely clutch 👌 Thank you, stay lit 🔥
@UndulaeMusic
@UndulaeMusic 9 ай бұрын
Really hope Image-Line opens up their walled garden. Currently an Ableton user but I used to use FL Studio and I really miss some of these plugins (Wave Candy, Harmor, Maximus)
@MrReeTart
@MrReeTart 9 ай бұрын
Harmor is just incredible.. mind blowing. Zebralette3 seems promising
@izzurumusic
@izzurumusic 9 ай бұрын
Agree
@stereokuuji
@stereokuuji 9 ай бұрын
Harmor is a stand alone plugin
@MrReeTart
@MrReeTart 9 ай бұрын
@@stereokuuji Harmor only available for windows
@UndulaeMusic
@UndulaeMusic 9 ай бұрын
@@stereokuuji unfortunately Image Line discontinued updates for the standalone VST a few years ago, so you can currently only use it within FL Studio unless you happen to already have an older version and you're not running on Apple Silicon
@official-phuh
@official-phuh 9 ай бұрын
Wave candy in Live myself too. I didn't know IL stopped the non-FL version. I shall cherish this old version. Good analysis
@SteveAcomb
@SteveAcomb 8 ай бұрын
as an electrical engineer with a focus on signal processing, I’m honestly blown away by that wavecandy “enhanced frequency”spectrogram. how tf are they doing that? this is really hard for math reasons… *edit wow! thank you so much for mentioning the papers! you’ve given me something to geek out about for the next few weeks 😂
@Jaysterr
@Jaysterr 9 ай бұрын
Dang I always wondered why Wave Candy looked so good lol. It’s awesome that you got the minimeters dev to add it though! Love that tool
@rottenelk
@rottenelk 9 ай бұрын
This is so important, thanks for sharing. So glad minimeters added an enhanced frequency option
@random-604
@random-604 9 ай бұрын
Loved this video! I've always been unsatisfied with the low frequency precision of Izotope Insight's spectrogram, so thanks for recommending the alternatives!
@Plikso
@Plikso 8 ай бұрын
Its incredible how he got the best intro i've ever seen with just 5sec
@dr4gon8it3music3
@dr4gon8it3music3 9 ай бұрын
pushing the industry forward once again - inspiring being and great sensei
@shmackydoo
@shmackydoo 9 ай бұрын
...And loudness is represented by the brightness of the image Great video Au5. Love the insights you have. And yeah FL is definitely infringing on our freedom by limiting their software to their daw
@FightinTheGorlax
@FightinTheGorlax 4 ай бұрын
Just saw a new spectogram called Spec Ops by Bullseye Audio. Seems a lot more detaled than typical spectograms, but the X axis is where that frequency bucket is in the stereo field as opposed to time.
@StarOnCheek
@StarOnCheek 9 ай бұрын
Omg, I've started doing sound design and using spectrum analyzers in a huge part thanks to you, especially the spectrum analyzers, and I've been trying Vision X4 and I am literally so disappointed by it. I didn't even understand why I was not like what you do in your videos until I saw this
@SALEENS7GTR5
@SALEENS7GTR5 9 ай бұрын
As an FL user, thanks for saving me money by sticking to Wave Candy
@alsoeris
@alsoeris 9 ай бұрын
Most of them not being able to display the side channel is my main problem. It works if you set up a utility before it though.
@eosmusic9872
@eosmusic9872 9 ай бұрын
Came here to say this
@offsetemusic
@offsetemusic 9 ай бұрын
there's a reason though: the side channel can phase cancel the mid channel depending on the information it has the same thing can happen when you sum the left and right channels to mono. the most ideal solution is to have separate spectrograms for each channel
@D16-i5n
@D16-i5n 9 ай бұрын
i think you can just split the mid side into two tracks
@au5music
@au5music 9 ай бұрын
There was a very old iTunes visualizer plugin called SpectroGraph that displayed stereo information in a spectrogram by coloring the L and R channels red and green (yellow for combined/mono). I never saw such a thing implemented since and would also love to see that as L/R and M/S analysis spectrograms along with enhanced frequency. Would be the end-all for me.
@benkirkpatrick6343
@benkirkpatrick6343 9 ай бұрын
So happy rn, being a Windows FL user. Love being the unsung hero of the music game lol
@43tss
@43tss 9 ай бұрын
Music producing turns back to be science. Finally. Thanks for this video, can't wait for more!
@05degrees
@05degrees 7 ай бұрын
Haha there’s so much science in signal processing used to make good-behaving filters and oscillators for synths! Well, basics of it are quite simple but when you try to, say, reduce aliasing, or ringing, or unwanted tails, or something else, it amps a lot.
@fidgetgadget3475
@fidgetgadget3475 9 ай бұрын
Very coherent message. Thank you for bringing awareness.
@CanaDan
@CanaDan 8 ай бұрын
I think alot of it was that it just wasnt heard about. It may also be really difficult to implement (fft analysis alone isnt easy. some very spooky binary manipulation and instruction set utilization going on). I've implemented fft spectrograms into projects of mine, and yet have never heard of spectrum reassignment, so thanks for bringing this to my attention. I was planning on implementing wavelet analysis, but theres not alot of info on that algorithm so maybe this is a better alternative instead to get better resolution. btw, if you can find a wavelet transform visualizer, give it a go. It may be similar to spectrum reassignment in terms of quality, as it essentially breaks past the fft uncertainty principal by cheating lmao. You get extremely good low frequency information and really good time accuracy because it treats each frequency as its own independent calculation
@fidgetgadget3475
@fidgetgadget3475 9 ай бұрын
Electrical engineers: Why would you need that much performance? Sound designers: I need it.
@jay7dsi
@jay7dsi 9 ай бұрын
its so annoying that the crossplatform wave candy is discontinued, i miss it every time im working in ableton
@kinka16
@kinka16 9 ай бұрын
12:31 isn't that a famous math fractal with a chaotic behavior ?
@jinto-music
@jinto-music 9 ай бұрын
Definitely, that's the Mandelbrot set as a bifurcation diagram, Veritasium has that one video on it
@kinka16
@kinka16 9 ай бұрын
@@jinto-music oh thanks for info, i thought it was a different set, no related to the mandelbrot set. ngl it sounds pretty good btw
@gursach4435
@gursach4435 9 ай бұрын
@@kinka16 it can actually arise in many other ways (though they could always be related to fractals in some deeper mathematical sense)! Example: Free-swinging pendulums generally behave periodically - if you keep track of the pendulum's position over time, as well as its speed over time, you'll find that its position and speed return to the same values after every natural period passes. Now if you drive/push the pendulum in an oscillatory fashion at a different frequency than its natural frequency (think pushing someone on a swing but NOT necessarily in the way that maximizes their speed), you can introduce chaotic behaviour; by increasing the driving amplitude (how hard you push it), you will find that the behaviour tends to become 'more chaotic,' corresponding to the pendulum taking a larger number of its natural periods to return to the same position and speed values. Increase the amplitude enough, and eventually the pendulum will NEVER revisit a single position and speed configuration value, i.e. its motion is completely unpredictable. The bifurcation plot arises when you plot the driving amplitude on the horizontal axis and the position value(s) it takes on at every period on the vertical axis. At small amplitudes, it is periodic in the normal sense, revisiting the same position after every natural period, so the plot is a horizontal line here. Increase the amplitude, and eventually it takes two periods to revisit the same point, meaning every even-numbered period it will visit one point, and every odd-numbered period it will visit another point - the plot here is two parallel horizontal lines. Increase some more, now it will visit four distinct points, and so on. The plot splits and splits (bifurcates), generating that distinct shape.
@kinka16
@kinka16 9 ай бұрын
@@gursach4435 yeah i did a lot of mechanical engineering and i have a lot of interest on science, physics, but im not too familiar with in some way, i really need to go deeper and somewhat experimental. it is absolutely facinating how simple things can be this chaotic !
@05degrees
@05degrees 7 ай бұрын
@@kinka16 Check out the logistic map, it’s very simple x ↦ a x (1 − x) where the upper bound for a is 4 and I forgot the lower but it can go a bit below zero. The magic is that this is a discrete thing where you change x at discrete times; it you try to write an analogous continuous system, the chaotic behavior for large values of a doesn’t happen anymore (there’s a theorem somewhere that for a continuous system, you need no less than three dimensions (and so, real variables), like in the system that gives the Lorentz attractor; but discrete systems are weirder and so even this simple quadratic thing goes).
@eputty_audio
@eputty_audio 9 ай бұрын
Absolutely love this video!
@adamluhring2482
@adamluhring2482 9 ай бұрын
The reassignment method is cool, but it's not the only solution worth considering here. Two common DSP methods: 1) You can estimate the true frequencies of peaks using splines that are only calculated near maxima in the spectrum above a certain threshold. This is pretty computationally efficient and is used in a lot of algorithms that extract partial data from audio (like pvanal in Csound). 2) You can take a wavelet transform. You're right about the uncertainty principle between time and frequency. The best time resolution and worst frequency resolution is the untransformed signal (just the list of sample values). The worst time resolution and best frequency resolution is an unwindowed DFT across the whole signal. Spectrograms are a series of shorter snippets of the signal Fourier transformed; the longer the snippets, the better the frequency resolution and the worse the time resolution. There's also a whole different class of transforms called wavelet transforms that gets the same excellent frequency resolution at the lowest end that a windowed Fourier transform would have and good time resolution at the high end (with a slight loss in frequency resolution).
@Venthorn
@Venthorn 9 ай бұрын
It's honestly frustrating how few spectrograms give you the option of different wavelet transforms instead of the short time Fourier transform.
@filipenicoli_
@filipenicoli_ 9 ай бұрын
Couldn't the FFT window be slided a few amount of samples instead of the length of the whole window? I guess you'll be doing a higher amount of transforms and using more processing power, but it could improve the time resolution. In DSP courses we've also studied zero padding/stuffing. I'm not sure if this could be applied in some way here.
@adamluhring2482
@adamluhring2482 9 ай бұрын
@@filipenicoli_ Sliding the FFT window is regularly done, but it doesn't improve frequency resolution.
@filipenicoli_
@filipenicoli_ 9 ай бұрын
​@@adamluhring2482 but wouldn't sliding improve time resolution for bigger fft sizes?
@adamluhring2482
@adamluhring2482 9 ай бұрын
@@filipenicoli_ Oh sorry, read that as frequency resolution, not time. Still, the answer is no. For a window of a given length, the FFT will always be the worst time resolution. The fact that those extra time steps can provide practical value is because human hearing works more like a wavelet transform; we'll never actually hear a sinusoid of infinite duration. But in the sense meant by time-frequency uncertainty, you can't beat that limit
@kinka16
@kinka16 9 ай бұрын
i was going to sleep but i had this call from Austin !
@Djenerater
@Djenerater 9 ай бұрын
FL Out here flexin
@dustinmorrison6315
@dustinmorrison6315 9 ай бұрын
Hey Au5 you should also check out the Wave Candy vectorscope so you can fine-tune your stereo shaping! I have been using an FL Studios' patcher patch that I made to listen to melodic dubstep for the last year and it sounds incredible. I also combine it with the convolver to make it sound like I'm listening in any venue I want.
@au5music
@au5music 9 ай бұрын
I have, but its not nearly as wild as Signalizer's vectorscope. It's got a time dimension so its actually a 3d oscilloscope.
@billpodolak7754
@billpodolak7754 9 ай бұрын
This is a cool video - heads up that the reassignment method spectrogram is available as an option in iZotope RX, but not yet implemented into Insight.
@exacoustics
@exacoustics 9 ай бұрын
Thanks for the links. I'll check them out
@yuxanne.
@yuxanne. 9 ай бұрын
The minimeters one gets a higher resolution depending on the windows size, i like to keep it vertical, with a really wide window size, its on my second moniter so space is never an issue
@menglin7432
@menglin7432 9 ай бұрын
Mathematically it's impossible to increase resolution of low frequencies without sacrificing time resolution. But what you described seem more like a UI issue, where the detected frequency isn't communicated to the user well.
@menglin7432
@menglin7432 9 ай бұрын
Using morlet wavelet transform, it's possible to get a better balance of time and frequency resolution
@razvanrusan9319
@razvanrusan9319 7 ай бұрын
@ 12:34 bhahahh that's the chaos map, but rotated 90 degrees. cool math easter egg!
@Milinor
@Milinor 9 ай бұрын
That's my battleground!
@handsomehal142
@handsomehal142 7 ай бұрын
I knew what this would be about when I clicked on the video, but it was still surprising to see what spectral reassignment looks like in real time! Still I doubt it's if very CPU intensive. It's basically just using instantaneous frequency to map to another frequency space with better resolution?
@HLRxxKarl
@HLRxxKarl 9 ай бұрын
Image Line needs to bring the Juice Pack back! Even as an FL owner who uses it 50-75% of the time, I'd drop more money on the Juice Pack in a heartbeat.
@turbinchik
@turbinchik 9 ай бұрын
Much respect as usual❤
@truthordarrenmusic
@truthordarrenmusic 9 ай бұрын
🤩 1024 FFT FTW 🩵
@SjarMenace
@SjarMenace 9 ай бұрын
Thx for being a voice we need more vst be adressed such things. Inhope they will get canceld
@Illkacirma
@Illkacirma 8 ай бұрын
thanks for sharing
@officialmaximedes
@officialmaximedes 9 ай бұрын
great video as always!
@chainsawteddybear
@chainsawteddybear 8 ай бұрын
Preach it brother
@DenisDeLong
@DenisDeLong 7 ай бұрын
Fantastic.
@SolarLiner
@SolarLiner 9 ай бұрын
I thought I was the only one that cared about how Wave Candy was the only spectrogram I knew that did such a thing, and when moving from FL to Bitwig, I was seriously missing having it.
@OriginallyG
@OriginallyG 9 ай бұрын
It seems like vision 4x makes up for the low FFT resolution by having the horizontal bar graph that shows the volumes of frequencies
@ColinLeet
@ColinLeet 9 ай бұрын
It looks like it's performing a peak picking on the fft following up with phase correction on the peaks, and then is just graphing those results. (Hence why it's not showing side lobes around the peak for the improved spectorgam.) I wonder if it's bases off of quadratic peak interpolation, or if it's more along the lines of a phase vocoder.
@WDShorty
@WDShorty 9 ай бұрын
Also custom color gradients would be the cherry on top
@vt100music
@vt100music 9 ай бұрын
Second question: since the analysis is sample based, can you increase the sample rate to impact the time resolution when you have higher fft sample settings? Like if I go to 96khz, does my analyzer get more time resolution at higher settings?
@au5music
@au5music 9 ай бұрын
Technically yes. 44.1k is already calculating more phase data than the refresh rate can fully display. If it outputted 1 sample per pixel there would be more information but that time scale would be too small to be useful.
@xuser8314
@xuser8314 9 ай бұрын
Id love harmor on mac so much. Maybe there is something we can do? If enough musicians sign a petition to bring it and other vsts to mac too.
@hjkhhjkh3635
@hjkhhjkh3635 9 ай бұрын
Hey Austin, Would it be possible for you to do a tutorial on how you use Morph? Only a 2-3 min video would be great!
@s.t.p.1236
@s.t.p.1236 9 ай бұрын
Thanks for sharing, peace
@feeltheflow9383
@feeltheflow9383 9 ай бұрын
12:34 omg it plots the logistic map!
@leiocerayt
@leiocerayt Ай бұрын
Now the question, how did you install WaveCandy???
@Znernicus
@Znernicus 9 ай бұрын
This is very interesting. I'm curious about your wavecandy preset to get it to look like that, because the default spectrum view does not look quite that sharp. Thanks!
@synthclub
@synthclub 3 ай бұрын
Ahh in Izotopes defence, Insight has a '3d spectrogram' which gives you the enhanced low end visualisation... looking at the wave forms in the 2d plane reduces resolution.
@GamboTheGent
@GamboTheGent 29 күн бұрын
Great video. Btw how do you get wave candy to work in Ableton? as far as i know its a plugin made for FL studio ?
@muffinmaster9037
@muffinmaster9037 9 ай бұрын
Nice video! I just found a new purpose for Minimeters (i only used it for making twitter clips lmao)
@thomasfokas
@thomasfokas 7 ай бұрын
How do you get wave candy? I can’t find it, besides being part of FL studio, but I want to use it with Live.
@greencowboy4762
@greencowboy4762 Ай бұрын
yeah
@leiocerayt
@leiocerayt Ай бұрын
Same for me and Cubase
@PocinTheTech
@PocinTheTech 9 ай бұрын
On first glance, I think the Candy spectrogram looks so good because it is lying. There are mathematical limits when sampling and analysing and you simply cant have such a high resolution without loosing some information. Either they have a variable sampling size (time) so high frequencies get sampled faster and are correctly timed, while low frequencies are sampled slower, or they have some kind of smoothing that makes it look smoother but in reality destroys/invents information, that wasn't in your signal. If I understand the reassignment method correctly, it is essentially smoothing in low frequencies since they compress the energy on its center of gravity. You can test this is you use two very close low frequency waves and look if they can be resolved by the plugin, or if they are merged to one
@au5music
@au5music 9 ай бұрын
It doesn't destroy or invent information, besides potentially making it harder to read magnitude color values. It incorporates bin phase angle in its display, which I find useful as subtle phase shifts and interactions are very apparent in the low end. Standard spectra won't show it at all.
@PocinTheTech
@PocinTheTech 9 ай бұрын
@@au5music well, I looked a bit into it now and I am pretty sure, there is some kind of "information loss". When a tone starts the spectral analysis should always show a broad spectrum, even for a perfect sine wave. Simply because every pulse is fourier limited and you need to add additional frequencies for a sound to change loudness. This are just "pseudo frequencies" since we usually dont percieve them as those, but the spectral analysis should show them, if it is accurate. At 2:41 you can see what i mean. The huge spectrometer has this "bar" before the sine waves are spectrally separated. But for the candy spectrometer this is missing. It starts with perfectly separated sine waves without spectral broadening when the pulse starts and finishes. So obviously something is missing here.
@cookiecap_465
@cookiecap_465 9 ай бұрын
great explanations!
@fluorescent2403
@fluorescent2403 6 ай бұрын
12:34 cant even tell if you got that bifurcation diagram here deliberately, these sort of fundamental math things tend to just show up randomly i used to accidentally render cardioids all the time back when i was messing with shader code
@MFKitten
@MFKitten 9 ай бұрын
Some kind of compositing of FFT sizes would probably work decently.
@gctechs
@gctechs 9 ай бұрын
Also something like this is available in Renoise.
@GBRen-xc2ow
@GBRen-xc2ow 9 ай бұрын
Does it apply to EQ’s as well? I’m not sure how Fruity Parametric EQ 2 compares to other EQ’s, but it has a similar feature where you can enable “Enhanced Frequency” and “High Precision” to better track the frequencies on the heatmap with thin lines.
@valentinpedersen6144
@valentinpedersen6144 9 ай бұрын
Is it because it would need to clean up noise down there to only show the most dominant frequency?
Resonate ANYTHING with SerumFX | Au5 Tutorial
16:50
Au5
Рет қаралды 91 М.
Yoink Anything | Bass Filter Tutorial
6:28
Au5
Рет қаралды 6 М.
УЛИЧНЫЕ МУЗЫКАНТЫ В СОЧИ 🤘🏻
0:33
РОК ЗАВОД
Рет қаралды 7 МЛН
Au5 - Bridges Between [Full Album]
46:53
Au5
Рет қаралды 39 М.
introducing PolyNodes
3:52
sonicLAB
Рет қаралды 10 М.
Au5 | The NEW Hypergrowl | Serum Tutorial
13:15
Au5
Рет қаралды 50 М.
How I Flipped That Porter Song
18:18
Au5
Рет қаралды 32 М.
You Don't Understand EQ
17:41
sseb
Рет қаралды 823 М.
Why Pros BASS Sound SO GOOD? Here is the secret..
15:33
Alice Efe - Mercurial Tones Academy
Рет қаралды 120 М.
10 Years of Mixing Advice in 10 Minutes
10:49
In The Mix
Рет қаралды 917 М.
These plugins don't have to be free, but are
11:54
Au5
Рет қаралды 15 М.
Au5 | The "HyperGrowl" | Serum Tutorial
13:34
Au5
Рет қаралды 636 М.