Python Symbolic Regression (PySR) [Physics Informed Machine Learning]

  Рет қаралды 29,205

Steve Brunton

Steve Brunton

Күн бұрын

Пікірлер: 37
@zildjiandrummer1
@zildjiandrummer1 3 ай бұрын
As someone in this field, your work is having a 1000x impact with these easy to digest explainers. Absolutely fantastic work!
@yensteel
@yensteel 3 ай бұрын
Thank you so much for sharing about Symbolic Regression! I'm not in the development of SR, but have been testing a lot of the variants for some time for engineering and finance. It's surprisingly useful for HFT. It's incredibly relevant today despite discouragement simply because it's an old concept. One paper showed that it could compress data, two papers showed some could outperform SVM despite being much faster for inference (800x + faster in one test of my own). It's shown use cases in electrical engineering, civil engineering, and physics, and finance. The solutions are low level, without the need of libraries. Some are robust to noise too. Again, thanks for your discussion and sharing!
@taumag
@taumag 23 күн бұрын
I've been working on PySINDy for HFT. How does PySR help improve the process?
@yensteel
@yensteel 21 күн бұрын
@@taumag Sorry, I haven't used Pysindy yet. All I can say, is that the deeper the tree, the more difficult it is to get a globally optimal solution using genetic programming. PySR has some nifty features that alleviate this weakness, and it's fast. It's ability to add a myriad of permutations of operators can help avoid imaginary numbers and div/low explosions of numbers, and help it find an optimal solution faster. Personally, I prefer to keep the depth low yet keep the width wide using multi-gene genetic programming. It allows for lower latency, parallelism, and faster convergence to the solution. Have fun!
@taumag
@taumag 21 күн бұрын
@@yensteel Thanks for the feedback! I sincerely appreciate it. You might be interested in a search for "SymINDy: Symbolic Identification of Nonlinear Dynamics" It's a combination of SR with SINDy.
@julianl5967
@julianl5967 3 ай бұрын
13:48 Interesting that the Planck and Rydberg benchmarks, which I assume are data from quantum systems, have a 0/5 in every method tested
@HumanPP
@HumanPP 3 ай бұрын
Simply fantastic outreach work Professor Brunton. Thank you so much for the incredible contributions you bring to your channel!
@ariaalinejad7935
@ariaalinejad7935 3 ай бұрын
Love your work! Makes me want to lean more into this filed of research
@sheevys
@sheevys 3 ай бұрын
Congrats to Miles for getting coverage here
@wasiuyahya1427
@wasiuyahya1427 3 ай бұрын
Great video. Thank you Prof
@superman39756
@superman39756 3 ай бұрын
It would be beyond great to see a video on Kolmogorov-Arnold Networks (KANs) leveraging their interpretability for Physics Informed ML somehow. Perhaps, KANs could be used to replace MLP/FFN blocks in existing Physics Informed ML models?
@eladiomendez8226
@eladiomendez8226 3 ай бұрын
This is amazing. Thank you!
@physicsanimated1623
@physicsanimated1623 6 ай бұрын
Vivek here - awesome video! What about KANs (Kolmogorov Arnold Networks)? - would you say they belong to the family of "interpretable ML models"?
@musicarroll
@musicarroll 3 ай бұрын
Curious as to why PySR failed with Planck. Was that due to weakness in modeling stochastic diffeqs?
@superman39756
@superman39756 3 ай бұрын
It would be awesome to see videos on SPINDE and Neural SDEs too. Can symbolic regression be used to learn/find SDE terms to fit to data as an alternative to Neural SDEs?
@mahmoudhamdy4252
@mahmoudhamdy4252 3 ай бұрын
❤thank you sir very informative. I kinda understood it.
@MrSandshadow
@MrSandshadow 3 ай бұрын
What are the best entry level books for ML, AI, any other related topic?
@anonymous-s4k8t
@anonymous-s4k8t 3 ай бұрын
great video, I want to know what is this pysr model or library is good for fitting the predetermined equations or you can fit the data as well, i mean can i give this model a bunch of data and it will be able to tell me the equation.
@lakshay7174
@lakshay7174 3 ай бұрын
Sir can you pls structure all of your videos, I will be starting my undergrad soon so this will help a lot, we would be extremely grateful to you, THANKU 🙏🙏
@sampoulin9198
@sampoulin9198 3 ай бұрын
what does “structure all of your videos” mean?
@morpholino
@morpholino 3 ай бұрын
Wow! just wow
@aarontoderash6028
@aarontoderash6028 3 ай бұрын
Why is PySR considered N/A for DE?
@LigmusCrotum
@LigmusCrotum 3 ай бұрын
I believe genetic programming enables the evolution of computer programs, not just mathematical expressions like symbolic regression
@hubstrangers3450
@hubstrangers3450 3 ай бұрын
Thank you...
@MDNQ-ud1ty
@MDNQ-ud1ty 3 ай бұрын
So now someone just has to combine Sindy with PySR. It should be pretty simple.
@taumag
@taumag 23 күн бұрын
I asked the same thing. Have you found anyone who made an attempt? PySR can't do differential equations where PySINDy can. They are complementary areas of research, not exclusive.
@MDNQ-ud1ty
@MDNQ-ud1ty 23 күн бұрын
@@taumag unfortunately none of it really matters any more because the world is run by psychopaths and they are openly and freely committing a genocide among other things(hijacking other countries, undermining peoples sanity, undermining the financial system, etc).
@taumag
@taumag 21 күн бұрын
Search for "SymINDy: Symbolic Identification of Nonlinear Dynamics" It's a combination of SR with SINDy.
@rezah336
@rezah336 3 ай бұрын
it is just trial and error, nothing wrong with that but it is not very sophisticated
@zxcaaq
@zxcaaq 3 ай бұрын
Funny to see scientists still stuck in python even after industry has moved away from python 🤣🤣🤣🤣
@herewegoagain2
@herewegoagain2 3 ай бұрын
moved to where? 98% of ML engineering and data science is in Python.
@edunuke
@edunuke 3 ай бұрын
​@herewegoagain2 This superiority complex type of comment stems from insecurity 99% of the time.
@roberthaley3672
@roberthaley3672 3 ай бұрын
Moved where? SQL ? 🤣🤣
@p-j-y-d
@p-j-y-d 2 ай бұрын
What industry? Trolling industry?
Residual Networks (ResNet) [Physics Informed Machine Learning]
17:26
Rust for the impatient
10:43
No Boilerplate
Рет қаралды 763 М.
GIANT Gummy Worm #shorts
0:42
Mr DegrEE
Рет қаралды 152 МЛН
Какой я клей? | CLEX #shorts
0:59
CLEX
Рет қаралды 1,9 МЛН
БАБУШКА ШАРИТ #shorts
0:16
Паша Осадчий
Рет қаралды 4,1 МЛН
Python: Symbolic Regression
21:34
Predictive Modeler
Рет қаралды 9 М.
Why Does Diffusion Work Better than Auto-Regression?
20:18
Algorithmic Simplicity
Рет қаралды 411 М.
Neural ODEs (NODEs) [Physics Informed Machine Learning]
24:37
Steve Brunton
Рет қаралды 70 М.
The Mathematical Genius Behind the Blockchain
6:50
Soren
Рет қаралды 2,6 М.
The Key Equation Behind Probability
26:24
Artem Kirsanov
Рет қаралды 162 М.
Genetic Algorithms in Python - Evolution For Optimization
26:10
NeuralNine
Рет қаралды 20 М.
The Dark Matter of AI [Mechanistic Interpretability]
24:09
Welch Labs
Рет қаралды 114 М.
The Genius Behind the Quantum Navigation Breakthrough
20:47
Dr Ben Miles
Рет қаралды 1,3 МЛН
GIANT Gummy Worm #shorts
0:42
Mr DegrEE
Рет қаралды 152 МЛН