EuroSciPy 2023 - MyST & Thebe
27:50
EuroSciPy 2023 - Closing notes
16:35
Пікірлер
@Freeloader_420
@Freeloader_420 2 ай бұрын
She is by far the best-looking authority on black holes. This was fun to listen to
@wolpumba4099
@wolpumba4099 2 ай бұрын
*Summary* This presentation introduces Estimagic, a Python package for nonlinear optimization, highlighting its usefulness for complex estimation problems and statistical inference. *Key takeaways:* * *Problem (**0:40**):* Many professionals (e.g., epidemiologists, statisticians, engineers) face nonlinear optimization challenges but lack the expertise and interest to delve into optimization algorithms. * *Existing Solutions' Shortcomings (**1:25**):* Traditional optimization libraries like SciPy can be challenging for non-experts due to cryptic errors, boilerplate code, and difficulties switching between libraries with different interfaces. * *Estimagic's Solution (**3:51**):* * *Unified Interface:* Wraps optimizers from various libraries (SciPy, NLopt, etc.) under a common, user-friendly interface inspired by SciPy.minimize. * *Flexible Parameter Handling:* Accepts various parameter data types (NumPy arrays, Pandas objects, lists, dictionaries, etc.) and allows for nested structures, eliminating the need to manually unpack parameters. * *Diagnostic Tools (**7:46**):* Provides visualization tools (e.g., Criterion plot) to compare the performance of different optimization algorithms easily. * *Global Optimization (**9:32**):* Includes algorithms for global optimization (genetic algorithms, multi-start framework) to handle objective functions with multiple local optima. * *Other Features (**11:09**):* * Numerical derivative calculation * Maximization capabilities * Support for bounds and constraints * Jax compatibility for accelerated computations and automatic differentiation * Enhanced error handling for numerical stability * Algorithms for nonlinear least squares problems * *Team (**12:45**):* The speaker acknowledges the contributions of various individuals and institutions in developing and supporting Estimagic. * *Roadmap (**13:29**):* Future development plans include simplifying the addition of optimizers, creating algorithms for noisy optimization, and improving the real-time dashboard. * *Call to Action (**14:07**):* Users are encouraged to contribute, report issues, and request features on the Estimagic GitHub page. i used gemini 1.5 pro to summarize the transcript
@Molox15
@Molox15 4 ай бұрын
The API is very similar to lpyspark. In fact I don't think it would be a hassle to convert existing pipelines to polars.
@oflasch
@oflasch 6 ай бұрын
Excellent work! Solara is a joy to work with. Many thanks for creating it!
@iutubtivi
@iutubtivi 10 ай бұрын
I have no knowledge or time to do benchmarking but, I was using pandas' "append" to combine about 8000 CSV files (about 10 GB in total) and it was taking almost an hour and a half, i decided to try polars, according to stack overflow i could use, concat, vstack, or extend, i randomly chose "vstack", and it did the same workload in less than 1 minute, same computer, same python version, same everything, all i had to do was modify the script a little bit, for example remove "index = False" when exporting the resulting (huge) dataframe to CSV.
@SuilujChannel
@SuilujChannel 10 ай бұрын
impressive!
@adityaaware9844
@adityaaware9844 10 ай бұрын
Am I being super Geeky cz im getting super excited by this😅😅
@tilkesh
@tilkesh Жыл бұрын
Thanks
@dafmdev
@dafmdev Жыл бұрын
At the beginning of the presentation he showed the performance of using only Pandas. How is the performance using Rust?
@mindreendtre
@mindreendtre Жыл бұрын
1 order of magnitude was suggested, but it would be interesting to see a comparison.
@Jononor
@Jononor Жыл бұрын
Very good progress. Looking forward to the day where predict_proba() is the default people use - not predict(). The automatic 0.5 decision threshold is basically never the right one!
@nilsflaschel49
@nilsflaschel49 Жыл бұрын
Impressive, how scikit-learn is progressing, especially in the imbalanced learning area!
@krumarnaudov
@krumarnaudov Жыл бұрын
Love the move to industry use-cases!
@sergeybrutspark
@sergeybrutspark Жыл бұрын
Be the first to like ))) nice topic
@DiegoAndresAlvarezMarin
@DiegoAndresAlvarezMarin 2 жыл бұрын
It is a shame that we missed this material. An advanced talk with a horrible sound and image :( Can you please post the link to the slides?
@Sigma00000
@Sigma00000 2 жыл бұрын
Any updates on this work?
@juozasdautartas8566
@juozasdautartas8566 2 жыл бұрын
Very useful library!
@pau1976
@pau1976 3 жыл бұрын
Thanks, very useful.
@simonjemand3149
@simonjemand3149 3 жыл бұрын
Thank you for your nice talk! Roughly, how much longer do c-functions take to be implemented compared to their Numba counterpart?
@nix99problems
@nix99problems 3 жыл бұрын
Badly captured video. Can't see the projected screen
@DrIlyas-sq7pz
@DrIlyas-sq7pz 3 жыл бұрын
Thank you. I am using QuTip package in which i am making some logic gates. I follow the instructions In the user guide it is said that i need to install imagemagick but by conda or pip it does not install image magic but i installed wand.I already installed imagmagick on my pc manually. No after all the imports etc and after writing commands for gate making, i need to write gate.png to display the gate but it keep giving error below. Plz let me know what is this error and how can i display some result as image file in python. I will be grateful. I am using jupyter.
@DrIlyas-sq7pz
@DrIlyas-sq7pz 3 жыл бұрын
--------------------------------------------------------------------------- CalledProcessError Traceback (most recent call last) <ipython-input-9-a760fe8d2360> in <module> 1 q = QubitCircuit(2, reverse_states=False) 2 q.add_gate("CSIGN", controls=[0], targets=[1]) ----> 3 q.png ~\anaconda3\lib\site-packages\qutip-4.6.0.dev0-py3.8-win-amd64.egg\qutip\qip\circuit.py in png(self) 1759 @property 1760 def png(self): -> 1761 return DisplayImage(self._raw_png(), embed=True) 1762 1763 def _raw_svg(self): ~\anaconda3\lib\site-packages\qutip-4.6.0.dev0-py3.8-win-amd64.egg\qutip\qip\circuit.py in _raw_png(self) 1752 1753 def _raw_png(self): -> 1754 return _latex.image_from_latex(self.latex_code(), "png") 1755 1756 if 'png' in _latex.CONVERTERS: ~\anaconda3\lib\site-packages\qutip-4.6.0.dev0-py3.8-win-amd64.egg\qutip\qip\circuit_latex.py in image_from_latex(code, file_type) 225 _run_command((_pdflatex, '-interaction', 'batchmode', 226 filename)) --> 227 _crop_pdf(filename + ".pdf") 228 if file_type in _MISSING_CONVERTERS: 229 dependency = _MISSING_CONVERTERS[file_type] ~\anaconda3\lib\site-packages\qutip-4.6.0.dev0-py3.8-win-amd64.egg\qutip\qip\circuit_latex.py in _crop_pdf(filename) 113 """Crop the pdf file `filename` in place.""" 114 temporary = ".tmp." + filename --> 115 _run_command((_pdfcrop, filename, temporary)) 116 # Windows does not allow renaming to an existing file (but unix does). 117 _force_remove(filename) ~\anaconda3\lib\subprocess.py in run(input, capture_output, timeout, check, *popenargs, **kwargs) 510 retcode = process.poll() 511 if check and retcode: --> 512 raise CalledProcessError(retcode, process.args, 513 output=stdout, stderr=stderr) 514 return CompletedProcess(process.args, retcode, stdout, stderr) CalledProcessError: Command '('pdfcrop', 'qcirc.pdf', '.tmp.qcirc.pdf')' returned non-zero exit status 1.
@martindominikus8825
@martindominikus8825 3 жыл бұрын
this is amazing, thank you!
@KarlVonBismark
@KarlVonBismark 4 жыл бұрын
Excellent
@gakhov
@gakhov 4 жыл бұрын
Here you can find the slides from the talk: www.slideshare.net/gakhov/exceeding-classical-probabilistic-data-structures-in-data-intensive-applications
@drew5134
@drew5134 5 жыл бұрын
Python's arithmetic operators, should be b = exp(-((x-mu)**2/(2*sigma**2))) b thanks for the great video.
@pawhidden5054
@pawhidden5054 5 жыл бұрын
Is there any code online available in this lecture?
@alexwickstrom303
@alexwickstrom303 4 жыл бұрын
consulting.behnel.de/training/espy2017/
@anujmishra4412
@anujmishra4412 2 жыл бұрын
@@alexwickstrom303 Thank you so much!
@pintukr23
@pintukr23 5 жыл бұрын
I am using dask on kubernetes cluster on AKS (azure). I am getting some fixed number of workers . It is not zero. Where and what should I change?
@kulkarniajinkya
@kulkarniajinkya 5 жыл бұрын
Hey, very informative! Can you share the notebook?
@MsHappyburger
@MsHappyburger 5 жыл бұрын
@@bornabesic8315 thanks
@prativadas4794
@prativadas4794 5 жыл бұрын
can we have the ppt ?
@StefanoBorini
@StefanoBorini 5 жыл бұрын
hey, that's me! :)
@mundaka87
@mundaka87 6 жыл бұрын
You can find more information on "Scientific computing for quantum technology" and the other talks of EuroScipy 2018 at gist.github.com/carmelom/e4c898f2305f726aad744d0dd9bdf1a0.
@GeospatialTechHeaven
@GeospatialTechHeaven 6 жыл бұрын
kzbin.info/www/bejne/anLaiJywj5plm6s
@MarioHari
@MarioHari 6 жыл бұрын
Watching at 1.5x speed seems perfectly normal. Else it's super slow
@abhishek.chakraborty
@abhishek.chakraborty 5 жыл бұрын
Wow... super useful advice 👍
@warbird2k
@warbird2k 6 жыл бұрын
github.com/jorisvandenbossche/talks/tree/master/2017_EuroScipy_geopandas
@pdbar
@pdbar 5 жыл бұрын
WarBird thanks!
@cfrp17
@cfrp17 6 жыл бұрын
Greetings from Chile! Good job Seb!
@pushkarparanjpe
@pushkarparanjpe 6 жыл бұрын
Lovely presentation! Thanks, made for a lazy re-cap of PyTorch docs that I had been meaning to do.
@bobsalita3417
@bobsalita3417 6 жыл бұрын
Repos shown: github.com/aaron-xichen/torch-playground
@sartajsingh7974
@sartajsingh7974 6 жыл бұрын
Tutorial notebooks can be found here github.com/leosartaj/euroscipy-sympy-tutorial
@whereistejas
@whereistejas 6 жыл бұрын
bad audio!
@mariazamyatina2278
@mariazamyatina2278 6 жыл бұрын
Is it possible to download the Jupyter Notebook he is using somewhere?
@yazu00
@yazu00 6 жыл бұрын
I think this link works: github.com/MridulS/euroscipy-2017-networkx
@luiscerna7071
@luiscerna7071 6 жыл бұрын
Just install the tool for your operating system from: jupyter.org/install then from your command prompt you need to hit the command : "jupyter notebook" I think it is that same command for any operating system. That will open the Jupyter Notebook environment on your browser and that will link to your prompt. In the environment opened in you browser you will see your home directory and from there you can access your files or create Jupyter Notebook projects, like the one from this video. Jupyter Notebook projects posses .ipynb extension. You will need to install Networkx and Matplotlib for this examples.
@TheXplorian
@TheXplorian 6 жыл бұрын
@20:10 why had he made a sigmoid layer before the softmax layer, what i understand about logistic regression, is that it doesn't have a sigmoid activation
@theultimatereductionist7592
@theultimatereductionist7592 6 жыл бұрын
Fantastic talk!
@ferniquepierre4964
@ferniquepierre4964 6 жыл бұрын
See the summary at www.euroscipy.org/2017/descriptions/19828.html
@robreilink
@robreilink 7 жыл бұрын
Nice work, Windel!
@windelbouwman2512
@windelbouwman2512 7 жыл бұрын
Thanks man!
@HoreaChristian
@HoreaChristian 7 жыл бұрын
Awesome stuff!
@fersilvil
@fersilvil 7 жыл бұрын
Great Job i love it
@erpukeru
@erpukeru 7 жыл бұрын
Seb❤️