Intro to Python in Power BI

[@nickie2222]

I've been using Python for years and I'm totally new to Power BI, I don't think I can do what I wanted in Power BI, but I watched the whole of the video anyway because it's such a well done video! Also, as Python-fan, watching your enthusiasm made the video even better

[@ankit_real]

How much package do you get??

[@CarlosHernandez-dh7zn]

The video in 6:11 set "matplotlib.pyplot as lib" and launch "pit.show". That's an error. The right code is: (after install pandas and anaconda) import seaborn as sns import matplotlib.pyplot as pit sns.swarmplot(x="day", y="total_bill", data=dataset) pit.show()

[@santoshf]

It's should be lib.show()

[@helloimsnow7760]

@@santoshf thank you

[@zhiyingwang1234]

Thanks a lot!

[@rokaskrisciunas6015]

Thanks ;)

[@tomasdale5306]

I HAVE NEVER SEEN SOMEONE WITH SO MUCH ENERGY TEACHING !!!!

[@lespinoz]

Wow...!!! How simple to implement Python you just showed here! Congrats and thank you for sharing! Aside from that, I liked the way you edited your video; audio, zooms, highlighting, story flow... just amazing!

[@willcisler7069]

I love the R and Python integration in power query but, for me, the personal gateway is the deal breaker. We have an enterprise gateway but that doesn't work. I could install the personal gateway on the same machine but now I have two gateways to update and configure.. :( Is it worth stating that the gateway isn't required for the visualisations as along as you use the support packages.

[@markmathieu8648]

Will, absolutely. I was let down alot early on in my PowerBI journey when I'd go to implement python outside of visualizations and just get crushed by the lack of support in enterprise gateway.

[@ssudarshan75]

Quite funny! Just before the video started, the first thing i did was to scroll down hoping that we dont need a personal gateway and here's the comment. This is a deal breaker

[@ThoughT73]

Same here. Total deal breaker.

[@daviddossantos5629]

Looks cool but no even going to try because it's not efficient the way to get the data, we use live connection (SSAS).

[@ducminh7568]

wait can we just upload the script on OneDrive and then use it ?

[@alicedwonderland7733]

Thank you, Patrick! I'm toying with the idea of starting with Python, and I love Power BI, hence I need to mix them. You rock!

[@JR-ly6bx]

probably the best tutorial on youtube ive ever seen, awesome job

[@simon123cup]

Patrick is a legend.

[@paulj625]

Damn right boy!!!

[@LuisRomaUSA]

Python visuals are very slow once the report is published, to slow to be actually used in a report. To my understanding, this is because the script has to be sent back to an azure host that recalculates the visual each time you change it. I try avoiding python visuals in power bi for this reason

[@sharkam69]

The only way that your report is not slow is an empty report

[@thefamousdjx]

Good info

[@paulnandes2841]

Python for REGEX to validate data quality of a database and then Power Automate to email the users inpuiting bad quality data so they can fix.

[@FaaBioo972]

Great use case 👍🏾

[@CloudandZack1st]

Just a friendly heads up: If you add python to your environment variables at the end of the installation (or the beginning depending on which version of Python you install), you can invoke pip without pointing to the directory. 😃

[@CloudandZack1st]

@@jamesbyrnes8286 Yes, you can manually add the path to your environment variables either through cmd or through searching environment variables in the start menu.

[@josez2544]

That's how you really teach something, rigth in the moment you are learning it yourself. Thanks

[@mimibyrd5403]

This video was excellent and allowed me to get started with Python in my Power BI report.

[@alencaru]

I use a lot R and Python in Power BI but the problem is not being able to take an input from the user and apply it to a model and then give back an output as (chart, table, list etc.) if it would possible to send information to Python and R it would be a big big game change especially to use NLP capabilities from both of languages.

[@ak_shavar]

Hi, I’m wondering if this is still the case as at Jan 2024. I’m looking to do something similar of taking user input and apply it to a model.

[@jhewitthunt]

Perfect starter video for a total amateur like me! Thanks Patrick

[@Embargo27]

This was phenomenal, bro u just made my life a lot easier

[@AAzert42]

Nice, thanks for this video ! Hope to have more video about Python integration in Power Bi in future videos

[@sofyan471]

Interaction is a problem with python. Some other visualisation tool has much better integration. Python is great but for visual we can't do interaction from python visual to other part of report

[@Abhishekjain07]

Absolutely it's a great challenge. As a python lover I am dying to use python visuals in Power BI and just because of this interactive limitation I am not able to. SAD. Very 😥

[@DanielWeikert]

It works from a default viz to the python viz but not the other way round. But that is not the only issue. Currently there are too many limitations. By the way: what other viz tool? Have not seen any good integration so far

[@VladMZ]

@@DanielWeikert If you know Javascript, you can build your own custom Visuals. Although the process is tedious and lengthy if you want a really good working visual. Use Charticulator to build your own visuals with little to no coding.

[@VladMZ]

@@Abhishekjain07 I tried R too, and it has the very same issues. Sadly.

[@LuisRomaUSA]

You could if power bi supported the right libraries, but power bi only lets you use libraries that do not provide interaction

[@jayong2370]

Great video. Just starting to explore using Python with Power BI. Interesting to see how the performance of the python queries stack up against DAX.

[@followrajah7743]

Patrick thank you for this. Just yesterday I wanted to use Python in Power BI but had no idea where to start.

[@Darksirius155]

Please more Video like this, always amazing videos.

[@mbulelolomo8898]

Thank you for this Patrick, I am actually starting with learning python. Great video you have right there!

[@stouttravis]

I know an intermediate level of python, but have never looked into what's supported in Power BI. Seeing Patrick get something built so easily without evening knowing python was exciting as it shows the integration must be pretty well designed. I'm excited to go through and learn the limitations for myself.

[@ducminh7568]

nah too bad it not that good with powerbi

[@thefamousdjx]

@@ducminh7568 why isnt it good? I found that with complex nested json, powerbi creates all these nested record and list objects and I have to go in and flatten them myself, unless I'm missing something as I just started using it. But with the python script the output comes out already flattened out

[@ducminh7568]

@@thefamousdjx so it not that great because you cannot load Python code online via SharePoint but it has to be from your computer so that you cannot automate tasks with PowerBi services but desktop only.

[@yukithejapanese]

I've already use Python integration for some of my freelance work and it's great!

[@WAIT4GOD]

Awesome, thanks for taking the time to do this!

[@Anthony_Lecoq]

Awesome Patrick ;) I was thinking to test python in PBI since a while. This video made me started... I though it would be a bit complicated, but I am astonished by the simplicity to implement it. Time invested versus the quality and powerfulness of charts. It is definitely worth it. And using data=dataset ... BAM we get the interactivity between charts... For the moment I do not use any service so no issue with the Gateway... I feel I will find out some great usage of python in PBI ;) Patrick you are amazing ! Merci

[@n0rice4u39]

Hey Patrick, not sure if this is mentioned but in the command line you dont have to put the full directory of python, just "python -m pip install.." is good enough

[@rohandhande9391]

This guy's are amazing why Microsoft not seen this channel .

[@Noel72317]

Hello patrick, I from Nicaragua and don't speak english but this video have subtitle in spanish, so great .. thank you for that could you continue placing the subtitles?

[@leybourne]

Amazing presentation as usual. Thank you, Patrick! Python and R integration is good. However, there are too many limitations for using Python and R scripts in Power BI which Patrick did not mention (vide documentation). When we want to get data from a data source that is directly not supported in Power BI (quite rare nowadays!), an R/Python script may help. I remember Adam had a video on creating data connectors with C# as well (long time ago). We can do certain transformations that are beyond the capacity of M using R/Python scripting. What we need is a scripting language for Power BI that is comparable to VBA in Excel, a language that is truly incorporated, not superficially attached. R and Python script support in Power BI is still just sensational than truly useful. Let’s see how it develops in the due course. Definitely Interesting, but I doubt if it would be equally useful. Of course, it’s only my opinion as a user of Power BI. There are experts on the subject who think otherwise.

[@matthiask4602]

don´t wish more scripting languages, python has to do the job. It should become the new VBA. (please!! I do not want to learn another language!!!)

[@leybourne]

@@matthiask4602 Neither do I! LOL! C# and R are good enough for MSBI! What I meant was that the scripting language - be it Python, R or whatever -should be well incorporated into and supported by Power BI. Right now, there are ridiculous limitations.

[@MattWhiteMattWPBS]

You're going to be the person blamed when Microsoft shoehorns VBA into PowerBI...!

[@navjotsingh2251]

@@leybourne I think python would be better, it would be difficult to use R as we use vba imo. Python fits nicely as a scripting language that will feel like vba for power bi.

[@JHatLpool]

Can you not perform your transformations using DAX (which is similar to VBA) ?

[@atarunraj]

Yup. Have used Python to extract data from Oracle ERP Cloud to use with Power BI. Never did the visualization though, so that was good to see. 👍

[@NayankaGothane]

When we work on R and Python visual, it kinda takes lot of load on pbix file. How to optimize the same?

[@swagatkumarsrivastava2322]

Really looking forward to receive some more important lessons on Python in Power BI.

[@klaymoon1]

Great video! Can I ask you what is Personal Gateway? Is it something download and install or subscribe to? Thanks.

[@davida6146]

It's weird because I followed your exact steps but I kept getting an error for my columns not being defined... I then got am error for the "pit.show()" not being defined. I tweaked it a bit and this code ended up working for me: # The following code to create a dataframe and remove duplicated rows is always executed and acts as a preamble for your script: #dataset = pandas.DataFrame(day, total_bill) #dataset = dataset.drop_duplicates() # Paste or type your script code here: import seaborn as sns import matplotlib.pyplot as lib sns.swarmplot(data=dataset, x="day", y="total_bill") lib.show()

[@SebasAvello]

I need help, when I try to show it with pit.show() appears this: ;NameError: name 'pit' is not defined

[@happyhotify]

lib.show()

[@xinchunhe3960]

What do you mean personal gateway? if i share my dashboard with other who doesn't have python install, will they see a error on their side?

[@jankruit6089]

Liked your video! I am A Python and Power BI Teacher: Very good as a start!

[@reggieoverton121]

As a python user myself I cringed at your code but was excited to see python work. Great work

[@ArmandoReportes]

Another reason to learn python. Thanks.

[@endless_puns]

The integration between Power BI and R/Python is amazing for loading and processing data. I've created an automatic data workflow that creates tidy data files stored in the pickle format which I then import and use for visualizing the data. Some reports require further modifications to the already processed data and for those I've set things up so that Power BI calls the execution of a Python script stored in a custom folder that then does the additional data processing. Pretty neat! The exact same thing works with R, too.

[@patrickkeating5329]

Would love to see a video of this.

[@rishabhagarwal4702]

Hi, how do you make power BI call a python script stored in a folder? Don't you have to paste the Python code in the power bi itself?

[@chinenyenwaneri6163]

Would love to see a video of this too

[@endless_puns]

@@rishabhagarwal4702 It's actually fairly straight-forward. Go to the Power Query editor and create a new query by using "Python script" as the source. Then, type in the following command: exec(open("C:/Users/User/Desktop/Script.py", encoding = "utf-8").read()) Then replace the folder and script names with your own and make sure to specify the encoding of your *.PY file. When you press enter, Power BI will start executing the script and then a pop-up window will appear where you will be able to choose one or several pandas data frames and load them into your model.

[@francisopiyo2332]

Nice one. Can the refresh happen on standard gateway or it has to be a personal gateway

[@josephdaquila2479]

Do you think this would be effective at defining custom logic for bringing in data? Like having to loop through the dataframe to determine its structure? and returning that dataset? stuff that you cant do just through applying transformations & such...

[@saketsrivastava84]

Brilliantly explained

[@tarun007]

Thanks Patrick. This was a good start.

[@andresmachad]

heyy guy, how can i put it on powerbi services? because it don't work there

[@xxczerxx]

This is really neat. I was wondering if you could use Python in Power Query at the "source" level to handle folders that have constantly updating information (eg files that have current date in their name)? Does this eat into memory usage or is it still "technically" operating within Python (ie outside M)? I had this problem previously -- a folder on SharePoint that had files being continuously added. I couldn't figure out a way for the Query to update dynamically. So I couldn't figure out a simple logic in M to simply say ("import everything in this folder with string containing 'xxx' "). However, after watching this vid it seems you could simply write a simple Python script to handle that batch import with necessary logic.

[@jedidiaholadele2086]

Loved this!! Watching him alias matplotlib as lib was quite funny though 😂

[@SK-ck3qb]

How can I use this with Analysis Services in an emedded app? Thanks!

[@matthiask4602]

Good "Intro". Makes one eager to learn more about python in Power BI . But more content on top of this is to be expected now. :-)

[@jasons6721]

Appreciate you posting this info! Very informative and something I was looking for. However, I've been trying to figure out the compelling use case to use python. So far, I can do everything that I've need with OOB connectors, dax and mquery. But, I've seen that doing some development using Python (specifically in Jupyter Notebook) is much quicker because you only deal with a small subset of data instead of loading the entire data set. In some cases, where data load time becomes an issue, i just set parameters to only load recent files or a # of records... Then, let data refresh do the heavy lifting after publishing.

[@SpiritOfIndiaaa]

thanks a lot , where from the data set of "tips" came from ?

[@jsorrisone]

bro man bro.....you are legit the most solid doo in the cuooo

[@luishernando]

Thanks a lot Patrick! Smooth and very useful orientation! Python and PB! awesome! The best of all the world

[@JHatLpool]

A really useful guide.

[@szklydm]

Just out of curiosity, how long did it take you to figure all this stuff out? 🙂 Great to see the "masters" struggle a bit, which is an inevitable part of the learning curve. Thanks for this Patrick!

[@VladMZ]

And I was just about to try Python for more advanced analytics in building a dataset. "Only Personal Gateway" is a big showstopper. Makes no sense. Also however cool Python or R visuals, they are just pictures - no tooltip, no interactivity :(

[@xtiandyc7034]

Hi Patrick! I'm planning to learn power bi right now. can you give me the link from your videos where I can start with? You got tons of videos and I don't know what video to start with. Thanks!

[@aswinshukla5762]

Any idea if we can use python in PBI Q&A feature ? I want to enhance the Q&A feature by adding some NLP api's.

[@richasugandhi2954]

Hello, I got an error when loading the 'tips' dataset. So, In which folder should the tips file be

[@goldensleeves]

Great video. What is a personal gateway??? Also, I am surprised it’s such a short list of supported python packages… I wish plotly was supported for example!

[@36DENSE36]

Are there any plans to also make Python available for the standard mode of the power bi gateway (so not the personal mode)?

[@CyrilGagnaire]

Hoooo, I need to try that! Thanks Patrick

[@jimmytao2505]

Amazing, how could you make the blue square move along with your mouse in your video?

[@DavidSanchez-vr1ny]

This was pretty cool!

[@AmitRoy-om3tp]

This is great! I will try this out.

[@abimaeldominguez4126]

Hello, thanks for the video. I have a question, I was wondering if this Python scripting would work when I upload my dashboard to the cloud and update it using a gateway to refresh the data sources periodically?

[@livingwithcatz]

It seems like several details were left out on the installation (adding to PATH, including PIP... matplotlib, pandas) I had to reference another video because my installation didn't work just by watching this. I'm just a beginner, so maybe it wasn't intended for people with no prior knowledge.

[@IsraelGonzález-y5x]

Nice video: by any chance you know how to upload my dashboard with python visuals into a website? When I upload the dashboard, everything can be seen except these python visuals.

[@davey1644]

Slick - Thanks Patrick !!

[@AlejandraRamirez-vj3vf]

how to read an excel file stored in a sharepoint with python in power bi? Without explicitly giving password and user or from an organizational account?

[@kabukidanshi7874]

Nice video! I have a question. If I send a dashboard with a python script to someone that doesn't have python installed, will it run? Thanks!

[@user-sj9xq6hb9p]

We need a full series

[@ucthangnong5631]

in python script to visualize, "Duplicate rows will be removed from the data". How can I disable it? :

[@tadsaitsaac7547]

we can do manipulations on the table we impprt to data query with python?

[@ahv5457]

When I publish it online, I cannot set up the schedule refresh. Any solution?

[@santoshadhikari9933]

How can we loop through Report object eg: slicer to export the report as PDF file using python script?

[@VashLoot]

Will Python script work if the PowerBI is located in Sharepoint. I mean, do other users, that can see my interface not see the visuals because they don't have python downloaded?

[@marcoantoniobajanabarahona3300]

You could make a video of how to use powerquery and phyton for some data transformation

[@darkmatter5310]

How can I switch parameters for the Python API call script from Power BI user interface.

[@CaribouDataScience]

Thanks

[@soumaisti4085]

Hi man, I got the examples but I'm a little confused because the Python language in Power Bi is just to plot some libraries or graphs? What are the real advantages related to Power BI? For example, I can download more visuals instead of implement using the R language? Tks

[@rauljimenez5485]

Is it possible to refresh a Python source in the Service?

[@vennelaneethipudi4573]

I have a requirement where I have to get values from 17 different worksheets of a excel file, so I wrote a python script that goes to each sheet and gets this single value and creates a dataframe. Now I am using this script in Power BI to get the dataframe into my model. But when I am trying to schedule a refresh it says the datasource is not supported. Is there any workaround or solution to this? Please help me out.

[@shubhrabhowmik]

how can I fetch data from sharepoint or web api and connect it here in power bi using python?

[@benhalicki9749]

Use of personal gateway... does this mean all users have to have the personal gateway installed to be able to access a published report using python?

[@elrevesyelderecho]

Thanks. Good intro to the subject!

[@ins-ight]

Hi Patrick, can we perform Text Analytics using Python visual in Power BI? If our data is based out of SSAS so we won't be able to use Text Analytics as we won't have Query Editor in Power BI then due to Analysis Server based data source.

[@aymanalafifi]

Can you include a parameter inside your python script? I'm thinking if you have some code to read a file and clean your data for powerbi, it would be nice to define the file path as a parameter so the user can recycle and reuse your dashboard and code for other files

[@MeghaviThakar]

Hey, great video but what if I want to take input from the user and use that in the Python code and give an output how can one do that?

[@PRIYANKAPATEL-x1s]

Apart from personal gateway to refresh the report, any other way or workaround to do it. Personal gateway is a very big limitation

[@pjevans793]

Great stuff man... Would love to see some videos over the GenerateEmbedTokenV2 changes and what new functionality comes with the newer embed token model. Really the main updates with the move to V2.

[@paulinedahne]

I am trying to uncompressed a column in a dataset using pandas and lzstring. I have used this syntax but the Python script errors with TypeError: 'function' object is not subscriptable # 'dataset' holds the input data for this script import pandas as pd import lzstring as lz df = pd.DataFrame(dataset) df['DecompreseedAssets'] = lz._decompress['MigratedAssets'] MigratedAssets column has data that is compressed using lzstring Could you help please?

[@debrasimpson4986]

Would it be an accurate statement to say using Python in PBI is faster than using Power Query M? I'm trying to find this online but haven't really seen anything confirming this and figure I'll ask on my favorite channel. ;)

[@ShabnamKhan-vk7fj]

You rock! thanks for the quick demo. I love it

[@klamentyne5991]

More of the python in power bi please!

[@samiraslan9735]

Patrick can teach you the whole thing about black holes in 5 minutes at your first grade 😁 love that Powerbi support R and Paython but personal gateway is a big no.

[@sabasoleimangoli1950]

I have an error: python visuals are currently disable in your organization!!!! so, is python scripts only visible on the Microsoft cloud? and don't visible on the report server?

[@sinatabar]

Awesome, cool video. Explaining all the details 👍

[@aryansena7290]

Need more videos in python with power Bi