How to Parse a CSV in Microsoft Power Automate Super Fast, Free and Easy.

  Рет қаралды 54,744

Paul Murana

Paul Murana

Күн бұрын

Пікірлер: 192
@PaulieM
@PaulieM 4 ай бұрын
The easiest and fastest way to process CSV in Power Automate: www.tachytelic.net/2024/02/power-platform-csv-parsing/
@steco5441
@steco5441 9 ай бұрын
Thank you very much sir, these kind of videos is what I love, no 10 minute intros no blabbering, straight up doing!!! Thank you so much!
@PaulieM
@PaulieM 9 ай бұрын
I also don’t enjoy long intros so try to keep things as short as possible! Don’t forget to check out my latest CSV video for even easier processing of CSV files: kzbin.info/www/bejne/h5PUqISrq8iApKMsi=doQ2kvdVZa36UvU8 Appreciate your kind words and glad you liked the video.
@asifuzzamananik5033
@asifuzzamananik5033 Жыл бұрын
Hi Paulie, Thanks from the bottom of my heart! It was really helpful.
@PaulieM
@PaulieM Жыл бұрын
Hey, I totally appreciate that. Thank you!
@BrettWyrick
@BrettWyrick 3 жыл бұрын
Wow. Earned a subscription from me. Can't believe how quick this was. Who needs premium connectors when I've got Paulie M to teach me? 😆 Thank you!
@cPathz
@cPathz 10 ай бұрын
For the record...In my case I take the file from an email attachment. For the splitLines compose I use: split(base64ToString(outputs('getAttachment')?[0]['contentBytes']), decodeUriComponent('%0D%0A')) Thank you for sharing your knowledge with us 😀
@PaulieM
@PaulieM 9 ай бұрын
Thank you for sharing and glad the video was helpful to you.
@HarshaVardhan-li5dg
@HarshaVardhan-li5dg Жыл бұрын
You are a saviour. I was struggling to get a column value and storing it in the array. It’s just what I need. Very informative and to the point. Thanks🎉
@PaulieM
@PaulieM Жыл бұрын
Glad it was helpful to you. Well done! 👍🏻
@mattpeterson1185
@mattpeterson1185 2 жыл бұрын
This is one of the cleanest and fastest solutions for parsing the contents of a CSV file into JSON I've managed to find. Thank you very much for creating this video! Hopefully future updates don't break this :)
@sammighafari6196
@sammighafari6196 Жыл бұрын
It was amazing, could you pls advise how to get the file as an email attachment or a file saved on SharePoint?
@rogerioalves8863
@rogerioalves8863 2 жыл бұрын
I was doing this but instead of using the select action I was manually doing what the select does with iterators and many variables and it took soo much time both to develop the flow aswell as time needed to run. Thanks
@cipriandia8409
@cipriandia8409 Жыл бұрын
Thank you Paulie, just commented on your previous video when I realised you made an even better version. You sir are a legend!
@PaulieM
@PaulieM Жыл бұрын
Thank you!
@joeshy
@joeshy 6 ай бұрын
Thanks for this! Easily processes all sorts of pesky exports for legacy processes super efficiently. So clean.
@CmdrKeene
@CmdrKeene 2 жыл бұрын
I'm missing something, what's going on at the 0:51 mark where you add the compose step "newLine" but it has no inputs? I don't understand how you were able to test the flow at the 2:07 mark without this.
@heldersilva7419
@heldersilva7419 2 жыл бұрын
In the "newLine" compose he just pressed Enter to add a new empty line, notice how the entry box for the "newLine" compose gains height.
@TranfugaCorp
@TranfugaCorp 2 жыл бұрын
you are a genius and very good person to share your knowledge! Greetings from Chile
@fuzzy889
@fuzzy889 Жыл бұрын
Smart. I had a very similar setup for parsing CSV's but using an apply to each loop to add each row into an array. Works well for small files, but Power Automate's loop actions are just way too slow to handle thousands of rows of data. Thank you!
@braveheartingux
@braveheartingux Жыл бұрын
Hi, Your way is amazing, can you please share the way where every CSV value is "" "" seperated please. As many CSVs using quoted fields to escape from character issues in the field value like comma
@PaulieM
@PaulieM 2 ай бұрын
It's really hard using the technique in this video, but you can follow this guide: kzbin.info/www/bejne/h5PUqISrq8iApKMsi=3pvRaq7te2OCeAg7 This uses a custom c# connector to process the CSV and quoted fields are no problem for it.
@gavinpedersen2096
@gavinpedersen2096 2 жыл бұрын
This is very helpful, thank you. Any idea why each value (including the column header) of the last column from my CSV has a ' ' appeneded to it? It's not this way in the csv.
@PaulieM
@PaulieM 2 жыл бұрын
Yes, it is because your line endings are windows style CRLF instead of LF. So when you do the split, you should split using decodeUriComponent('%0D%0A') - all the information you need about this is on this blog post: www.tachytelic.net/2021/02/power-automate-parse-csv/
@TrevinGrams
@TrevinGrams 3 ай бұрын
This is a very handy guide, perfect for my purposes. Thank you for putting it together!
@PaulieM
@PaulieM 3 ай бұрын
My pleasure, glad it helped.
@jett27
@jett27 Жыл бұрын
I have a csv file that contains a sentence with a comma inside of them surrounded by "". Using this method also splits those sentences causing an error. Any idea on how to deal with this?
@21kaveri
@21kaveri 4 ай бұрын
Did you find a solution ? I am struggling with the same issue
@jett27
@jett27 4 ай бұрын
@@21kaveri I ended up using Power Query for my use case. I realized I didn't need to use Power Automate for what I needed: kzbin.info/www/bejne/ZpLIi4tnoZl9ipYsi=qUxGfTUygSgFXXpq
@priyal_001
@priyal_001 Жыл бұрын
How can I insert rows into SQL server from the content in CSV. Can you tell me about this please
@user-zd3ge6sm7w
@user-zd3ge6sm7w 2 жыл бұрын
Paulie, great video. Everything works for me except my splitByLines function is returning at the end of every line. I've verified every character in the code and can't see why it's returning . It's separating each row and all fields correctly though.
@PaulieM
@PaulieM 2 жыл бұрын
Hi - take a look at the blog post here: www.tachytelic.net/2021/02/power-automate-parse-csv/ What you need to do instead of splitting by new line is split by CRLF, so it would be something like split(outputs('Get_file_content_using_path')?['body'], decodeUriComponent('%0D%0A'))
@user-zd3ge6sm7w
@user-zd3ge6sm7w 2 жыл бұрын
@@PaulieM I am impressed by your quick and absolutely perfect response. That resolved it. You have my utmost respect. - Don
@facun_OK
@facun_OK 3 жыл бұрын
This is fantastic and by far really simple. Thanks a lot for sharing your knowledge
@PaulieM
@PaulieM 3 жыл бұрын
So glad it was helpful - thank you 🙏
@skim32
@skim32 9 ай бұрын
So I figure out the partial cause of my issue. In my CSV, i expect to have some null values. So the Parse JSON kept failing stating "invalid type. expected string but got null." So I did some research and another site suggested I add null to the type in the JSON Schema. So it looks kind of of like this "type": ["string","null"]. When I add this to my JSON schema the flow saves fine and the flow runs correctly. But this is where all of my fields go away in the dynamic content. Any suggestions? *SOLUTION* I figure it out. Gotta use anyof in the schema.
@PaulieM
@PaulieM 9 ай бұрын
Thanks - you inspired my latest video.
@benjaminmilkutat3184
@benjaminmilkutat3184 Жыл бұрын
Great Video that helped me so much. Thanks for that simple work through showing how you get this done uncomplicated.
@geoffkeenan
@geoffkeenan Жыл бұрын
Great video, clear to follow and worked first time for me!
@EvinScully
@EvinScully 3 жыл бұрын
For some reason, when I use the share point "get file content" instead of the one drive "get file content' I get weird errors about invalid templates and parameter types on the split function. Either way, if you're getting an error, try the one drive "get file" function
@Sloal
@Sloal 2 жыл бұрын
The SharePoint Get File Content returns the data in Base64 encoding. So you need to use this to convert it to a string. split(base64ToString(outputs('Get_file_content_by_path')?['body']?['$content']), decodeUriComponent('%0D%0A'))
@ChadBowen-dj4sy
@ChadBowen-dj4sy Жыл бұрын
@@Sloal is this the same solution for email attachments that are .csv?
@philipbenutte2122
@philipbenutte2122 5 ай бұрын
Very important, I would like to throw out a doubt, how can I treat the null values, my file does not contain some null values and it has not been treated before, or this test is missing
@saratchandra7388
@saratchandra7388 3 жыл бұрын
Can you make video moving excel csv data to existing xlsx file using power automate .not having premium licence.using sharepoint in both cases.
@brianteague1906
@brianteague1906 2 жыл бұрын
My column headers looks like this in the fieldName Compose Outputs. My data looks like this too. I can't find a way to fix it. Any idea what's wrong? "\"FirstName\"", "\"LastName\"", "\"Company\"", "\"JobTitle\"", "\"Email\"", "\"UniqueId\" " I see that his CSV file doesn not have any quotation marks. Mine does. I saved the file as CSV UTF-8. I then removed the newLine step and used this in my splitLines. split(body('Get_file_content'), decodeUriComponent('%0D%0A'))
@KJ-th7wh
@KJ-th7wh 2 жыл бұрын
This solves the line Ending with "r" issue, please follow his advice worked for me. Thanks @Brian Teague
@heymanpluto2591
@heymanpluto2591 6 ай бұрын
Is there a way to not use the column header in the csv file and assign a new column header
@AshishBhat-v4t
@AshishBhat-v4t 7 ай бұрын
Is is possible for you to launch a course, or let us know if you have any. This JSON and CSV parsing is such an amazing thing.
@bipulsinghkashyap8160
@bipulsinghkashyap8160 12 күн бұрын
Thanks for this! It solved my problem so quick.
@PaulieM
@PaulieM 12 күн бұрын
Glad it helped!
@bluric0
@bluric0 2 жыл бұрын
Hi Paulie, what’s the input for newLine? Your video adds its in but no input and I cannot Test the flow without one
@PaulieM
@PaulieM 2 жыл бұрын
Hi Adrien, check out the start of the video at 50 seconds. kzbin.info/www/bejne/qYnHlpqVa7GladE It's just a compose with a containing a new line (literally just pressing the enter key in a compose action)
@bluric0
@bluric0 2 жыл бұрын
@@PaulieM Oh right. Yeah I didn’t see the Enter command being performed. That’s what I missed! Thank you!
@nunnny09
@nunnny09 Жыл бұрын
Hi Paul, any way to make parse json dynamic as in our case we have multiple csv files to parse and all have different columns . Please advise
@peterallison8384
@peterallison8384 2 жыл бұрын
Really easy to put together. Thanks for the step-by-step instructions. I'm still trying to figure out how to work around commas within a string. Any ideas?
@gutieman666
@gutieman666 2 жыл бұрын
I've ran into the same issue. This works well if your data is nice and clean but in my use case the fields themselves have commas so it's splitting where it shouldn't and throwing things out of alignment. Haven't found a work around.
@shanejones8095
@shanejones8095 2 жыл бұрын
Encountered the same issue... Now looking for a workaround to transform CSV to XLSX. Sad face.
@chrismcd1405
@chrismcd1405 2 жыл бұрын
I have data with semicolon as delimiter. Will this still work with some modification? The data also has quotes around each field contents. Does that help if delimiter is inside of field data?
@anw1986
@anw1986 3 жыл бұрын
Thank you...this was exactly what I was looking for
@PaulieM
@PaulieM 3 жыл бұрын
Great to hear, glad it helped.
@DeepDeep-zd5jq
@DeepDeep-zd5jq 10 ай бұрын
Hello, very informative video if we want to read a file in parquet format from azure how we can achieve this? thanks
@lindaklimczyk8042
@lindaklimczyk8042 3 жыл бұрын
This is exactly what I need. I'm new at power platform so bear with my question ... The first split where you split the first line off ends with: "...content')?['body'], )" This generates an invalid expression error for me, I believe that it is expecting something after the last comma. I've tried it with ' , ' without error but I realize that it needs to detect end of line and not a field separator. I'm at a loss. Will you advise?
@PaulieM
@PaulieM 3 жыл бұрын
Yes. Try. split(outputs('Get_file_content')?['body'], outputs('newLine')) Hope that helps!
@RediShade-AU
@RediShade-AU 4 ай бұрын
Hi Paul. Great video, which have helped me a lot! I have a further question, if you can help? I am taking csv data from an incoming email and using it to add a row to a Dataverse Table. How do I setup the start of the flow? I tried to create a Flow using trigger = "When a new email arrives (v3)" and added the Step "Get email attachment (v2)", but the data does not seem to parse correctly to handle using your method for the rest of the downstream data handling from "newLine" onwards? Am I missing a step? Thanks.
@PaulieM
@PaulieM 4 ай бұрын
Hard to say without seeing the email or attachment. If you get in touch via my blog I will have a look at it for you.
@RediShade-AU
@RediShade-AU 4 ай бұрын
@@PaulieM Hi Paul. Thanks for your reply. We persisted a little longer yesterday and managed to get it sorted. Could not have done it without help from your very helpful videos! Thanks heaps for this content.
@PaulieM
@PaulieM 4 ай бұрын
@@RediShade-AU you should have tried my new CSV connector! Makes the whole thing so much easier 😀
@vipinsinghal9448
@vipinsinghal9448 Жыл бұрын
Hi Paul, Its interesting flow, exactly what i want, but i have a query If we have 40 columns than in Select action we need to put all 40 columns one by one ?
@captainwahhh3952
@captainwahhh3952 2 жыл бұрын
This is very clever and worked perfectly for me. Thank you so much!
@luisinaflores8914
@luisinaflores8914 Жыл бұрын
I was going well, but when i tried to do the "Select" i had an error: Unable to process template language expressions in action 'Select' inputs at line '0' and column '0': 'The template language function 'split' expects its first parameter to be of type string. The provided value is of type 'Array'.
@PaulieM
@PaulieM Жыл бұрын
Hi - hard to say where it’s gone wrong for you. If you connect on LinkedIn or via my blog I will help you out.
@luisinaflores8914
@luisinaflores8914 Жыл бұрын
@@PaulieM and how is your linked in ?
@PaulieM
@PaulieM Жыл бұрын
@@luisinaflores8914 www.linkedin.com/in/pmurana/
@saisreevasireddy8362
@saisreevasireddy8362 2 жыл бұрын
Hi @Paulie M . this is fantastic. In my flow i cannot see the fields in dynamic content after parsing. Can you please help me with this issue.
@azzahradindaparamitha4460
@azzahradindaparamitha4460 Жыл бұрын
In 'select' step i got this error: Unable to process template language expressions in action 'Select' inputs at line '0' and column '0': 'The template language function 'outputs' must have only one parameter.'. Any solutions?
@mauricio.dantas
@mauricio.dantas 2 жыл бұрын
Hi Paulie, in Select step is it possible to split value as number? I tried but without success. I need this because after parse json will add lines in sharepoint list
@ericholdforth4981
@ericholdforth4981 2 жыл бұрын
did you have any luck with this? I'm in the same situation.
@mbaker82
@mbaker82 2 жыл бұрын
great video! thank you. keep up the good work. Question: if you rerun the flow after you parse the json, it gives red check mark. Ideas?
@mbaker82
@mbaker82 2 жыл бұрын
I figured it out. there was an extra line at the bottom of my CVS file. However, for some reason there is a being added to my last cvs column. I look at the raw input from get file and its not there, then i look at splitByLines and i see the input has the added to the last column. which makes me think its the compose newLine adding this . Ideas?
@TinyHomeBuilders
@TinyHomeBuilders Жыл бұрын
Amazing tutorial. Thanks for sharing!
@JanDeprez
@JanDeprez Ай бұрын
I am getting the error after running this a couple of time: "Your flow is running too many actions". Is there any to design this to limit the number of actions?
@PaulieM
@PaulieM Ай бұрын
Maybe you have the flow setup wrong, it shouldn’t use too many actions. If you’re parsing a CSV try using my C# connector, it will do the whole file in one action.
@rameshbabuc5981
@rameshbabuc5981 3 жыл бұрын
Thanks for this Detailed example. Using Power Automate I am doing following operations as per requirement. Trigger condition : When email trigger with csv attachment - In .CSV file there is no empty row in between content - Using select operations mapping key and value pairs. But after execution of select operation , in output I am seeing empty value. Is there any value to restrict empty row value check in select operation "From" option dynamically? Also Parse JSON is failing due to empty , so I added "null" value in Parse JSON scheme. After adding this value , I could not see return values(Name,Date,Email) from csv Kindly help.
@007__NIL-m5q
@007__NIL-m5q 2 жыл бұрын
Brilliant - now just need to master those quote encapsulated commas.. power automate should do this natively....
@joannezhu101
@joannezhu101 2 жыл бұрын
Hello Paulie, when i duplicate the step newLine, it asks for input, should I put FileContent from previous step Create File?
@joannezhu101
@joannezhu101 2 жыл бұрын
I actually figured out this part. Now my testing shows empty record only comma in it, when I open the initial csv file in notepad, it has been split into rows, do I still need to split lines?
@mukeshsainilkj1663
@mukeshsainilkj1663 Жыл бұрын
Fantastic method sir.
@nikolaosmariolis5118
@nikolaosmariolis5118 2 жыл бұрын
Hi Paulie, Any idea why instead of having the fields available from Parse Json I have only 2 objects? body and element?
@simonewoolston6592
@simonewoolston6592 Жыл бұрын
Hi, did you manage to solve this, I have the same problem?
@kavyamuniswamappa
@kavyamuniswamappa 2 жыл бұрын
Hi..I have a question here... can we save the powerapp New form as a file in SharePoint? Like we save InfoPath form as file..
@jonmatthews5642
@jonmatthews5642 2 жыл бұрын
Thanks for the video! this has helped me alot! However i'm run into an issue as the CSV file I'm working with. It's formatted with the Line1 (column1, data1), Line2 (Column2, Data2) etc and not like a standard csv Line1 (column1, column2, column3), Line2 (data1,data2,data3) etc therefore my JSON comes out formatted like this. Is there a method to fix this? [ { "Column1": "Data1" }, { "Column2": "Data2" }, { "Column3": "Data3" }, { ] Thanks again!
@yoseopjeon4523
@yoseopjeon4523 Жыл бұрын
Hi, it's what I'm seeking. If there is blank row in the csv file, Parse JSON didn't work. Could you help me?
@PaulieM
@PaulieM Жыл бұрын
Yes, just split the file into lines, then use a filter array action to remove the empty lines. Then join the array back together again.
@venomtverskoi
@venomtverskoi 2 жыл бұрын
Can we get a number of rows being parsed?
@estebanfrutos3734
@estebanfrutos3734 9 ай бұрын
Thanks Paulie, I have a problem in a flow similar to yours, the problem is that the data per row is separated by tabs instead of commas, and I don't know how to separate the data.
@PaulieM
@PaulieM 9 ай бұрын
Instead of splitting by a comma, split using this expression: decodeUriComponent('%09') This represents the tab character.
@estebanfrutos3734
@estebanfrutos3734 9 ай бұрын
@@PaulieM Thanks, it works
@PaulieM
@PaulieM 9 ай бұрын
@@estebanfrutos3734 no problems, well done!
@benholman8444
@benholman8444 10 ай бұрын
What if my data inside my CSV has commas in it? I've run into that issue and I can't figure out how to get around it. I have data that the header is "Meet Days" and the data is somethign like "M,T,W,Th,F"
@benholman8444
@benholman8444 10 ай бұрын
OK, I worked something out, but I'm wondering if there's a simpler solution. I created a replace() step for every day of the week to change the "," into a "-" and it's working. But I feel like that's more ofa hack than a solid solution. Any thoughts?
@21kaveri
@21kaveri 4 ай бұрын
@@benholman8444 Hi, were you able to resolve this? I, too, am stuck in the situation where my data contains , in between the text - hence the formatting is getting messed up. Could you please share your solution?
@tusharmehtadxb
@tusharmehtadxb 3 жыл бұрын
Awesome, like in the video title mentioned, I had done testing and found it is fast, free, and easy. I guess if you can add some more steps and parse data to the SharePoint list It will be a great help to many people like me.
@tusharmehtadxb
@tusharmehtadxb 3 жыл бұрын
Paulie, I had found the details in your other video let me know have a look into it. kzbin.info/www/bejne/pIHPn3Z6ltqXa68
@louisrazo7070
@louisrazo7070 3 жыл бұрын
Excellent work!
@rtc6157
@rtc6157 3 жыл бұрын
thanks, this was very helpful!
@M9xer
@M9xer Жыл бұрын
For some reason my JSON output contains a bunch of back slashes and quotes. Any thoughts?
@masternack626
@masternack626 10 ай бұрын
I had the same problem and noticed I was trying to work with an xlsx file instead of a csv. Might want to check that.
@DTejashReddy789
@DTejashReddy789 7 ай бұрын
Hi, I have data is csv file, but some of the columns contains new line in the same row as part of the sentence. If I follow this method, it is splitting in between the sentences into a new line and it is taking that as a new row. can you help me in here
@PaulieM
@PaulieM 7 ай бұрын
Well, it’s a tricky situation to be sure. You’d have to show me a sample of your CSV file to see if I could come up with an idea.
@DTejashReddy789
@DTejashReddy789 7 ай бұрын
@@PaulieM how can I connect with you
@PaulieM
@PaulieM 7 ай бұрын
@@DTejashReddy789 use the contact form on my blog www.tachytelic.net
@DTejashReddy789
@DTejashReddy789 7 ай бұрын
@@PaulieM thanks paulie, I will ping you soon
@JohnDoe-su3lf
@JohnDoe-su3lf 2 жыл бұрын
Hi Paulie. Thanks for your great tutorial. However when I tried to parse a csv file using your method I got an error stating that the "'The template language function 'split' expects its first parameter to be of type string. The provided value is of type 'Object'. " It turns out that I had to use the expression base64tostring() before I could parse the file content. Any idea why that is?
@PaulieM
@PaulieM 2 жыл бұрын
Hi John, this is probably due to the file extension (or lack of) of the file that you were working with. If the file has a .txt extension then Power Automate will assume the file type and extract the content for you.
@joezuchora
@joezuchora 2 жыл бұрын
Nice video but I think we skipped the step where we convert from base64, no?
@anthonyaltman4021
@anthonyaltman4021 2 жыл бұрын
Paul, good video, however in my csv i have a number of arrays inside arrays. so my csv has extra commas that are creating issues with this method? any ideas?
@PaulieM
@PaulieM 2 жыл бұрын
If you show me an example of what your data looks like so I can better understand your problem I will take a look for you.
@lalitkadam3808
@lalitkadam3808 2 жыл бұрын
Really nice video. Excellent work! Can we load more than 100k records using the same steps? or we will require pagination
@PaulieM
@PaulieM 2 жыл бұрын
It would depend how many columns there are as there is a 100 megabyte limit within the actions. But if the CSV is under 100mb in since you should be ok.
@lalitkadam3808
@lalitkadam3808 2 жыл бұрын
@@PaulieM thank you Paulie 👍
@fernandopineda7036
@fernandopineda7036 2 жыл бұрын
Paul, are you available for a project?
@PaulieM
@PaulieM 2 жыл бұрын
Yes, please get in touch via my blog.
@Helena-fp5rt
@Helena-fp5rt 6 ай бұрын
In NewLine "'Inputs' is required." But I didn't see anything there. Can you help me?
@parvildrobu
@parvildrobu Ай бұрын
I think just pressed "Enter", which is the input basically
@tritonb1
@tritonb1 2 жыл бұрын
How do you handle a CSV that has comma's within a set of double quotes in a column?
@PaulieM
@PaulieM 2 жыл бұрын
Not easily. I did another video on the Official Power Automate KZbin channel. Have you seen that video?
@tritonb1
@tritonb1 2 жыл бұрын
@@PaulieM I did not but if I can get a link and it helps to resolve my problem I'd be super grateful!
@PaulieM
@PaulieM 2 жыл бұрын
kzbin.info/www/bejne/bnrZeauIo9x9bbM
@Rajuthunder
@Rajuthunder 2 жыл бұрын
Excellent I have learned a lot
@facun_OK
@facun_OK 3 жыл бұрын
Sorry to ask again but... is there a way to distinguish, during the split, which array elements contains a comma in the records? I have the scenario where there are records with comma and causes my array having more elements on different rows which makes me difficult to find the way to alling them. Thanks in advance for any feedback can provided.
@PaulieM
@PaulieM 3 жыл бұрын
What I tend to do in this situation is replace "," (Double Quote, Comma, Double Quote) in the entire CSV with something else like "|" (Double Quote, Vertical Bar or Pipe, Double Quote). Then you can split on the pipe symbol instead of the comma and the commas within your fields will remain intact.
@facun_OK
@facun_OK 3 жыл бұрын
@@PaulieM I see... so the replacement is suggested to be made on the file directly and then uploading it for letting the flow do the rest. Ok then, thanks a lot for your kindly support and teach!
@PaulieM
@PaulieM 3 жыл бұрын
@@facun_OK you can do it within the flow no problem, just add a compose action with a replace
@sneham8458
@sneham8458 3 жыл бұрын
@@PaulieM But what if the csv file only has double quotes around the fields that contains comma ? i.e., not all fields are seperated by (double quote, comma, double quote) ? eg: 449401,"Test(com) CO., LTD.","$123,43.74 ",54
@PaulieM
@PaulieM 3 жыл бұрын
@@sneham8458 What I would do is run a replace before the split, something like replace(outputs('Get_file_Content'), '","', '"|"') which will change (double quote, comma, double quote into double quite pipe symbol double quote). Then within the select you can split by Pipe Symbol instead of comma. You will still probably have to run some replaces in the selects to get rid of the unwanted double quotes, but it should give you a good start,
@franknielsen3219
@franknielsen3219 2 жыл бұрын
Brilliant, what if you have more than 5000 rows, lets say 7000 rows, how would that be acomplished? BTW, you make realy nice videos 👌👌👌👌
@PaulieM
@PaulieM 2 жыл бұрын
The 5,000 in this example, were just an example. 7,000 would also work 😀
@seen72
@seen72 Жыл бұрын
Finally what I've been looking for. I've got 11k rows and have found it timed out, will be trying this as soon as I'm home! 😍 Subscribed
@pplppl3444
@pplppl3444 2 жыл бұрын
Hello. Paulie M. Very helpful guide. Thank you! But I have error on a step Parse JSON. ValidationFailed. The schema validation failed. [ { "message": "Invalid type. Expected String but got Null.", "lineNumber": 0, "linePosition": 0, My csv file is not empty. I am using export from power bi paginated report to csv in previous step.
@billyroesener
@billyroesener 2 жыл бұрын
Did you get anywhere with this? I'm having the same issue. I've got valid data from the sampleData compose. When I look at the parseJson input data it all looks valid. But the validation keeps saying the data is null when it's not.
@joannezhu101
@joannezhu101 2 жыл бұрын
@@billyroesener i come the same problem, other steps all working except Parse Json says ""message": "Invalid type. Expected String but got Null.", "lineNumber": 0, "linePosition": 0, "path": "[1939]" is it because that column has no value, i do have certain csv "fields" is empty, just comma,comma,comma... I wonder what should I do from here?
@Gojiranotron
@Gojiranotron Жыл бұрын
@@joannezhu101 not sure if you still need a fix, but change the json properties from "type": "string" to "type": ["string, "null"]. this will allow both strings and nulls to be accepable for the schema.
@Trup_ti
@Trup_ti 3 жыл бұрын
Hi! I am facing an error at apply each step its says [ "Unable to process template language expressions for action 'Apply_to_each' at line 1 and column 13766:" The number of foreach items limit exceeded for action 'Apply_to_each': maximum '5000' and actual '11051'] though my CSV file has only 4000 rows
@PaulieM
@PaulieM 3 жыл бұрын
But there is not an apply to each step in the flow?
@Trup_ti
@Trup_ti 3 жыл бұрын
@@PaulieM Yes you're right..I am using the flow from your blog post which then import data to SharePoint list. There in you have an apply to each step.
@johanhuiberts7114
@johanhuiberts7114 2 жыл бұрын
Thanks a million for this video Paulie. It really helped me getting my work done. Or at least almost..... One of the Items I have in my csv contains a '\' character and somehow that is replaced by '\\'. I need to parse this item as a text in an SQL statement in the end. So I need it to be a '\'. I found a lot of information on escape sequence, but sofar not found just that information to help me. Can you explain how to deal with this?
@PaulieM
@PaulieM 2 жыл бұрын
It's correct that it gets replaced with a double slash. That is showing you the slash is being retained and then escaped. When you create output from it, it should become a single slash again.
@ET-zf9qs
@ET-zf9qs 3 ай бұрын
Hi, good day, is there a way to use your solution and then write all of these back to a SharePoint list?
@PaulieM
@PaulieM 3 ай бұрын
Yes, you simply follow this video and then add the items to your list in an apply to each loop. Use the create item action.
@ET-zf9qs
@ET-zf9qs 3 ай бұрын
@@PaulieM thanks for sharing, but just wondering if you also have a tutorial for that?
@PaulieM
@PaulieM 3 ай бұрын
After the parse json step at the end of the flow, add a create item action (SharePoint) and add of of the values from your parse JSON output and It will automatically put it into a loop for you.
@ET-zf9qs
@ET-zf9qs 3 ай бұрын
@@PaulieM Perfect! Thanks for all your help, much much appreciated! :)
@rathnasagar3199
@rathnasagar3199 3 жыл бұрын
Thank You Very Much Paulie
@wisherb1
@wisherb1 Жыл бұрын
What goes in the NewLine compose?
@PaulieM
@PaulieM Жыл бұрын
Literally a new line, put your mouse in the box and press the return key on your keyboard. Alternatively you can use the expression: decodeUriComponent('%0A') for a new line or decodeUriComponent('%0D%0A') for a Windows style CR+LF
@jagajeetkuppala
@jagajeetkuppala 10 ай бұрын
@@PaulieM I was not able to simply press return key now. It is taking it as empty data and asks to provide some value. Using expression seems to be the way! just an concat('') also worked for me. Please post the updated solution in description or pinned comment. BTW great video! Thanks...
@masternack626
@masternack626 10 ай бұрын
@@jagajeetkuppala I ran into the same issue but was able to get around it by changing back to the 'old' power automate. The 'New' power automate requires a value to be entered.
@jagajeetkuppala
@jagajeetkuppala 9 ай бұрын
@@masternack626 I didnt make that switch. But I hope you didnt loose out any feature by switching to old power automate.
@masternack626
@masternack626 9 ай бұрын
@@jagajeetkuppala I haven't done a complete comparison to know which features may or may not be available. I recently took a PA course from New Horizons and the instructor directed us to not use the new PA design. I assumed it was just because she didn't like change. When I started on projects where I work, I opted to use the new design. However, I found it more difficult to use at times and eventually switched back to the old design. PA is not the only MS app I've used recently that has a new design that is missing critical features I cannot do without. Outlooks ND is terrible, for example.
@ksboi29
@ksboi29 4 ай бұрын
Hell yah this will help me!!!!
@benholman8444
@benholman8444 10 ай бұрын
Sorry to be a bother. But now I'm getting an error in the JSON step. "message": "Invalid type. Expected String but got Null."
@sophiamohsin4638
@sophiamohsin4638 3 жыл бұрын
just awesome!!
@PaulieM
@PaulieM 3 жыл бұрын
Glad you enjoyed. Thinking about doing another video on this as I have found another method!
@willthomas7416
@willthomas7416 2 жыл бұрын
Great solution!
@PaulieM
@PaulieM 2 жыл бұрын
Thank you Will 🙏
@sudhakararao5892
@sudhakararao5892 Жыл бұрын
Nice one, Thank you
@coolbeing163
@coolbeing163 Жыл бұрын
wow. I am looking similar. thanks
@Vivaan_phani
@Vivaan_phani 3 жыл бұрын
Thanks alot Paul
@rafaelnegreiros_analyst
@rafaelnegreiros_analyst Жыл бұрын
Fantastic
@PaulieM
@PaulieM Жыл бұрын
Happy to help!
@hanisntsolo
@hanisntsolo 3 жыл бұрын
Awesome
@mks1222
@mks1222 3 жыл бұрын
Nice!
@backendadmin1217
@backendadmin1217 3 ай бұрын
Wow❤
@LukasSoftwareDeveloper
@LukasSoftwareDeveloper 3 жыл бұрын
What I get in the end of last row is: Name ", "" :/
@PaulieM
@PaulieM 3 жыл бұрын
Hi Lukas, that is because you have Windows style link breaks in your file (CRLF) and this demo shows working with Unix Style (LF). If you check the blog post there is a section that shows you how to deal with both types.
@LukasSoftwareDeveloper
@LukasSoftwareDeveloper 3 жыл бұрын
@@PaulieM hey thx I already found the solution. I used split(triggerOutputs()?['body'], decodeUriComponent('%0D%0A')) problem is idk how to remove last record of an array. I know you can skip first rows but how to skip last one?
@PaulieM
@PaulieM 3 жыл бұрын
@@LukasSoftwareDeveloper You need to find the length of the array and then minus 1 from it and use the take function, like this: take( outputs('array'), sub(length(outputs('array')),1) ) So you are saying, take the whole array, minus 1. Try and and see if it works for you.
@ashwin147
@ashwin147 3 жыл бұрын
Hi @Lukas Čaplikas and @paulie I am struck with the end of row /r issue not sure how to fix it can you please elaborate on the steps for fixing it
@PaulieM
@PaulieM 3 жыл бұрын
@@ashwin147 If you check out the blog post there is a section which shows you how to do this.
@FranciscoDanconia2
@FranciscoDanconia2 6 ай бұрын
Reeeeeeeeeeeeeeeeeeee
@napoleonmoscosa9353
@napoleonmoscosa9353 Жыл бұрын
You are not a good teacher
@PaulieM
@PaulieM Жыл бұрын
Thank you 🙏 😂
@HarshaVardhan-li5dg
@HarshaVardhan-li5dg Жыл бұрын
Just try watching it once or twice or by pausing at each connector it helped me
@guettadavid94
@guettadavid94 Жыл бұрын
I have a string like: "13931,13038,Express,736558,Americas,United States,KY,Erlanger,HUB,Leasehold,US Hub (new),\"CVG - Erlanger, Greater Cincinnati Airport\",Greater Cincinnati Airport,41048" how do I take out \"CVG - Erlanger, Greater Cincinnati Airport\" it contains a comma.
@anguswalker1963
@anguswalker1963 Жыл бұрын
Where is your CSV file created? Do you have the option to set the seperator to | istead of , | is used a lot less than , in text so I alwys find it a better seperator to use when I have the option. It gets around these issues.
@benholman8444
@benholman8444 10 ай бұрын
OK, I've got this pretty much working now, but the splitByLine is adding a " " to the end of each line. How do I stop that?
@PaulieM
@PaulieM 10 ай бұрын
That’s because your CSV has line endings which are carriage return line feed. Not just line feed. If you check out the blog post there are instructions how to fix this. You should use decodeUriComponent('%0D%0A') instead to perform the split.
Get Rows from CSV file using Power Automate
15:13
Clavin Fernandes
Рет қаралды 44 М.
How to parse a CSV file with Power Automate
8:04
Paul Murana
Рет қаралды 38 М.
كم بصير عمركم عام ٢٠٢٥😍 #shorts #hasanandnour
00:27
hasan and nour shorts
Рет қаралды 11 МЛН
Sigma Kid Mistake #funny #sigma
00:17
CRAZY GREAPA
Рет қаралды 14 МЛН
Quando A Diferença De Altura É Muito Grande 😲😂
00:12
Mari Maria
Рет қаралды 18 МЛН
快乐总是短暂的!😂 #搞笑夫妻 #爱美食爱生活 #搞笑达人
00:14
朱大帅and依美姐
Рет қаралды 14 МЛН
How to Parse/Read a CSV file in Microsoft Power Automate Flow for Azure Logic Apps
10:12
Microsoft Dynamics 365 & Power Platform
Рет қаралды 15 М.
How to Export Power BI Data to Excel | Query against a dataset
17:58
Parsing Text from email with Microsoft Power Automate
17:53
Paul Murana
Рет қаралды 79 М.
Process CSV files easily with Power Automate and Dataflows
20:25
Microsoft Power Platform
Рет қаралды 65 М.
How to properly process csv files in Power Automate-Encodian Parse CSV
13:48
CSV File To SharePoint List by Power Automate
6:55
Ravindra Jadhav
Рет қаралды 3,5 М.
Parse a CSV to JSON Array - Easy Solution
7:11
DamoBird365
Рет қаралды 4,8 М.
Quickly Import CSV Data to a SharePoint List with Power Automate
10:49
A Creative Opinion
Рет қаралды 28 М.
كم بصير عمركم عام ٢٠٢٥😍 #shorts #hasanandnour
00:27
hasan and nour shorts
Рет қаралды 11 МЛН