Power BI: Remove Duplicate Records And Keep Most Recent ⚡

In this video, I explain how to use the Table.Buffer function in the Power Query Editor to remove duplicate records with differing dates and keep the most recent entry.
To see all of Matt's videos check out his KZbin series on:
/ @thealgebrateacherpowe...
- - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -- - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -
On-Demand Learning Courses FREE Trial: www.pragmaticw...
Pragmatic Works Blog: blog.pragmaticw...
Let's connect:
Twitter: / pragmaticworks​
Facebook: / ​
Instagram: / pragmatic.w​. .
LinkedIn: / prag​. .
KZbin: / pragmaticworks​
Pragmatic Works
1845 Towncenter Blvd Suite 505 Fleming Island, FL 32003
Phone: [phone]
Email: [e-mail]

[@krystieharris4026]

It took me 3 hours to find you, but i'm so glad I did! Thank you!

[@9ajack]

This is a live saver!! I had a similar issue and so simple yet so helpful!

[@Dude276175]

I wasted sooo much time trying to figure this out. I found the reason that Remove Duplicates was not working, but could not find a fix (that I was able to perform with my level of knowledge). Then I found this video and it was PERFECT.

[@Tdrewlo]

Incredibly helpful yet so simple! Thanks so much!

[@PragmaticWorks]

Glad it was helpful!

[@DanBrill]

Thanks! Very well explained. It's an easy fix, but I'd never have figured this out on my own.

[@hannahmahoney6267]

THANK YOU SO MUCH! I was having a really hard time understanding why PBI would not remove duplicates after I sorted and this video was so easy to apply and solved my issue !

[@PragmaticWorks]

Glad it helped!

[@ChiefBroady]

Thank you! Such an easy solution for such a weird functionality.

[@nicoleburnat2550]

I spent nearly 4 hours trying to figure this out..thank you so much, so easy!

[@PragmaticWorks]

Glad it helped!

[@gaparkinson09]

This was so simple and perfect - thank you!!!!

[@PragmaticWorks]

Glad it was helpful!

[@favoureforuoku4622]

Thank you so much for this video @matthew Peterson. I have a related problem, but in this case, I don't want to delete the old record but want to return only the most recent as a count.

[@melissawaller239]

Thanks so much for this!! I needed to be able to remove duplicates in both ascending date order and descending date order and I kept getting the same info. So thankful to find this. Very easy to follow!

[@PragmaticWorks]

Melissa, we are so glad you found the video helpful! Thank you for watching and commenting.

[@wessauder7708]

Wow! I didn't know about the Table.Buffer function. I wonder if there are other types of issues where this pops up. Thank you for posting - saved me hours.

[@narafinbluemoon906]

Thank you very much for your effort. Simple and it is working.

[@ChristopherMoore1913]

Great video. I've been looking for something like this. I aggregate data from dozens of excel models each month, and one of the tables is the 1 side of a 1 to many relationships. I've been filtering the table by only keeping the latest records based on submission month, but that filtered out closed projects. This method works much better.

[@dickmcmullen2341]

Thanks Matthew - Have tried this before unsuccessfully with a different syntax, so thanks for the correct syntax. It now works beautifully!

[@TheAlgebraTeacherPOWERStoBI]

Glad to have helped!

[@ecashmarketing]

good stuff!!!! help me solve problem.... i was joining tables here and there....your solution was so simple.

[@nathangoffnett5693]

Awesome explanation and solution, this is exactly what I needed! :D

[@JoshCunningham-e2o]

Thank you for this video! Was very frustrated with my sort not working properly until I learned about this fix.

[@tystallard]

Thank you, I had a hard time figuring this one out. I appreciate you taking the time and posting this.

[@mattaldridge]

THANK YOU! you just saved me an hour of work trying to figure this out

[@B0ge]

So easy to follow-up how you navigate through the video. Thanks for excellent video and advice!

[@lukeandchitraswygard8567]

Thank you! I desperately needed this solution! Grateful to have found this video!

[@PragmaticWorks]

You are very welcome!

[@mdrinkwater]

Thankyou for making this. I would NEVER have figured this out by myself!

[@hakim4416]

Un grand merci pour ce partage. C'est tellement bien expliqué !

[@LuisJuarez-mi8du]

Great explanation, thanks for sharing the knowledge!

[@daniellaria]

This was awesome! Thank you for a realy simple and effective video!

[@davidweaver8506]

Thanks Matt! This is super helpful. You mentioned doing a little research and finding this. Where did you find it?

[@HowardND9]

Holy **** this is fantastic…EXACTLY what I needed and way more efficient than my ideas! I will use this like a bar of soap. Thank you!

[@PragmaticWorks]

You are welcome!

[@iainmorrison6658]

That is a brilliant tip/trick. Thanks for putting in the sleuthing to find that solution.

[@souzarodrigo04]

Good trick, will definitely use it, thank you. Just wondering why the video title mentions Power Apps...

[@yaygara]

Super easy trick, saved my day! Thank you.

[@josemadrid17]

Great explanation Sir! I was having the same exact issue, luckily I was able to solve it right away.

[@PragmaticWorks]

Glad it helped!

[@ivanbork4175]

In short, thanks Has been annoying me for the longest time You got a new follower

[@PragmaticWorks]

Thanks for subscribing!

[@nathanwilliams7129]

Amazing. Just what I needed. Thankyou!

[@helmutgertz8721]

Really helpful!!!! Nailed and fixed what caused me some headache ...

[@PragmaticWorks]

Glad it helped!

[@victorpiva701]

Thank you so much!!! I was searching for this solution for hours!!!! Love from Brazil!

[@PragmaticWorks]

Glad we could help!

[@עידןלביא-ת3נ]

The Only one that help me found the right soultion, saved my day! Thank you

[@PragmaticWorks]

Glad it helped!

[@tommytom9407]

Been trying to work this out of hours. Thank you so much 👍

[@romansturza1310]

Good job Matthew! Thank you

[@mariemherreromedina2048]

Thanks for the explanation! I wonder if this can be used when having incremental refresh configured.

[@xiajunjim]

This is Epic, saved me loads of time! Appreciated!

[@PragmaticWorks]

Glad it helped!

[@awesh1986]

You have been a life saver for me.

[@jrafaelmartinez9965]

Amazing!!! This save my query, thanks so much!!

[@ekaterinavolkova4348]

You're my hero! It works! Thank you very much!

[@GaryMillerUK]

Perfect! Solved my problem. Thanks👍

[@reileybergin10]

Worked! Thanks Matt!

[@PragmaticWorks]

Glad it helped!

[@alexdenham85]

Matt is there a good solution for databases at scale? Or is your only option to de-dupe the source table / create a view? When using buffer I'm finding it just doesn't scale to my dataset.

[@Maxlippens]

Helped me a lot ! thanks for sharing this solution

[@alison434]

Just what I needed, thank you!

[@PragmaticWorks]

You're welcome! Glad to help (:

[@floriansorin2728]

thanks a lot that was my today probleme, i'm glad i found this video 👍

[@ljsky]

Thanks for the solution!

[@PragmaticWorks]

glad we could help!

[@marcosfilho1815]

Thank you very much, very useful information.

[@justinbregman9174]

Great video, I re-reference it all the time

[@juliane1mota]

Can I like it a million times??? Loved this!

[@rizvanmammadov137]

Thanks a lot. Was just looking for this workaround.

[@PragmaticWorks]

Glad I could help

[@SteveShishani]

Thanks, Matthew! It works as explained. How would you use this with DAX in Power BI in conjunction with Calculate and DistinctCount?

[@tytytherugbyguy]

Very well explained!

[@KollainCanada]

Life Saver. thank you

[@justinlane3306]

Thank You - this saved me today!

[@PragmaticWorks]

Glad to help!

[@kennethskinner7727]

Wow - I never would have found the buffer fix. This may have saved me another day of beating my head against a wall!

[@PragmaticWorks]

Glad it helped!

[@santhoshikrishnakanthmulla9691]

good one. i didn't know that .

[@DanielADamico]

Nice tip!👏👏

[@pawelwidawski7886]

Great video! Helped me a lot, thanks :)

[@Savastan0s]

Thanks, exactly what I needed!

[@MK-ni6gs]

Excellent, thank you.

[@sonetmollick4630]

Awesome Matthew. lots of thanks :) It works for me, before I had to create a long DAX code to get the same result.

[@PragmaticWorks]

Glad it helped!

[@ehteshamali2893]

Hi there, Great lecture sir. I had a question: How do you remove duplicates within a duplicated column in Power BI? Whenever I try to remove the duplicates via the power query editor, it removes the duplicated from both columns; original and the duplicated one. Please help.

[@rohittyagi2594]

so simple and perfect - thank you!!!!

[@jeansepulveda2577]

Thanks so much!!!! this helped me.

[@PragmaticWorks]

Glad it helped!

[@denyskrysanov7590]

Thanks, Man. Great Solution !

[@PragmaticWorks]

You're welcome!

[@MichaelDee2]

Simply fantastic!

[@malchicken]

Good to know, thank you :)

[@gillesbonniot315]

Thank you so much ... I was looking for why my remove duplicates was not working and this was the missing component.

[@PragmaticWorks]

Glad it was helpful!

[@louwjhl7227]

Now that is an explanation that I won't forget! Thanks!! @ChatGTP - please take note

[@alphatolentino2837]

Thank you for sharing this! 😊

[@patyhelenfl]

That was great!!! thank you so much!!!

[@PragmaticWorks]

You're so welcome!

[@emuss2760]

life saver bro!! Thank you

[@rezag.7349]

Thank you for this excellent workaround. I just have one question in regards to the root cause as you explained it. The Advanced Editor allows us to let a step occur after any of previous steps. example: step 4 could be specified to be executed based on the outcome of step 2 (and thereby step 3 would be skipped). Does this indicate that Power Query has to follow the order of steps as specified in code (via Advanced Editor). So is the root cause perhaps something else e.g. a bug?

[@SystemsDeptKIOCL]

wonderfully useful tip I am so very grateful to you

[@PragmaticWorks]

Glad it was helpful!

[@chisamuel7168]

Sir, thank you so much this is just awesome

[@amithmihiranga1913]

Amazing I was finding it hard to solve this one 👍

[@himanshunagpalca]

excellent trick , thanks for sharing

[@OmarMcIver]

Killer. Really helped. Thank you!

[@PragmaticWorks]

Glad it helped!

[@enzioquartero6367]

Amazing! Thank you for this!

[@Linriel777]

Great video. This solved my problem. I thought I was to stupid to remove duplicates...

[@croquetando]

Thanks, so helpful and to the point :)

[@jonellara5751]

Thank you Sir! It works for me

[@mfachry3012]

OMG, thankyou verymuch this is really works

[@martinlatal_]

This is amazing! Thanks

[@nbcctest1160]

Thank you! This is exactly what I needed!!!!

[@PragmaticWorks]

Glad it was helpful!

[@daronodonald9662]

When I apply the Table.Buffer, even though it's only the 2nd to last step, it completely kills my query and none of my queries load. Any ideas?

[@IsaacSomuah]

This worked for me Thanks man

[@thedynermite]

I got very angry with power query here. The change in logic compared to basic excel made no sense. Thank you for explaining both the problem (+ power query logic) and the solution clearly and effectively.

[@keiljuanaphillips9663]

Thank you so much!

[@PragmaticWorks]

You're welcome!

[@davissonmonteiro7856]

On point, thanks that was so helpful.

[@dineshsuranga4290]

Thank you.

[@PragmaticWorks]

Welcome!

[@mrvulpus]

Thanks Matt, this made my day!

[@PragmaticWorks]

Glad to hear it!

[@balupriya729]

Really helpful thx for the tip

[@PandyaDarshit]

What to do if I have to take a date from the date slicer (From visual) then Sort value based on some columns then keep the most recent one

[@joseraulesquivelugarte7120]

Great! Thaks a lot!

[@PragmaticWorks]

You are welcome!