Power BI: Remove Duplicate Records And Keep Most Recent ⚡

Поділитися
Вставка
  • Опубліковано 11 жов 2024
  • In this video, I explain how to use the Table.Buffer function in the Power Query Editor to remove duplicate records with differing dates and keep the most recent entry.
    To see all of Matt's videos check out his UA-cam series on:
    / @thealgebrateacherpowe...
    - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -- - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -
    On-Demand Learning Courses FREE Trial: www.pragmaticw...
    Pragmatic Works Blog: blog.pragmaticw...
    Let's connect:
    Twitter: / pragmaticworks​
    Facebook: / ​
    Instagram: / pragmatic.w​. .
    LinkedIn: / prag​. .
    UA-cam: / pragmaticworks​
    Pragmatic Works
    1845 Towncenter Blvd Suite 505 Fleming Island, FL 32003
    Phone: (904) 413-1911
    Email: training@pragmaticworks.com

КОМЕНТАРІ • 175

  • @krystieharris4026
    @krystieharris4026 6 місяців тому +5

    It took me 3 hours to find you, but i'm so glad I did! Thank you!

  • @9ajack
    @9ajack Рік тому +14

    This is a live saver!! I had a similar issue and so simple yet so helpful!

  • @Dude276175
    @Dude276175 2 роки тому +2

    I wasted sooo much time trying to figure this out. I found the reason that Remove Duplicates was not working, but could not find a fix (that I was able to perform with my level of knowledge). Then I found this video and it was PERFECT.

  • @Tdrewlo
    @Tdrewlo Рік тому +9

    Incredibly helpful yet so simple! Thanks so much!

  • @DanBrill
    @DanBrill Рік тому +3

    Thanks! Very well explained. It's an easy fix, but I'd never have figured this out on my own.

  • @hannahmahoney6267
    @hannahmahoney6267 2 роки тому +1

    THANK YOU SO MUCH! I was having a really hard time understanding why PBI would not remove duplicates after I sorted and this video was so easy to apply and solved my issue !

  • @nicoleburnat2550
    @nicoleburnat2550 2 роки тому +2

    I spent nearly 4 hours trying to figure this out..thank you so much, so easy!

  • @ChiefBroady
    @ChiefBroady 6 місяців тому +3

    Thank you! Such an easy solution for such a weird functionality.

  • @gaparkinson09
    @gaparkinson09 Рік тому +6

    This was so simple and perfect - thank you!!!!

  • @melissawaller239
    @melissawaller239 11 місяців тому

    Thanks so much for this!! I needed to be able to remove duplicates in both ascending date order and descending date order and I kept getting the same info. So thankful to find this. Very easy to follow!

    • @PragmaticWorks
      @PragmaticWorks  11 місяців тому

      Melissa, we are so glad you found the video helpful! Thank you for watching and commenting.

  • @wessauder7708
    @wessauder7708 4 місяці тому

    Wow! I didn't know about the Table.Buffer function. I wonder if there are other types of issues where this pops up. Thank you for posting - saved me hours.

  • @dickmcmullen2341
    @dickmcmullen2341 3 роки тому +1

    Thanks Matthew - Have tried this before unsuccessfully with a different syntax, so thanks for the correct syntax. It now works beautifully!

  • @narafinbluemoon906
    @narafinbluemoon906 6 місяців тому +2

    Thank you very much for your effort. Simple and it is working.

  • @JoshCunningham-e2o
    @JoshCunningham-e2o 8 місяців тому

    Thank you for this video! Was very frustrated with my sort not working properly until I learned about this fix.

  • @nathangoffnett5693
    @nathangoffnett5693 6 місяців тому +2

    Awesome explanation and solution, this is exactly what I needed! :D

  • @favoureforuoku4622
    @favoureforuoku4622 3 місяці тому

    Thank you so much for this video @matthew Peterson. I have a related problem, but in this case, I don't want to delete the old record but want to return only the most recent as a count.

  • @mattaldridge
    @mattaldridge 8 місяців тому

    THANK YOU! you just saved me an hour of work trying to figure this out

  • @ChristopherMoore1913
    @ChristopherMoore1913 10 місяців тому

    Great video. I've been looking for something like this. I aggregate data from dozens of excel models each month, and one of the tables is the 1 side of a 1 to many relationships. I've been filtering the table by only keeping the latest records based on submission month, but that filtered out closed projects. This method works much better.

  • @ecashmarketing
    @ecashmarketing Рік тому

    good stuff!!!! help me solve problem.... i was joining tables here and there....your solution was so simple.

  • @lukeandchitraswygard8567
    @lukeandchitraswygard8567 3 роки тому +1

    Thank you! I desperately needed this solution! Grateful to have found this video!

  • @tystallard
    @tystallard 5 місяців тому

    Thank you, I had a hard time figuring this one out. I appreciate you taking the time and posting this.

  • @B0ge
    @B0ge 2 роки тому

    So easy to follow-up how you navigate through the video. Thanks for excellent video and advice!

  • @mdrinkwater
    @mdrinkwater 9 місяців тому

    Thankyou for making this. I would NEVER have figured this out by myself!

  • @iainmorrison6658
    @iainmorrison6658 Рік тому

    That is a brilliant tip/trick. Thanks for putting in the sleuthing to find that solution.

  • @ivanbork4175
    @ivanbork4175 2 роки тому +1

    In short, thanks
    Has been annoying me for the longest time
    You got a new follower

  • @hakim4416
    @hakim4416 2 місяці тому

    Un grand merci pour ce partage. C'est tellement bien expliqué !

  • @HowardND9
    @HowardND9 3 роки тому

    Holy **** this is fantastic…EXACTLY what I needed and way more efficient than my ideas! I will use this like a bar of soap.
    Thank you!

  • @juliane1mota
    @juliane1mota Рік тому

    Can I like it a million times??? Loved this!

  • @yaygara
    @yaygara 3 роки тому +1

    Super easy trick, saved my day! Thank you.

  • @LuisJuarez-mi8du
    @LuisJuarez-mi8du 6 місяців тому +1

    Great explanation, thanks for sharing the knowledge!

  • @victorpiva701
    @victorpiva701 3 роки тому

    Thank you so much!!! I was searching for this solution for hours!!!! Love from Brazil!

  • @helmutgertz8721
    @helmutgertz8721 3 роки тому

    Really helpful!!!! Nailed and fixed what caused me some headache ...

  • @awesh1986
    @awesh1986 2 місяці тому

    You have been a life saver for me.

  • @josemadrid17
    @josemadrid17 2 роки тому +1

    Great explanation Sir! I was having the same exact issue, luckily I was able to solve it right away.

  • @daniellaria
    @daniellaria 2 місяці тому

    This was awesome! Thank you for a realy simple and effective video!

  • @xiajunjim
    @xiajunjim 2 роки тому +1

    This is Epic, saved me loads of time! Appreciated!

  • @ljsky
    @ljsky 2 роки тому +1

    Thanks for the solution!

  • @עידןלביא-ת3נ
    @עידןלביא-ת3נ 2 роки тому

    The Only one that help me found the right soultion, saved my day! Thank you

  • @souzarodrigo04
    @souzarodrigo04 3 роки тому +1

    Good trick, will definitely use it, thank you. Just wondering why the video title mentions Power Apps...

  • @tommytom9407
    @tommytom9407 9 місяців тому

    Been trying to work this out of hours. Thank you so much 👍

  • @romansturza1310
    @romansturza1310 3 роки тому +1

    Good job Matthew! Thank you

  • @santhoshikrishnakanthmulla9691
    @santhoshikrishnakanthmulla9691 3 роки тому +3

    good one. i didn't know that .

  • @floriansorin2728
    @floriansorin2728 4 місяці тому

    thanks a lot that was my today probleme, i'm glad i found this video 👍

  • @DanielADamico
    @DanielADamico 3 роки тому +2

    Nice tip!👏👏

  • @alison434
    @alison434 2 роки тому +1

    Just what I needed, thank you!

  • @justinbregman9174
    @justinbregman9174 Рік тому

    Great video, I re-reference it all the time

  • @justinlane3306
    @justinlane3306 2 роки тому +1

    Thank You - this saved me today!

  • @nathanwilliams7129
    @nathanwilliams7129 9 місяців тому

    Amazing. Just what I needed. Thankyou!

  • @davidweaver8506
    @davidweaver8506 Рік тому

    Thanks Matt! This is super helpful.
    You mentioned doing a little research and finding this. Where did you find it?

  • @malchicken
    @malchicken 3 роки тому +3

    Good to know, thank you :)

  • @ekaterinavolkova4348
    @ekaterinavolkova4348 11 місяців тому

    You're my hero! It works! Thank you very much!

  • @MK-ni6gs
    @MK-ni6gs 3 роки тому +2

    Excellent, thank you.

  • @mariemherreromedina2048
    @mariemherreromedina2048 2 роки тому

    Thanks for the explanation! I wonder if this can be used when having incremental refresh configured.

  • @reileybergin10
    @reileybergin10 3 роки тому +1

    Worked! Thanks Matt!

  • @GaryMillerUK
    @GaryMillerUK Рік тому

    Perfect! Solved my problem. Thanks👍

  • @jrafaelmartinez9965
    @jrafaelmartinez9965 2 місяці тому

    Amazing!!! This save my query, thanks so much!!

  • @tytytherugbyguy
    @tytytherugbyguy 2 роки тому

    Very well explained!

  • @kennethskinner7727
    @kennethskinner7727 2 роки тому

    Wow - I never would have found the buffer fix. This may have saved me another day of beating my head against a wall!

  • @Maxlippens
    @Maxlippens Рік тому

    Helped me a lot ! thanks for sharing this solution

  • @Savastan0s
    @Savastan0s Рік тому

    Thanks, exactly what I needed!

  • @denyskrysanov7590
    @denyskrysanov7590 3 роки тому +1

    Thanks, Man. Great Solution
    !

  • @rizvanmammadov137
    @rizvanmammadov137 2 роки тому

    Thanks a lot. Was just looking for this workaround.

  • @MichaelDee2
    @MichaelDee2 Рік тому

    Simply fantastic!

  • @SystemsDeptKIOCL
    @SystemsDeptKIOCL 3 роки тому +1

    wonderfully useful tip I am so very grateful to you

  • @marcosfilho1815
    @marcosfilho1815 25 днів тому

    Thank you very much, very useful information.

  • @sonetmollick4630
    @sonetmollick4630 2 роки тому

    Awesome Matthew. lots of thanks :) It works for me, before I had to create a long DAX code to get the same result.

  • @emuss2760
    @emuss2760 Рік тому

    life saver bro!!
    Thank you

  • @SteveShishani
    @SteveShishani 3 роки тому

    Thanks, Matthew! It works as explained. How would you use this with DAX in Power BI in conjunction with Calculate and DistinctCount?

  • @KollainCanada
    @KollainCanada 9 місяців тому

    Life Saver. thank you

  • @amithmihiranga1913
    @amithmihiranga1913 Рік тому

    Amazing I was finding it hard to solve this one 👍

  • @alphatolentino2837
    @alphatolentino2837 5 місяців тому

    Thank you for sharing this! 😊

  • @alexdenham85
    @alexdenham85 7 місяців тому

    Matt is there a good solution for databases at scale? Or is your only option to de-dupe the source table / create a view? When using buffer I'm finding it just doesn't scale to my dataset.

  • @gillesbonniot315
    @gillesbonniot315 3 роки тому

    Thank you so much ... I was looking for why my remove duplicates was not working and this was the missing component.

  • @jeansepulveda2577
    @jeansepulveda2577 Рік тому +1

    Thanks so much!!!! this helped me.

  • @louwjhl7227
    @louwjhl7227 Місяць тому

    Now that is an explanation that I won't forget! Thanks!! @ChatGTP - please take note

  • @Linriel777
    @Linriel777 4 місяці тому

    Great video. This solved my problem. I thought I was to stupid to remove duplicates...

  • @IsaacSomuah
    @IsaacSomuah 4 місяці тому

    This worked for me
    Thanks man

  • @chisamuel7168
    @chisamuel7168 2 місяці тому

    Sir, thank you so much
    this is just awesome

  • @patyhelenfl
    @patyhelenfl Рік тому +1

    That was great!!! thank you so much!!!

  • @jonellara5751
    @jonellara5751 7 місяців тому

    Thank you Sir! It works for me

  • @enzioquartero6367
    @enzioquartero6367 2 роки тому

    Amazing! Thank you for this!

  • @nbcctest1160
    @nbcctest1160 3 роки тому

    Thank you! This is exactly what I needed!!!!

  • @himanshunagpalca
    @himanshunagpalca 2 місяці тому

    excellent trick , thanks for sharing

  • @rohittyagi2594
    @rohittyagi2594 Рік тому

    so simple and perfect - thank you!!!!

  • @pawelwidawski7886
    @pawelwidawski7886 Рік тому

    Great video! Helped me a lot, thanks :)

  • @martinlatal_
    @martinlatal_ Місяць тому

    This is amazing! Thanks

  • @mrvulpus
    @mrvulpus 3 роки тому

    Thanks Matt, this made my day!

  • @ehteshamali2893
    @ehteshamali2893 2 роки тому

    Hi there, Great lecture sir. I had a question: How do you remove duplicates within a duplicated column in Power BI? Whenever I try to remove the duplicates via the power query editor, it removes the duplicated from both columns; original and the duplicated one. Please help.

  • @croquetando
    @croquetando Рік тому

    Thanks, so helpful and to the point :)

  • @OmarMcIver
    @OmarMcIver 2 роки тому +1

    Killer. Really helped. Thank you!

  • @keiljuanaphillips9663
    @keiljuanaphillips9663 2 роки тому +1

    Thank you so much!

  • @mfachry3012
    @mfachry3012 4 місяці тому

    OMG, thankyou verymuch this is really works

  • @dineshsuranga4290
    @dineshsuranga4290 2 роки тому +1

    Thank you.

  • @mohammed333suliman
    @mohammed333suliman 3 роки тому +1

    Nice trick

  • @UsmanBabar28
    @UsmanBabar28 2 роки тому

    You're a legend.

  • @davissonmonteiro7856
    @davissonmonteiro7856 Рік тому

    On point, thanks that was so helpful.

  • @coisasqueeugosto6233
    @coisasqueeugosto6233 2 роки тому

    Worked! Thank You!

  • @orlandoramos3531
    @orlandoramos3531 2 роки тому

    Just wanted to drop a thanks!

  • @daronodonald9662
    @daronodonald9662 2 роки тому +1

    When I apply the Table.Buffer, even though it's only the 2nd to last step, it completely kills my query and none of my queries load. Any ideas?

  • @JordivanKaam
    @JordivanKaam 5 місяців тому

    Thanks legend! 😀