Idempotency in APIs: you should be aware of this!

Поділитися
Вставка
  • Опубліковано 31 гру 2024
  • Idempotency is an important aspect of designing APIs and how they interact with other microservices or external modules. It's definitely a best practice to consider when building an API. It's used to avoid critical errors in the system and keep the business logic in tact.
    Consider becoming a member of the channel by joining me ❤️
    / @softwaredeveloperdiaries
    🙌 Become my Patreon and get exclusive perks: / softdevdiaries
    💼 Follow me on LinkedIn and drop me a message if you'd like: / gusgadirov
    💻 Also, let's connect on GitHub: github.com/gusgad
    📚 Resources:
    A full article on Idempotency: www.baeldung.c...
    And don't forget to subscribe for more videos like this 😊

КОМЕНТАРІ • 50

  • @onhazrat
    @onhazrat Рік тому +8

    🎯 Key Takeaways for quick navigation:
    00:55 🔄 Item potency means the same operation produces the same result, crucial for consistent API behavior.
    03:15 📝 Pay attention to the "post" and "patch" HTTP methods, as they can create or modify data, demanding careful handling of item potency.
    04:41 🔑 The solution to item potency issues involves using an item potency key (X-Item-Poy-ID) to ensure requests aren't processed multiple times.
    05:08 💾 Store the item potency key in a memory system, such as a database or cache, to manage consistent API behavior.
    06:58 ✅ Attach the item potency key to your requests, preventing the same request from being processed twice.
    Made with HARPA AI

  • @TannerBarcelos
    @TannerBarcelos 8 місяців тому +4

    The best video explanation of this very critical issue high scale, highly reliable systems face. Subscribed!

  • @soulGrafitti
    @soulGrafitti 4 місяці тому +2

    Nice video. I really like your examples and approach.
    Around 03:33 you discuss why POST and PATCH require idempotentcy but the other HTTP methods don't. There is a lot of information arguing the opposite which I found when I googled POST and PUT. At a glance the reasoning one way or the other seems to depend on the exact use case and how effectively the return status codes are managed. Perhaps you could add some discussion or commentary addressing the divergence of opinion.

  • @cariyaputta
    @cariyaputta Рік тому +12

    So it's equivalent to the concept of pure function?

    • @positivity1016
      @positivity1016 Рік тому +3

      Good point, sounds similar

    • @SoftwareDeveloperDiaries
      @SoftwareDeveloperDiaries  Рік тому +1

      It is 🙂

    • @henrybigelow3570
      @henrybigelow3570 4 місяці тому +1

      No. A pure function is a function that has no side effects. An idempotent function is one that, if called once, has the same side effect as if it is called more than once.

  • @milindsankeshware423
    @milindsankeshware423 3 місяці тому +1

    Do you have any video posted on Spring Rest API/ Microservices ? If yes then could you please share ?

    • @SoftwareDeveloperDiaries
      @SoftwareDeveloperDiaries  3 місяці тому

      Hey mate, unfortunately I don't do Spring specific videos but I talk about microservices in my System Design & Architecture playlist: ua-cam.com/play/PL5Lsd0YA4OMFvX88T5xH93NqBALI7TENz.html

  • @cybersholt
    @cybersholt Рік тому +4

    Really interesting topic, been doing web development for 20 years and luckily never had anything like uber eats had!
    But the video was done really well and am looking forward to more from ya. Keep up the great work man

  • @actitud
    @actitud 22 дні тому

    Very well explained. Thanks.

  • @josecarlostoscano5837
    @josecarlostoscano5837 Рік тому +3

    Would repeated calls of the function ‘makeRequest’ have different values for the idempotency key? If they do, then the api would process both of them, wouldn’t it?

    • @juraev0056
      @juraev0056 Рік тому +3

      Yes, `makeRequest` makes a new request. You should make retry requests with previous failed request's idempotent key. You can see he's handling retries with `shouldRetry`

    • @SoftwareDeveloperDiaries
      @SoftwareDeveloperDiaries  Рік тому +1

      No, the idempotency key is the same for all retries for a particular user. The client can save the key in the SessionStorage while the user is still on the "Order" page and delete it after the order has been placed successfully.

  • @kazuar87
    @kazuar87 Рік тому +1

    6:37 what kind of cache? The automatic subtitle does not get it either... :)

  • @yusufnurwahid898
    @yusufnurwahid898 3 місяці тому

    Very clear explanation!!!
    Many thanks!!!

  • @verb0ze
    @verb0ze Рік тому

    I don't know if I agree with not needing to concern ourselves with idempotency for other methods. I'd say it depends on the API. There are some cases where DELETE for example should be idempotent, like when deleting an item from a doing cart (and setting the total cost for the remainder of the cart

    • @MrMashyker
      @MrMashyker 6 місяців тому

      Exactly! HTTP methods are just conventions: devs are free to implement them however they like.

  • @abdrnasr
    @abdrnasr Рік тому +2

    Great video!
    Don't you think that storing this temp value on the client is not the most secure way? A client could easily clear cookie.
    If there is a mechanism in the backend that deals with duplicate requests, then this is a different story.

    • @SoftwareDeveloperDiaries
      @SoftwareDeveloperDiaries  Рік тому +2

      Good question! The user should be somewhat aware that if they face an error upon let's say, clicking the "Pay" button and clear their cookies right after that, then that's not in their best interest and can lead to unexpected consequences such as paying twice. At least that's how I see it :)

  • @JohnSmithhh
    @JohnSmithhh 4 місяці тому

    Cool video ! How to make ajax request idempotent in a situation where user can create for example cards on the page ?

  • @AhmedAli-jx9ie
    @AhmedAli-jx9ie Рік тому +2

    how exactly the request will be retried with the same idempotency key?

    • @SoftwareDeveloperDiaries
      @SoftwareDeveloperDiaries  Рік тому +3

      The frontend can save the idempotency key in the SessionStorage as soon as the customer lands on the "Order" page and use it for every retry. Upon a success, the frontend clears the key.

    • @throwaway-lo4zw
      @throwaway-lo4zw Місяць тому

      @@SoftwareDeveloperDiaries this is a stupid solution i can just change that key and get multiple refunds

  • @idle.observer
    @idle.observer 4 місяці тому +1

    Can someone explain, when we should remove the idempotency key? I think we shouldn't save all the keys forever.

    • @SoftwareDeveloperDiaries
      @SoftwareDeveloperDiaries  3 місяці тому

      Either after the processing has been fully completed, for ex. the order has been delivered to the client or you set a custom TTL.

  • @CodingWithAuryn
    @CodingWithAuryn 11 місяців тому

    Very helpful!! Thank you for this nice explanation!

  • @naveenkumar-pg7te
    @naveenkumar-pg7te 4 місяці тому +1

    Can this be achieved with transaction? If first request fails in service just revert everything dont create burger and send error message to client

  • @rahulbabbar555
    @rahulbabbar555 8 місяців тому

    Hey! nice explanation.. Which software you are using to demonstrate this..

  • @jonatasdeoliveiracoelho4691
    @jonatasdeoliveiracoelho4691 6 місяців тому

    Extremely helpful! Thanks a lot! Subscribed!

  • @MaartenRaasveldt
    @MaartenRaasveldt 3 місяці тому

    Shouldn't you store the idempotency key in the database you're writing the order to so that it's transactional? Otherwise if the program crashes at any point between "executing" the order, and writing the idempotency key to storage (like redis), you'll still have the same problem

    • @SoftwareDeveloperDiaries
      @SoftwareDeveloperDiaries  3 місяці тому

      Thanks for your comment, that's actually a good point. Storing it together with the main data that's being written is prob the best idea most of the times.

  • @anandraj2895
    @anandraj2895 2 місяці тому

    pretty good , informative

  • @viraj_singh
    @viraj_singh Рік тому

    When I was in my university, I ordered so many free food at the time of the glitch. Later on I was banned from uber eats and then uber and I just made a new uber account ande moved on. :) Great video by the way.

  • @M0HCT3R
    @M0HCT3R Рік тому

    It would be interesting to see the solution for backend

    • @SoftwareDeveloperDiaries
      @SoftwareDeveloperDiaries  Рік тому +2

      Hope this is somewhat of a help :)
      medium.com/dsc-hit/creating-an-idempotent-api-using-node-js-bdfd7e52a947

  • @EmmanuelOdii80
    @EmmanuelOdii80 Рік тому

    Hey, Great video.
    Meanwhile, I'd love to know if tou use Nest js :)

  • @mansoormasoudifard8624
    @mansoormasoudifard8624 6 місяців тому

    I learned a lot 👌

  • @rajaerobinson
    @rajaerobinson Рік тому

    Great video!

  • @developerfoe
    @developerfoe Рік тому +1

    amazing video

  • @throwaway-lo4zw
    @throwaway-lo4zw Місяць тому

    ok so basically u can just have like a status column in your refunds table or whaterver which is type bool which can be set to true if the backend has already processed the burger refund rather than this idempotency key bullshit lol