Speed Up Your APIs with Nodejs and Redis Magic!

Поділитися
Вставка
  • Опубліковано 25 сер 2024

КОМЕНТАРІ • 96

  • @sarthak_nande
    @sarthak_nande Місяць тому +2

    best video I ever saw
    Thanks for this knowledge

  • @osama-ki_masi-ki_pota7677
    @osama-ki_masi-ki_pota7677 27 днів тому

    Bhai apka padhane ka style mast aur simple hai

  • @TrendingShorts-5G
    @TrendingShorts-5G Місяць тому +3

    Really amazing video on docker and redis please if possible make more on docker and redis please bhaiya . Your explanation is very good 🤩

    • @sandeepdev0
      @sandeepdev0  Місяць тому +1

      noted✅, content coming soon

  • @funcreations4864
    @funcreations4864 Місяць тому +3

    Kon kon drop servicing wali didi ka ad dekha hai is video ko dekhne se pehle like here 😂😂

  • @user-by6oe1jl9j
    @user-by6oe1jl9j Місяць тому +1

    Recently i have found you. your all videos are amazing sir, please bring a microservice video on node js with aws it will be so helpful. thanks.

    • @sandeepdev0
      @sandeepdev0  Місяць тому

      Noted✅, will bring this content very soon

  • @ganeshgajelly
    @ganeshgajelly Місяць тому +1

    Amazing video.

  • @deepakyadav-ri2fv
    @deepakyadav-ri2fv 12 днів тому +1

    Impressive content and teaching style.
    Can you make some videos related to Kafka with real world example.

    • @sandeepdev0
      @sandeepdev0  11 днів тому

      Thank you and your suggestion Noted✅

  • @Bhide.Svelte
    @Bhide.Svelte Місяць тому +1

    bro you are god really i love it ...best explanation my friend, made by day

  • @tejassankhla1264
    @tejassankhla1264 Місяць тому +1

    Thanks much needed videos like these

  • @disharadadiya11
    @disharadadiya11 Місяць тому +3

    Please make a video on the payment gateway with node js please

    • @sandeepdev0
      @sandeepdev0  Місяць тому +1

      Noted✅, video will come soon on this topic

  • @ffgamer4140
    @ffgamer4140 Місяць тому +1

    Thank you very much😭 bro i really need this 😘

    • @sandeepdev0
      @sandeepdev0  Місяць тому

      Glad I could help😊 , it made my day

  • @RakeshSingh-vl2mz
    @RakeshSingh-vl2mz Місяць тому +1

    Thanks bro learnt alot

  • @ranjeetchoudhary8820
    @ranjeetchoudhary8820 Місяць тому +1

    Hello Sir,
    Could you please upload a video tutorial where you create an eCommerce REST API similar to Walmart using Node.js, Redis, and Express.js? The tutorial should cover authentication and all other key points typically followed by the industry.

    • @sandeepdev0
      @sandeepdev0  Місяць тому +1

      Actually good Idea, Will do work on this soon

  • @Superuser-r1y
    @Superuser-r1y Місяць тому +2

    Razorpay ka use krke nodejs me subscription api bano. 🙏

    • @sandeepdev0
      @sandeepdev0  Місяць тому

      Working on it bro✅, Next video will be on this and coming in just couple of days

  • @Superuser-r1y
    @Superuser-r1y Місяць тому +2

    New sub❤👍

    • @sandeepdev0
      @sandeepdev0  Місяць тому

      welcome in the community bro💓

  • @Paper_Mastery
    @Paper_Mastery Місяць тому +11

    one qustion well i can literally do that redies query but how will system know that user has updated query

    • @sarthaksingh6953
      @sarthaksingh6953 Місяць тому

      With the help of cdc

    • @sandeepdev0
      @sandeepdev0  Місяць тому +14

      Good question,
      Here is the detailed answer of your question on How to ensure Redis cache has most updated data
      1. Cache Invalidation on Update
      Whenever data is updated in the database, immediately invalidate or update the corresponding cache entry.
      Implementation Steps:
      Update the Database: Perform the update operation on the database.
      Invalidate Cache: Remove or update the relevant key in Redis.
      Example in Node.js:
      const redisClient = require('./redisClient'); // assuming you've set up your Redis client
      const db = require('./databaseClient'); // your database client
      async function updateData(id, newData) {
      // Update the database
      await db.update(id, newData);
      // Invalidate the cache
      await redisClient.del(`data:${id}`);
      }
      async function getData(id) {
      // Check the cache first
      let cachedData = await redisClient.get(`data:${id}`);
      if (cachedData) {
      return JSON.parse(cachedData);
      }
      // If not in cache, fetch from the database
      let data = await db.get(id);
      // Store in cache for future requests
      await redisClient.set(`data:${id}`, JSON.stringify(data));
      return data;
      }
      2. Write-Through Cache
      When updating data, write the new data to both the database and the cache simultaneously.
      Example in Node.js:
      async function updateData(id, newData) {
      // Update the database
      await db.update(id, newData);
      // Update the cache
      await redisClient.set(`data:${id}`, JSON.stringify(newData));
      }
      3. Cache with Expiry (TTL)
      Set a time-to-live (TTL) for cache entries. This ensures that even if cache invalidation is missed, the stale data will eventually expire and be refreshed from the database.
      Example in Node.js:
      async function getData(id) {
      let cachedData = await redisClient.get(`data:${id}`);
      if (cachedData) {
      return JSON.parse(cachedData);
      }
      let data = await db.get(id);
      // Store data with an expiry time (e.g., 60 seconds)
      await redisClient.setex(`data:${id}`, 60, JSON.stringify(data));
      return data;
      }
      4. Event-Driven Cache Invalidation
      Use events to trigger cache invalidation. Whenever the database updates, it emits an event that listeners (like the cache layer) can act upon.
      Example with Event Emitters:
      const EventEmitter = require('events');
      const cacheInvalidationEmitter = new EventEmitter();
      cacheInvalidationEmitter.on('dataUpdated', async (id) => {
      await redisClient.del(`data:${id}`);
      });
      async function updateData(id, newData) {
      await db.update(id, newData);
      cacheInvalidationEmitter.emit('dataUpdated', id);
      }
      By using one or a combination of these strategies, you can ensure that your Redis cache reflects the latest data from your database.
      Hope this answer will resolve your query, if not? feel free to ask here again and I will make a proper practical video on your boubt and will ensure you will get a proper answer😊

    • @iUmerFarooq
      @iUmerFarooq Місяць тому +2

      @@sandeepdev0 Bhai mera be same he question tha. Ap es pher ek video he bana do Part2.
      Shukriya

    • @gangitlaraju9322
      @gangitlaraju9322 Місяць тому +1

      Need video

    • @Paper_Mastery
      @Paper_Mastery Місяць тому

      @@sandeepdev0 nice 🙂 very soon I will be asking some more but currently little busy at ts learning

  • @jaydeep7932
    @jaydeep7932 Місяць тому +1

    great work bro 🤟

  • @flutterdeveloper
    @flutterdeveloper Місяць тому

    I think client side caching is better using next js or react query

  • @harshhrathore
    @harshhrathore Місяць тому +1

    great video!!

  • @ayushgandhi577
    @ayushgandhi577 Місяць тому +2

    I like your video but I'm looking for advanced projects
    For example - project-based on node.js typescript mongodb redis aws

    • @sandeepdev0
      @sandeepdev0  Місяць тому +1

      Advanced Full stack project tutorials - 1 shot videos coming soon

  • @flutterdeveloper
    @flutterdeveloper Місяць тому +1

    But i guess there has to be some mechanism to invalidate the data after sometime manually

    • @sandeepdev0
      @sandeepdev0  Місяць тому

      there is TTL in Redis which will invalidate the data after fixed time which we set,
      But there are some other really great approaches in Redis like:
      1. Event Driven approach
      2. Polling
      3. Invalidation on updation of data
      4. Hybrid approaches

  • @JatinGupta-ze6nc
    @JatinGupta-ze6nc Місяць тому +1

    guruji kha the ap apkw charan kha hai mai kitna darta tha ye soch k kya hai ye aj smjh aya

    • @sandeepdev0
      @sandeepdev0  Місяць тому

      I'm really glad that you have liked this video. One of the best comment on my channel ever😅,
      Also comment down on what topics you want the next videos on☺️

  • @rushikeshbhumkar8474
    @rushikeshbhumkar8474 Місяць тому +1

    super brooo

  • @rushikeshbhumkar8474
    @rushikeshbhumkar8474 Місяць тому +1

    thank you

  • @vammotv5183
    @vammotv5183 Місяць тому +1

    This video got me to subscribed, amazing content and I have a question how much data I can store on redis? and also Instagram where storing cashed data

    • @sandeepdev0
      @sandeepdev0  Місяць тому +1

      Hey vammotv, first of all thanks for subscribing and joining our valuable community. Here is the short answer of your questions:
      How Much Data Can You Store in Redis?
      The amount of data you can store in Redis is limited by the available RAM on your server. For larger datasets, Redis Cluster allows sharding across multiple nodes to increase capacity.
      Also Redis provides various data structure which can be used for efficient data storing
      Instagram's Caching Strategy
      Although Instagram's real architecture isn't public fully, But through my research I got top know Instagram uses in-memory caches like Redis and Memcached for frequently accessed data, and CDNs for static assets. They also optimize databases and use a microservices architecture to handle large-scale data efficiently.
      Hope these answers were able to resolve your queries, if not? feel free to ask here again and I will try my best to make video on your questions and answer them propely and in-depth😊

    • @vammotv5183
      @vammotv5183 Місяць тому +1

      @@sandeepdev0 Please tell me how can I write like this and you know every linkedin post they are posting like this and I am unable to write like this and I search a lot and last I am unable to find how can I write content on post plz make a detailed video and I will share lot of my friends and please explain in detail, please make video ASAP

  • @typesoffun
    @typesoffun Місяць тому +1

    Keep it up bro ❤..

  • @AyushGupta-ux4gq
    @AyushGupta-ux4gq Місяць тому +2

    isn't similar to memoisation concept ?

    • @sandeepdev0
      @sandeepdev0  Місяць тому

      Yes Ayush, you are absolutely right ✅

  • @vammotv5183
    @vammotv5183 Місяць тому +1

    Please tell me how can I write like this and you know every linkedin post they are posting like this and I am unable to write like this and I search a lot and last I am unable to find how can I write content on post plz make a detailed video and I will share lot of my friends and please explain in detail, please make video ASAP

    • @sandeepdev0
      @sandeepdev0  Місяць тому

      Hey bro, first of all, thanks for commenting, but sorry I didn't get your query, Can you explain to me a bit more and with clarity what you are exactly asking?

  • @divyanshurawat2422
    @divyanshurawat2422 8 днів тому

    I am using upstash with reddis, my backend in node.js is deployed on vercel, but speed not increased

    • @sandeepdev0
      @sandeepdev0  7 днів тому

      make sure your logic for data fetching from Redis and data saving in Redis is correct

  • @anuragsidhu7863
    @anuragsidhu7863 Місяць тому +2

    In production how its going to work . When i stop docker , redis will not work .

    • @sandeepdev0
      @sandeepdev0  Місяць тому

      In production, There are various ways, like you can use Redis cloud, where Redis is hosted on the cloud or you can host Redis on your server as well, for example on AWS EC2 using the same docker image, and also AWS, Azure, etc. (famous cloud providers) provides Redis cloud in their services which are usually used in production.
      Hope this answer has resolved your query if not? feel free to ask in the comments section

    • @anuragsidhu7863
      @anuragsidhu7863 Місяць тому

      How about upstash . For production

    • @anuragsidhu7863
      @anuragsidhu7863 Місяць тому +1

      @@sandeepdev0 ​ How about upstash for production

    • @sandeepdev0
      @sandeepdev0  Місяць тому

      Yes, upstash also can be used in production. Its also great👌

    • @anuragsidhu7863
      @anuragsidhu7863 Місяць тому

      @@sandeepdev0 thanks 👍

  • @shantanunimkar4471
    @shantanunimkar4471 Місяць тому +1

    Really amazing video bro , but I have a question, how can I ensure that when data is updated in the database, subsequent requests to the same route do not return stale data from Redis cache but instead fetch the updated data from the database?

    • @sandeepdev0
      @sandeepdev0  Місяць тому +2

      Good question,
      Here is the detailed answer on how you can ensure Redis always have updated data from database:
      👇👇
      There are various techniques like:
      1. Cache Invalidation on Update
      Whenever data is updated in the database, immediately invalidate or update the corresponding cache entry.
      Implementation Steps:
      Update the Database: Perform the update operation on the database.
      Invalidate Cache: Remove or update the relevant key in Redis.
      Example in Node.js:
      javascript
      const redisClient = require('./redisClient'); // assuming you've set up your Redis client
      const db = require('./databaseClient'); // your database client
      async function updateData(id, newData) {
      // Update the database
      await db.update(id, newData);
      // Invalidate the cache
      await redisClient.del(`data:${id}`);
      }
      async function getData(id) {
      // Check the cache first
      let cachedData = await redisClient.get(`data:${id}`);
      if (cachedData) {
      return JSON.parse(cachedData);
      }
      // If not in cache, fetch from the database
      let data = await db.get(id);
      // Store in cache for future requests
      await redisClient.set(`data:${id}`, JSON.stringify(data));
      return data;
      }
      2. Write-Through Cache
      When updating data, write the new data to both the database and the cache simultaneously.
      Example in Node.js:
      async function updateData(id, newData) {
      // Update the database
      await db.update(id, newData);
      // Update the cache
      await redisClient.set(`data:${id}`, JSON.stringify(newData));
      }
      3. Cache with Expiry (TTL)
      Set a time-to-live (TTL) for cache entries. This ensures that even if cache invalidation is missed, the stale data will eventually expire and be refreshed from the database.
      Example in Node.js:
      async function getData(id) {
      let cachedData = await redisClient.get(`data:${id}`);
      if (cachedData) {
      return JSON.parse(cachedData);
      }
      let data = await db.get(id);
      // Store data with an expiry time (e.g., 60 seconds)
      await redisClient.setex(`data:${id}`, 60, JSON.stringify(data));
      return data;
      }
      4. Event-Driven Cache Invalidation
      Use events to trigger cache invalidation. Whenever the database updates, it emits an event that listeners (like the cache layer) can act upon.
      Example with Event Emitters:
      const EventEmitter = require('events');
      const cacheInvalidationEmitter = new EventEmitter();
      cacheInvalidationEmitter.on('dataUpdated', async (id) => {
      await redisClient.del(`data:${id}`);
      });
      async function updateData(id, newData) {
      await db.update(id, newData);
      cacheInvalidationEmitter.emit('dataUpdated', id);
      }
      By using one or a combination of these strategies, you can ensure that your Redis cache reflects the latest data from your database.
      I hope this answer will resolve your query, if not? feel free to ask in comments section and I will make dedicated video on this topic and practically explain you how you can ensure Redis cache have most updated data

    • @sandeepdev0
      @sandeepdev0  Місяць тому +1

      Good question,
      Here is the detailed answer of your question on How to ensure Redis cache has most updated data
      1. Cache Invalidation on Update
      Whenever data is updated in the database, immediately invalidate or update the corresponding cache entry.
      Implementation Steps:
      Update the Database: Perform the update operation on the database.
      Invalidate Cache: Remove or update the relevant key in Redis.
      Example in Node.js:
      const redisClient = require('./redisClient'); // assuming you've set up your Redis client
      const db = require('./databaseClient'); // your database client
      async function updateData(id, newData) {
      // Update the database
      await db.update(id, newData);
      // Invalidate the cache
      await redisClient.del(`data:${id}`);
      }
      async function getData(id) {
      // Check the cache first
      let cachedData = await redisClient.get(`data:${id}`);
      if (cachedData) {
      return JSON.parse(cachedData);
      }
      // If not in cache, fetch from the database
      let data = await db.get(id);
      // Store in cache for future requests
      await redisClient.set(`data:${id}`, JSON.stringify(data));
      return data;
      }
      2. Write-Through Cache
      When updating data, write the new data to both the database and the cache simultaneously.
      Example in Node.js:
      async function updateData(id, newData) {
      // Update the database
      await db.update(id, newData);
      // Update the cache
      await redisClient.set(`data:${id}`, JSON.stringify(newData));
      }
      3. Cache with Expiry (TTL)
      Set a time-to-live (TTL) for cache entries. This ensures that even if cache invalidation is missed, the stale data will eventually expire and be refreshed from the database.
      Example in Node.js:
      async function getData(id) {
      let cachedData = await redisClient.get(`data:${id}`);
      if (cachedData) {
      return JSON.parse(cachedData);
      }
      let data = await db.get(id);
      // Store data with an expiry time (e.g., 60 seconds)
      await redisClient.setex(`data:${id}`, 60, JSON.stringify(data));
      return data;
      }
      4. Event-Driven Cache Invalidation
      Use events to trigger cache invalidation. Whenever the database updates, it emits an event that listeners (like the cache layer) can act upon.
      Example with Event Emitters:
      const EventEmitter = require('events');
      const cacheInvalidationEmitter = new EventEmitter();
      cacheInvalidationEmitter.on('dataUpdated', async (id) => {
      await redisClient.del(`data:${id}`);
      });
      async function updateData(id, newData) {
      await db.update(id, newData);
      cacheInvalidationEmitter.emit('dataUpdated', id);
      }
      By using one or a combination of these strategies, you can ensure that your Redis cache reflects the latest data from your database.
      Hope this answer will resolve your query, if not? feel free to ask here again and I will make a proper practical video on your boubt and will ensure you will get a proper answer😊

    • @shantanunimkar4471
      @shantanunimkar4471 Місяць тому

      @@sandeepdev0 Thank you 😁

  • @HelooAapKaun
    @HelooAapKaun Місяць тому +1

    nice video , btw which vs code extension u use that autocompletes ur code ??

    • @ffgamer4140
      @ffgamer4140 Місяць тому +1

      codium ai

    • @sandeepdev0
      @sandeepdev0  Місяць тому +1

      Actually I use github copilot, but if you want same or better for absolutely free you can go for codium ai

  • @NomiChak
    @NomiChak Місяць тому

    How about use redis on cpanel?

  • @DivineVibesHindus
    @DivineVibesHindus 26 днів тому +1

    how to check if data is changed

    • @sandeepdev0
      @sandeepdev0  25 днів тому

      There are several techniques to do this, Hard to explain here... I am making a proper video on it

    • @DivineVibesHindus
      @DivineVibesHindus 25 днів тому

      @@sandeepdev0 please make a video its important if i am use radis in my project

  • @LOLlol-kw5fo
    @LOLlol-kw5fo Місяць тому +1

    What about accounting software there data needs to be real-time

    • @sandeepdev0
      @sandeepdev0  Місяць тому

      Redis Pub/Sub can be used in these types of softwares

  • @rnp0728
    @rnp0728 Місяць тому +1

    What if my data comes from database and it changes continuously?

    • @rnp0728
      @rnp0728 Місяць тому +1

      Atleast reply don't just like the comments

    • @sandeepdev0
      @sandeepdev0  Місяць тому +1

      If your data changes continuously, you need a robust caching strategy to ensure data consistency while minimizing the performance impact. Here are some approaches:
      1. Event-Driven Updates
      Emit events on data changes and have the cache update itself based on those events.
      Example with Event Emitters:
      const EventEmitter = require('events');
      const cacheUpdateEmitter = new EventEmitter();
      cacheUpdateEmitter.on('dataUpdated', async (id, newData) => {
      await redisClient.set(`data:${id}`, JSON.stringify(newData));
      });
      async function updateData(id, newData) {
      await db.update(id, newData);
      cacheUpdateEmitter.emit('dataUpdated', id, newData);
      }
      2. Polling
      Periodically poll the database for changes and update the cache accordingly.
      Example:
      async function pollAndUpdateCache(id) {
      setInterval(async () => {
      let data = await db.get(id);
      await redisClient.set(`data:${id}`, JSON.stringify(data));
      }, 5000); // Poll every 5 seconds
      }
      5. Hybrid Approach
      Combine several strategies for optimal performance and consistency.
      By implementing one or a combination of these strategies, you can handle continuously changing data effectively while maintaining cache consistency.

    • @sandeepdev0
      @sandeepdev0  Місяць тому +1

      In some cases like Chat Apps where messages are sent in realtime , you can utilize Redis Pub Sub for optimize the performance

    • @sandeepdev0
      @sandeepdev0  Місяць тому +1

      Sorry bro for late replying, thanks for waiting, here I have given the answer, but if you still have more questions, want more clarity upon answers, feel free to comment here, I will make a dedicated practical video for resolving your queries😊

    • @rnp0728
      @rnp0728 Місяць тому +1

      @@sandeepdev0 thanks, will try to implement once, then I will get back to you

  • @wasimzaman674
    @wasimzaman674 Місяць тому

    Different APIs k liye different caching Karne se Radis ki wajah se memory leak nahi hogi ?

    • @sandeepdev0
      @sandeepdev0  Місяць тому

      When using Redis, it is crucial to follow best practices to ensure there are no memory leaks:
      1. Use the LRU eviction policy to automatically remove the least recently used entries when memory limits are reached.
      2. Set TTL (Time-to-Live) for each cache entry to automatically remove stale data.
      3. Set memory limits to prevent Redis from consuming excessive memory.
      4. Implement cache segmentation to manage memory usage more effectively by using distinct keys for different APIs.
      5. And make sure to use effective data structure according to your system/data need, because Redis supports a variety of data structures to manage data effectively.

  • @JourneyOfCricket
    @JourneyOfCricket Місяць тому +3

    But if we want real-time data then?

  • @swapnilpatel3337
    @swapnilpatel3337 Місяць тому

    Schema to diffrence hogi jab ki microservice pe kam karta he instagram to db bhi alg he

    • @sandeepdev0
      @sandeepdev0  Місяць тому +1

      yes you are right, but I also said that this is just an example and its not the actual and real architecture of Instagram. That was just a simple example to make everyone understand the problem solved by Redis.

    • @sandeepdev0
      @sandeepdev0  Місяць тому +1

      But thanks for commenting on the video☺️

    • @swapnilpatel3337
      @swapnilpatel3337 Місяць тому +1

      @sandeepdev0 thank you sir...

  • @jayantgupta5310
    @jayantgupta5310 Місяць тому +1

    Bhai ye thoda music dhang ka use kiya kr, baki sb theek hai

    • @sandeepdev0
      @sandeepdev0  Місяць тому

      Got it bro, I will be careful next time☺️

  • @vammotv5183
    @vammotv5183 Місяць тому

    Bro, see my comments you can understand what I am telling