Speed up your MySQL database with the buffer pool

Поділитися
Вставка
  • Опубліковано 10 гру 2024

КОМЕНТАРІ • 42

  • @aFfoochen
    @aFfoochen 19 днів тому

    Thank you so much for this video. Really high quliaty and direct to the point. Learned a lot!

    • @PlanetScale
      @PlanetScale  19 днів тому

      Glad you got a lot out of it.

  • @vighnesh._
    @vighnesh._ 6 місяців тому

    Super helpful, was trying to get my head around what buffer pool is and how i could optimise the performance. Exactly what i needed to proceed. Thanks a ton!!!

  • @Ostap1974
    @Ostap1974 7 місяців тому +1

    Hope there will a followup video addressing other innodb_x config options. Preferably starting with brothers and sisters of the buffer_pool_size. There are some rules of thumb, but it is not overly trivial to get them right.

  • @ahmad-murery
    @ahmad-murery 7 місяців тому +3

    I hope you do more videos explaining some other useful configurations.
    Thanks Ben!

  • @NedumEze
    @NedumEze 7 місяців тому +1

    Wow! A stunner.
    Thanks a million.
    May I ask, is this possible via PHPMYADMIN? If yes, please, how?
    While I have your attention, is there a way to enlarge the max size of mysql database Tables? Again, in PHPMYADMIN interface.

    • @PlanetScale
      @PlanetScale  7 місяців тому +1

      To configure this value to can update it in the my.cnf file, like I show in the video. Looks like IMH recommends SSHing into your server to update it: www.inmotionhosting.com/support/server/databases/edit-mysql-my-cnf/

  • @MrThenewlion
    @MrThenewlion 10 днів тому

    Hii thank you for ur content, can you please share the python stress program or github url ?

  • @Smit-SundaramTech
    @Smit-SundaramTech 26 днів тому

    MySQL returning same select query result from buffer, where there is update query parallelly executing from client application, how to prevent this, so i can get updated result from mysql?

    • @PlanetScale
      @PlanetScale  26 днів тому

      Is the update and the select queries happening in a single transaction, or two separate ones? If the same, then just ensure you runt he update before the select. If the latter, you should ensure that the update transaction completed before you try to select the new data.
      If you are using PlanetScale (or something similar) and are updating on the primary and then selecting on a replica, there can be replica lag. In this case, you'd either have to live with it, or make both requests to your primary.

    • @Smit-SundaramTech
      @Smit-SundaramTech 26 днів тому

      @@PlanetScale I have multiple client connected with same DB table where counter field is getting updated first and then select query is being executed to get updated value, each client needs updated value but randomly on client PC I receiving old field value instead of updated one and when i fire query again in few seconds immediately its giving me updated value. How i can prevent this?

  • @swiftybase
    @swiftybase 7 місяців тому

    Does PlanetScale automatically configure the option based on your plan, or do you need to adjust it manually?

    • @PlanetScale
      @PlanetScale  7 місяців тому +1

      Correct! One of the many advantages of using a managed service :)

  • @shindohikaru8705
    @shindohikaru8705 7 місяців тому

    What is the tradeoff when increasing the values of innodb_buffer_pool_size and innodb_buffer_pool_chunk_size? Will it affect the server performance for other operations, such as creating indexes when a new record has been inserted?

    • @PlanetScale
      @PlanetScale  7 місяців тому +1

      Configuring mysql to use multiple puffer pol instances (via innodb_buffer_pool_instances and innodb_buffer_pool_chunk_size) causes mysql to create multiple pools. This can help reduce contention in situations where you have a lot of concurrent connections / queries executing, as the pages get divided up amongst the available buffer pools. The docs have some additional info that might help!
      dev.mysql.com/doc/refman/8.0/en/innodb-multiple-buffer-pools.html

    • @shindohikaru8705
      @shindohikaru8705 7 місяців тому

      thanks in advance for your answer 💯

  • @michailgiannopoulos5274
    @michailgiannopoulos5274 7 місяців тому

    Another key performance setting if you do not use replication and can afford to lose 1 sec of transactions in case of a server crash is to disable log_bin and set innodb_flush_log_at_trx_commit = 2

    • @PlanetScale
      @PlanetScale  7 місяців тому

      Great insight. Maybe this should be another video!

  • @SuperRockmate
    @SuperRockmate 7 місяців тому +1

    I hope you can make video about mysql router

    • @PlanetScale
      @PlanetScale  7 місяців тому +1

      As PlanetScale we use Vitess (vitess.io/) to handle query routing, high availability, etc. We recently made a video about what happens here so check this one out if interested! ua-cam.com/video/9FYedahsJxE/v-deo.html

    • @SuperRockmate
      @SuperRockmate 7 місяців тому

      @@PlanetScale thank you

  • @kamurashev
    @kamurashev 7 місяців тому +1

    It’s very workload dependent, you are only reading so you’re showing kind of best case scenario.
    If you also have mutations it would evict parts of cache so the result wouldn’t be as great.
    Needless to say except that detail it is very very relevant.
    Moreover I had opportunity to monitor a hardware MySQL server which were backing up a highly loaded web app before AWS migration and an RDS after one. The MySQL is so underestimated, with right config it was delivering sub ms for majority of queries. Later we had to add redis caching (to compensate for AWS RDS disadvantages) and even redis was for the very list not better than the hardware MySQL. I’d say for majority of cases MySQL was beating up redis. But RDS Aurora wasn’t even close. When we analyzed the most of it was coming from network delays. The back side of cloud services.

    • @PlanetScale
      @PlanetScale  7 місяців тому +2

      It definitely is workload dependent! For example, if you have a large data set but the vast majority of it is never queried, you might only need to size the buffer pool such that the hot pages can fit in memory, and then you'll be fine.

  • @ramialdarkazly1163
    @ramialdarkazly1163 7 місяців тому

    This is a great video

  • @TheMrBazil
    @TheMrBazil 7 місяців тому +21

    Better make a video of why you removed the free tier plan

    • @raglandasir6885
      @raglandasir6885 7 місяців тому +3

      They already explained in the blog post

    • @HollyGuevaraPS
      @HollyGuevaraPS 7 місяців тому

      What would you like to know? The amount infrastructure required for even our smallest possible database is quite costly. This video explains it well: ua-cam.com/video/9FYedahsJxE/v-deo.html

    • @TheMrBazil
      @TheMrBazil 7 місяців тому

      @@HollyGuevaraPS this is no explanation, other smaller companies also continue to have significant expenses with infrstructure and continue to be free tiers. It is a good thing that other companies similar to planetscale continue to offer super free tiers and it was easy to go there,

    • @HollyGuevaraPS
      @HollyGuevaraPS 7 місяців тому

      ​@@TheMrBazil Which companies? There was a lot of convo about this on Twitter recently and couple founders at other database companies said themselves that their free tier isn't a significant expense to them due to their architecture. I do wish we could offer a much cheaper tier, and it is something we're still discussing internally.

    • @dominiklessel835
      @dominiklessel835 7 місяців тому +4

      It's still dirt cheap for the value you get. I really don't understand why everyone feels entitled to get something for nothing these days. I'd rather have a viable DB provider than one that's burning money left and right.

  • @drT-g6p
    @drT-g6p 4 місяці тому

    Don't get me wrong, it's a great video. But i'm still a little bit disappointed because there is so many parameters to control the buffer cache and i was expecting more. Please remember that a "good" hit-ratio does not mean that your application is tuned.

    • @PlanetScale
      @PlanetScale  4 місяці тому

      Absolutely! This was a very simple benchmark. Real-world workloads are going to be much more complex, and you may need to do some deeper analysis to decide how to tune your buffer pool.
      If you use PlanetScale, we spin your DB up with it pre-tuned.

  • @otmanm4095
    @otmanm4095 7 місяців тому +1

    Niiiice!