How to configure rate limiter in Istio

In this video, you'll learn how to configure rate limiting on workloads running inside the Istio service mesh.
As Istio doesn't have a dedicated Custom Resource Definition (CRD) that we could use to configure rate limiting, we'll use EnvoyFilter resource to configure the rate limiter feature inside the Envoy proxy.
You can find the accompanying YAML files here: www.learncloud...
🆕 For configuring global rate limiter in Istio, check out this article: www.learncloud...
If you like the video, consider subscribing: / peterjausovec
▬▬▬▬▬▬ Connect with me ▬▬▬▬▬▬
➡️ Newsletter: learncloudnati...
➡️ Twitter: / pjausovec
➡️ LinkedIn: / pjausovec

[@MohitSharma-x7c]

Hi Peter, very nice and informative video. I have implemented global ratelimiter using ratelimit service and redis service and it is working fine. But it has single cm containing all the urls we need to ratelimit. I am running multiple pods in which multiple services are exposed and each pod has 40-50 urls. Now, i want to maintain multiple configmaps containing urls podwise. Is it possible to use multiple cm in global ratelimit?

[@learncloudnative]

There's a configuration setting called MERGE_DOMAIN_CONFIG that will merge multiple configuration files -- check the docs here: github.com/envoyproxy/ratelimit?tab=readme-ov-file#file-based-configuration-loading

[@hubertsiwik6065]

Looking forward to the article about global rate limiter ;)
Let me ask if you recommend any materials where I could get to know how to apply descriptors into global RL. The reason I would like to do that is to retain a limited number of requests sent to ratelimit+Redis. By and large, rough filtering with descriptors applied to global RT (ingress-gateway is being applied local rate limiting), fine filtering by decision taken from ratelimit service.

[@learncloudnative]

The local rate limit Envoy doc has the info on the descriptors: www.envoyproxy.io/docs/envoy/latest/configuration/http/http_filters/local_rate_limit_filter#config-http-filters-local-rate-limit
Even though it talks about it in the context of the local rate limit, the configuration is similar. There's also examples in the repo where the rate limiting service implementation is at: github.com/envoyproxy/ratelimit

[@luv-nnd]

Love it! but can you make one for global rate limiting as local rate limiting is only for one pod, but normally we will have multiple pods for one service.

[@learncloudnative]

I am in process of writing an article about global RL. Video might come a bit later :)

[@luv-nnd]

@@learncloudnative Thank you! That would be great helpful!

[@lavnemesis123]

thanks a lot. Much needed article on GRL. Appreciate it.

[@learncloudnative]

Glad it was helpful!

[@ravicheviti]

is there a way to setup rate limiting per ip based. Means We want to limit number of request from a client ip. 100 request for 1 mins. any help?

[@learncloudnative]

You can do that with global rate limiting (requires Redis and rate limiting service); then you can use the remote_address in configuration to create descriptors per-IP. I'll have an article/video on the global rate limiting hopefully soon :)

[@hubertsiwik6065]

Let me add that omitting the value key in the descriptor makes each IP get its own bucket.

[@learncloudnative]

@@hubertsiwik6065 exactly! and that's typically one of the use cases

[@rebelmoon-aj]

thank you. this is pretty awesome

[@learncloudnative]

Glad you like it!