Soft Throttling: In this type, we can set the API request limit to exceed a certain percentage. For example, if we have rate-limit of 100 messages a minute and 10% exceed-limit, our rate limiter will allow up to 110 messages per minute.
how is it different from just hard throttling with rate limit of 110 messages/minute?
Hi @Dewey_Munoz
In hard throttling, we will be strict with the limit. If we have defined 100 messages per minute then only 100 messages will be allowed and messages exceeding this limit would be discarded.
Soft throttling can also be strict. If we have a soft limit of 90 messages and a 10% exceed limit, it will have the same behavior that you describe. Only 100 messages will be allowed and messages exceeding this limit would be discarded.
The main difference between hard and soft should be that soft can be temporarily exceeded.