A flexible rate limiter configurable with different variations of the Token Bucket algorithm, with hierarchy support, and optional persistence in Redis. Useful for limiting API requests, or other tasks that need to be throttled.
Author: Jesús Carrera @jesucarr - frontendmatters.com
Installation
npm install tokenbucket
Example
Require the library
var TokenBucket = require('tokenbucket');Create a new tokenbucket instance. See below for possible options.
var tokenBucket = new TokenBucket();The class that the module exports and that instantiate a new token bucket with the given options.
Params
- [options]
Object- The options object- [.size]
Number= 1- Maximum number of tokens to hold in the bucket. Also known as the burst size. - [.tokensToAddPerInterval]
Number= 1- Number of tokens to add to the bucket in one interval. - [.interval]
Number|String= 1000- The time passing between adding tokens, in milliseconds or as one of the following strings: 'second', 'minute', 'hour', day'. - [.lastFill]
Number- The timestamp of the last time when tokens where added to the bucket (last interval). - [.tokensLeft]
Number= size- By default it will initialize full of tokens, but you can set here the number of tokens you want to initialize it with. - [.spread]
Boolean= false- By default it will wait the interval, and then add all the tokensToAddPerInterval at once. If you set this to true, it will insert fractions of tokens at any given time, spreading the token addition along the interval. - [.maxWait]
Number|String- The maximum time that we would wait for enough tokens to be added, in milliseconds or as one of the following strings: 'second', 'minute', 'hour', day'. If any of the parents in the hierarchy hasmaxWait, we will use the smallest value. - [.parentBucket]
TokenBucket- A token bucket that will act as the parent of this bucket. Tokens removed in the children, will also be removed in the parent, and if the parent reach its limit, the children will get limited too. - [.redis]
Object- Options object for Redis- .bucketName
String- The name of the bucket to reference it in Redis. This is the only required field to set Redis persistance. ThebucketNamefor each bucket must be unique. - [.redisClient]
redisClient- The Redis client to save the bucket. - [.redisClientConfig]
Object- Redis client configuration to create the Redis client and save the bucket. If theredisClientoption is set, this option will be ignored.- [.port]
Number= 6379- The connection port for the Redis client. See configuration instructions. - [.host]
String= '127.0.0.1'- The connection host for the Redis client. See configuration instructions - [.unixSocket]
String- The connection unix socket for the Redis client. See configuration instructions - [.options]
String- The options for the Redis client. See configuration instructions
- [.port]
- .bucketName
- [.size]
This options will be properties of the class instances. The properties tokensLeft and lastFill will get updated when we add/remove tokens.
Example
A filled token bucket that can hold 100 tokens, and it will add 30 tokens every minute (all at once).
var tokenBucket = new TokenBucket({
size: 100,
tokensToAddPerInterval: 30,
interval: 'minute'
});An empty token bucket that can hold 1 token (default), and it will add 1 token (default) every 500ms, spreading the token addition along the interval (so after 250ms it will have 0.5 tokens).
var tokenBucket = new TokenBucket({
tokensLeft: 0,
interval: 500,
spread: true
});A token bucket limited to 15 requests every 15 minutes, with a parent bucket limited to 1000 requests every 24 hours. The maximum time that we are willing to wait for enough tokens to be added is one hour.
var parentTokenBucket = new TokenBucket({
size: 1000,
interval: 'day'
});
var tokenBucket = new TokenBucket({
size: 15,
tokensToAddPerInterval: 15,
interval: 'minute',
maxWait: 'hour',
parentBucket: parentBucket
});A token bucket limited to 15 requests every 15 minutes, with a parent bucket limited to 1000 requests every 24 hours. The maximum time that we are willing to wait for enough tokens to be added is 5 minutes.
var parentTokenBucket = new TokenBucket({
size: 1000,
interval: 'day'
maxWait: 1000 * 60 * 5,
});
var tokenBucket = new TokenBucket({
size: 15,
tokensToAddPerInterval: 15,
interval: 'minute',
parentBucket: parentBucket
});A token bucket with Redis persistance setting the redis client.
redis = require('redis');
redisClient = redis.redisClient();
var tokenBucket = new TokenBucket({
redis: {
bucketName: 'myBucket',
redisClient: redisClient
}
});A token bucket with Redis persistance setting the redis configuration.
var tokenBucket = new TokenBucket({
redis: {
bucketName: 'myBucket',
redisClientConfig: {
host: 'myhost',
port: 1000,
options: {
auth_pass: 'mypass'
}
}
}
});Note that setting both redisClient or redisClientConfig, the redis client will be exposed at tokenBucket.redis.redisClient.
This means you can watch for redis events, or execute redis client functions.
For example if we want to close the redis connection we can execute tokenBucket.redis.redisClient.quit().
tokenBucket.removeTokens(tokensToRemove) ⇒ Promise
Remove the requested number of tokens. If the bucket (and any parent buckets) contains enough tokens this will happen immediately. Otherwise, it will wait to get enough tokens.
Kind: instance method of TokenBucket
Fulfil: Number - The remaining tokens number, taking into account the parent if it has it.
Reject: Error - Operational errors will be returned with the following name property, so they can be handled accordingly:
'NotEnoughSize'- The requested tokens are greater than the bucket size.'NoInfinityRemoval'- It is not possible to remove infinite tokens, because even if the bucket has infinite size, thetokensLeftwould be indeterminant.'ExceedsMaxWait'- The time we need to wait to be able to remove the tokens requested exceed the time set inmaxWaitconfiguration (parent or child).
.
Params
- tokensToRemove
Number- The number of tokens to remove.
Example
We have some code that uses 3 API requests, so we would need to remove 3 tokens from our rate limiter bucket.
If we had to wait more than the specified maxWait to get enough tokens, we would handle that in certain way.
tokenBucket.removeTokens(3).then(function(remainingTokens) {
console.log('10 tokens removed, ' + remainingTokens + 'tokens left');
// make triple API call
}).catch(function (err) {
console.log(err)
if (err.name === 'ExceedsMaxWait') {
// do something to handle this specific error
}
});Attempt to remove the requested number of tokens and return inmediately.
Kind: instance method of TokenBucket
Returns: Boolean - If it could remove the tokens inmediately it will return true, if not possible or needs to wait, it will return false.
Params
- tokensToRemove
Number- The number of tokens to remove.
Example
if (tokenBucket.removeTokensSync(50)) {
// the tokens were removed
} else {
// the tokens were not removed
}tokenBucket.save() ⇒ Promise
Saves the bucket lastFill and tokensLeft to Redis. If it has any parents with redis options, they will get saved too.
Kind: instance method of TokenBucket
Fulfil: true
Reject: Error - If we call this function and we didn't set the redis options, the error will have 'NoRedisOptions' as the name property, so it can be handled specifically.
If there is an error with Redis it will be rejected with the error returned by Redis.
Example
We have a worker process that uses 1 API requests, so we would need to remove 1 token (default) from our rate limiter bucket.
If we had to wait more than the specified maxWait to get enough tokens, we would end the worker process.
We are saving the bucket state in Redis, so we first load from Redis, and before exiting we save the updated bucket state.
Note that if it had parent buckets with Redis options set, they would get saved too.
tokenBucket.loadSaved().then(function () {
// now the bucket has the state it had last time we saved it
return tokenBucket.removeTokens().then(function() {
// make API call
});
}).catch(function (err) {
if (err.name === 'ExceedsMaxWait') {
tokenBucket.save().then(function () {
process.kill(process.pid, 'SIGKILL');
}).catch(function (err) {
if (err.name == 'NoRedisOptions') {
// do something to handle this specific error
}
});
}
});tokenBucket.loadSaved() ⇒ Promise
Loads the bucket lastFill and tokensLeft as it was saved in Redis. If it has any parents with redis options, they will get loaded too.
Kind: instance method of TokenBucket
Fulfil: true
Reject: Error - If we call this function and we didn't set the redis options, the error will have 'NoRedisOptions' as the name property, so it can be handled specifically.
If there is an error with Redis it will be rejected with the error returned by Redis.
Example
See save
npm test
The source code is in CoffeeScript, to compile automatically when you save, run
gulp
Documentation is inline, using jsdoc-to-markdown. To update the README.md file just run
gulp doc
Contributions are welcome! Pull requests should have 100% code coverage.
Originally inspired by limiter.
The MIT License (MIT)
Copyright 2015 Jesús Carrera - frontendmatters.com
Permission is hereby granted, free of charge, to any person obtaining a copy of this software and associated documentation files (the "Software"), to deal in the Software without restriction, including without limitation the rights to use, copy, modify, merge, publish, distribute, sublicense, and/or sell copies of the Software, and to permit persons to whom the Software is furnished to do so, subject to the following conditions:
The above copyright notice and this permission notice shall be included in all copies or substantial portions of the Software.
THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE.