1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
434
435
436
437
438
439
440
441
442
443
444
445
446
447
448
449
450
451
452
453
454
455
456
457
|
=encoding utf-8
=head1 Name
lua-resty-lrucache - Lua-land LRU cache based on the LuaJIT FFI.
=head1 Status
This library is considered production ready.
=head1 Synopsis
-- file myapp.lua: example "myapp" module
local _M = {}
-- alternatively: local lrucache = require "resty.lrucache.pureffi"
local lrucache = require "resty.lrucache"
-- we need to initialize the cache on the lua module level so that
-- it can be shared by all the requests served by each nginx worker process:
local c, err = lrucache.new(200) -- allow up to 200 items in the cache
if not c then
error("failed to create the cache: " .. (err or "unknown"))
end
function _M.go()
c:set("dog", 32)
c:set("cat", 56)
ngx.say("dog: ", c:get("dog"))
ngx.say("cat: ", c:get("cat"))
c:set("dog", { age = 10 }, 0.1) -- expire in 0.1 sec
c:delete("dog")
c:flush_all() -- flush all the cached data
end
return _M
# nginx.conf
http {
# only if not using an official OpenResty release
lua_package_path "/path/to/lua-resty-lrucache/lib/?.lua;;";
server {
listen 8080;
location = /t {
content_by_lua_block {
require("myapp").go()
}
}
}
}
=head1 Description
This library implements a simple LRU cache for
L<OpenResty|https://openresty.org> and the
L<ngx_lua|https://github.com/openresty/lua-nginx-module> module.
This cache also supports expiration time.
The LRU cache resides completely in the Lua VM and is subject to Lua GC. As
such, do not expect it to get shared across the OS process boundary. The upside
is that you can cache arbitrary complex Lua values (such as deep nested Lua
tables) without the overhead of serialization (as with C<ngx_lua>'s [shared
dictionary
API](https://github.com/openresty/lua-nginx-module#lua_shared_dict)).
The downside is that your cache is always limited to the current OS process
(i.e. the current Nginx worker process). It does not really make much sense to
use this library in the context of
L<init_by_lua|https://github.com/openresty/lua-nginx-module#lua_shared_dict>
because the cache will not get shared by any of the worker processes (unless
you just want to "warm up" the cache with predefined items which will get
inherited by the workers via C<fork()>).
This library offers two different implementations in the form of two classes:
C<resty.lrucache> and C<resty.lrucache.pureffi>. Both implement the same API.
The only difference is that the latter is a pure FFI implementation that also
implements an FFI-based hash table for the cache lookup, while the former uses
native Lua tables.
If the cache hit rate is relatively high, you should use the C<resty.lrucache>
class which is faster than C<resty.lrucache.pureffi>.
However, if the cache hit rate is relatively low and there can be a I<lot> of
variations of keys inserted into and removed from the cache, then you should
use the C<resty.lrucache.pureffi> instead, because Lua tables are not good at
removing keys frequently. You would likely see the C<resizetab> function call in
the LuaJIT runtime being very hot in [on-CPU flame
graphs](https://github.com/openresty/stapxx#lj-lua-stacks) if you use the
C<resty.lrucache> class instead of C<resty.lrucache.pureffi> in such a use case.
=head1 Methods
To load this library,
=over
=item 1.
use an official L<OpenResty release|https://openresty.org> or follow the
L<Installation> instructions.
=item 2.
use C<require> to load the library into a local Lua variable:
=back
local lrucache = require "resty.lrucache"
or
local lrucache = require "resty.lrucache.pureffi"
=head2 new
C<syntax: cache, err = lrucache.new(max_items [, load_factor])>
Creates a new cache instance. Upon failure, returns C<nil> and a string
describing the error.
The C<max_items> argument specifies the maximal number of items this cache can
hold.
The C<load-factor> argument designates the "load factor" of the FFI-based
hash-table used internally by C<resty.lrucache.pureffi>; the default value is
0.5 (i.e. 50%); if the load factor is specified, it will be clamped to the
range of C<[0.1, 1]> (i.e. if load factor is greater than 1, it will be
saturated to 1; likewise, if load-factor is smaller than C<0.1>, it will be
clamped to C<0.1>). This argument is only meaningful for
C<resty.lrucache.pureffi>.
=head2 set
C<syntax: cache:set(key, value, ttl?, flags?)>
Sets a key with a value and an expiration time.
When the cache is full, the cache will automatically evict the least recently
used item.
The optional C<ttl> argument specifies the expiration time. The time value is in
seconds, but you can also specify the fraction number part (e.g. C<0.25>). A nil
C<ttl> argument means the value would never expire (which is the default).
The optional C<flags> argument specifies a user flags value associated with the
item to be stored. It can be retrieved later with the item. The user flags are
stored as an unsigned 32-bit integer internally, and thus must be specified as
a Lua number. If not specified, flags will have a default value of C<0>. This
argument was added in the C<v0.10> release.
=head2 get
C<syntax: data, stale_data, flags = cache:get(key)>
Fetches a value with the key. If the key does not exist in the cache or has
already expired, C<nil> will be returned.
Starting from C<v0.03>, the stale data is also returned as the second return
value if available.
Starting from C<v0.10>, the user flags value associated with the stored item is
also returned as the third return value. If no user flags were given to an
item, its default flags will be C<0>.
=head2 delete
C<syntax: cache:delete(key)>
Removes an item specified by the key from the cache.
=head2 count
C<syntax: count = cache:count()>
Returns the number of items currently stored in the cache B<including>
expired items if any.
The returned C<count> value will always be greater or equal to 0 and smaller
than or equal to the C<size> argument given to L<`cache:new`>.
This method was added in the C<v0.10> release.
=head2 capacity
C<syntax: size = cache:capacity()>
Returns the maximum number of items the cache can hold. The return value is the
same as the C<size> argument given to L<`cache:new`> when the cache was
created.
This method was added in the C<v0.10> release.
=head2 get_keys
C<syntax: keys = cache:get_keys(max_count?, res?)>
Fetch the list of keys currently inside the cache up to C<max_count>. The keys
will be ordered in MRU fashion (Most-Recently-Used keys first).
This function returns a Lua (array) table (with integer keys) containing the
keys.
When C<max_count> is C<nil> or C<0>, all keys (if any) will be returned.
When provided with a C<res> table argument, this function will not allocate a
table and will instead insert the keys in C<res>, along with a trailing C<nil>
value.
This method was added in the C<v0.10> release.
=head2 flush_all
C<syntax: cache:flush_all()>
Flushes all the existing data (if any) in the current cache instance. This is
an C<O(1)> operation and should be much faster than creating a brand new cache
instance.
Note however that the C<flush_all()> method of C<resty.lrucache.pureffi> is an
C<O(n)> operation.
=head1 Prerequisites
=over
=item *
L<LuaJIT|http://luajit.org> 2.0+
=item *
L<ngx_lua|https://github.com/openresty/lua-nginx-module> 0.8.10+
=back
=head1 Installation
It is recommended to use the latest L<OpenResty release|https://openresty.org>.
At least OpenResty 1.4.2.9 is required. Recent versions of OpenResty only
support LuaJIT, but if you are using an older version, make sure to enable
LuaJIT when building OpenResty by passing the C<--with-luajit> option to its
C<./configure> script. No extra Nginx configuration is required.
If you want to use this library with your own Nginx build (with ngx_lua), then
you need to ensure you are using ngx_lua 0.8.10 or greater.
By default, ngx_lua will search Lua files in /usr/local/share/lua/5.1/.
But C<make install> will install this module to /usr/local/lib/lua.
So you may find the error like this:
nginx: [alert] failed to load the 'resty.lrucache' module
You can install this module with the following command to resolve the above problem.
cd lua-resty-lrucache
sudo make install LUA_LIB_DIR=/usr/local/share/lua/5.1
You can also change the installation directory to any other directory you like with the LUA_LIB_DIR argument.
cd lua-resty-lrucache
sudo make install LUA_LIB_DIR=/opt/nginx/lualib
When not installed in /usr/local/share/lua/5.1, you also need to configure the
L<lua_package_path|https://github.com/openresty/lua-nginx-module#lua_package_path>
directive to add the path to your lua-resty-lrucache source tree to ngx_lua's
Lua module search path, as in:
# nginx.conf
http {
lua_package_path "/opt/nginx/lualib/?.lua;;";
...
}
and then load the library in Lua:
local lrucache = require "resty.lrucache"
=head1 Community
=head2 English Mailing List
The L<openresty-en|https://groups.google.com/group/openresty-en> mailing list
is for English speakers.
=head2 Chinese Mailing List
The L<openresty|https://groups.google.com/group/openresty> mailing list is for
Chinese speakers.
=head1 Bugs and Patches
Please report bugs or submit patches by
=over
=item 1.
creating a ticket on the [GitHub Issue
Tracker](https://github.com/openresty/lua-resty-lrucache/issues),
=item 2.
or posting to the L<OpenResty community>.
=back
=head1 Author
Yichun "agentzh" Zhang (章亦春) E<lt>agentzh@gmail.comE<gt>, OpenResty Inc.
Shuxin Yang.
=head1 Copyright and License
This module is licensed under the BSD license.
Copyright (C) 2014-2019, by Yichun "agentzh" Zhang, OpenResty Inc.
Copyright (C) 2014-2017, by Shuxin Yang.
All rights reserved.
Redistribution and use in source and binary forms, with or without modification, are permitted provided that the following conditions are met:
=over
=item *
Redistributions of source code must retain the above copyright notice, this list of conditions and the following disclaimer.
=back
=over
=item *
Redistributions in binary form must reproduce the above copyright notice, this list of conditions and the following disclaimer in the documentation and/or other materials provided with the distribution.
=back
THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND CONTRIBUTORS "AS IS" AND ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL THE COPYRIGHT HOLDER OR CONTRIBUTORS BE LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL, SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.
=head1 See Also
=over
=item *
OpenResty: https://openresty.org
=item *
the ngx_http_lua module: https://github.com/openresty/lua-nginx-module
=item *
the ngx_stream_lua module: https://github.com/openresty/stream-lua-nginx-module
=item *
the lua-resty-core library: https://github.com/openresty/lua-resty-core
=back
|