- Publicity: Public Only All
acs-cache-procs.tcl
This file defines the following Objects and Classes: ::acs::HashKeyPartitionedCache
, ::acs::KeyPartitionedCache
- Location:
- packages/acs-tcl/tcl/acs-cache-procs.tcl
Procedures in this file
- Class ::acs::Cache (public)
- Class ::acs::HashKeyPartitionedCache (public)
- Class ::acs::KeyPartitionedCache (public)
- Class ::acs::LockfreeCache (public)
- Class ::acs::PartitionedCache (public)
- Object ::acs::group_cache (public)
- Object ::acs::misc_cache (public)
- Object ::acs::per_request_cache (public)
- Object ::acs::per_thread_cache (public)
- Object ::acs::permission_cache (public)
- Object ::acs::site_nodes_cache (public)
- Object ::acs::site_nodes_children_cache (public)
- Object ::acs::site_nodes_id_cache (public)
- Object ::xo::xotcl_object_cache (public)
- Object ::xo::xotcl_object_type_cache (public)
- Object ::xo::xotcl_package_cache (public)
- Object ::xowiki::cache (public)
- acs::Cache instproc flush (public)
- acs::Cache instproc flush_all (public)
- acs::Cache instproc flush_cache (public)
- acs::Cache instproc flush_pattern (public)
- acs::Cache instproc get (public)
- acs::Cache instproc init (public)
- acs::Cache instproc set (public)
- acs::Cache instproc show_all (public)
- acs::HashKeyPartitionedCache instproc flush_pattern (public)
- acs::HashKeyPartitionedCache instproc set (public)
- acs::KeyPartitionedCache instproc flush_pattern (public)
- acs::KeyPartitionedCache instproc set (public)
- acs::LockfreeCache instproc eval (public)
- acs::LockfreeCache instproc flush (public)
- acs::LockfreeCache instproc get (public)
- acs::PartitionedCache instproc flush_all (public)
- acs::PartitionedCache instproc init (public)
- acs::PartitionedCache instproc show_all (public)
- acs::disk_cache_eval (public)
- acs::disk_cache_flush (public)
Detailed information
Class ::acs::Cache (public)
::nx::Class ::acs::CacheBase class for cache management
- Testcases:
- No testcase defined.
Class ::acs::HashKeyPartitionedCache (public)
::nx::Class ::acs::HashKeyPartitionedCachePartitioned cache, where the partition numbers are computed via a hash function. Key-partitioning is based on a modulo function using a special partition_key, which has to be numeric
- Testcases:
- No testcase defined.
Class ::acs::KeyPartitionedCache (public)
::nx::Class ::acs::KeyPartitionedCachePartitioned cache, where the partition numbers are computed via a modulo function from the numeric keys.
- Testcases:
- No testcase defined.
Class ::acs::LockfreeCache (public)
::nx::Class ::acs::LockfreeCacheLockfree caches are provided either as per-thread caches or per-request caches, sharing the property that accessing these values does not require locks. Typical applications of these caches are the per_request_cache and per_thread_cache.
- See Also:
- Testcases:
- No testcase defined.
Class ::acs::PartitionedCache (public)
::nx::Class ::acs::PartitionedCachePartitioned cache infrastructure. Partition numbers are computed via a modulo function from the numeric keys.
- Testcases:
- No testcase defined.
Object ::acs::group_cache (public)
::acs::KeyPartitionedCache ::acs::group_cache
- ::acs::group_cache set -partition_key /integer/ /key/ /value/
- ::acs::group_cache flush_pattern -partition_key /integer/ /pattern/
- ::acs::group_cache init
- ::acs::group_cache show_all
- ::acs::group_cache flush_all ?-partition_key /value/?
- ::acs::group_cache eval ?-partition_key /value/? ?-expires /value/? ?-timeout /value/? ?-per_request? /key/ /command/
- ::acs::group_cache get ?-partition_key /value/? /key/
- ::acs::group_cache flush ?-partition_key /value/? /key/
- ::acs::group_cache flush_cache ?-partition_key /value/?
- Testcases:
- No testcase defined.
Object ::acs::misc_cache (public)
::acs::HashKeyPartitionedCache ::acs::misc_cacheGeneric cache. This cache is a successor of the util_memoize_cache, but in a partitioned fashion to make it scalable. It should only be used for situation, where no wild-card flushes are required.
- ::acs::misc_cache set -partition_key /value/ /key/ /value/
- ::acs::misc_cache flush_pattern -partition_key /value/ /pattern/
- ::acs::misc_cache init
- ::acs::misc_cache show_all
- ::acs::misc_cache flush_all ?-partition_key /value/?
- ::acs::misc_cache eval ?-partition_key /value/? ?-expires /value/? ?-timeout /value/? ?-per_request? /key/ /command/
- ::acs::misc_cache get ?-partition_key /value/? /key/
- ::acs::misc_cache flush ?-partition_key /value/? /key/
- ::acs::misc_cache flush_cache ?-partition_key /value/?
- Testcases:
- No testcase defined.
Object ::acs::per_request_cache (public)
::acs::LockfreeCache ::acs::per_request_cacheLockfree cache with per-request live time of the entries. The purpose of the per-request cache is to cache computation results of a single request. The entries of this cache are therefore very short-lived. Some values are needed multiple times per request, and/or they should show consistently the same value during the same request, no matter, if concurrently, a value is changed (e.g. permissions). The per-request cache uses a Tcl variable in the global Tcl namespace, such it will be automatically reclaimed after the request. The per-request cache uses the prefix "::__acs_cache".
Object ::acs::per_thread_cache (public)
::acs::LockfreeCache ::acs::per_thread_cacheLockfree cache with per-thread live time of the entries. The per-thread caches use namespaced variables, which are not touched by the automatic per-request cleanup routines of the server. So, the values cached in one requests can be used by some later request in the same thread. The entries are kept in per-thread caches as long as the thread lives, there is so far no automatic mechanism to flush these. So, per-thread caches are typically used for values fetched from the database, which do not change, unless the server is restarted. Note: the usage of per-thread caches is only recommended for static values, which do no change during the life time of the server, since there is so far no automatic measure in place to the flush values in every thread.
Object ::acs::permission_cache (public)
::acs::KeyPartitionedCache ::acs::permission_cachePermission cache. This partitioned cache manages partition caching. In case of bottlenecks, increase the number of partitions and the cache size.
- ::acs::permission_cache set -partition_key /integer/ /key/ /value/
- ::acs::permission_cache flush_pattern -partition_key /integer/ /pattern/
- ::acs::permission_cache init
- ::acs::permission_cache show_all
- ::acs::permission_cache flush_all ?-partition_key /value/?
- ::acs::permission_cache eval ?-partition_key /value/? ?-expires /value/? ?-timeout /value/? ?-per_request? /key/ /command/
- ::acs::permission_cache get ?-partition_key /value/? /key/
- ::acs::permission_cache flush ?-partition_key /value/? /key/
- ::acs::permission_cache flush_cache ?-partition_key /value/?
- Testcases:
- No testcase defined.
Object ::acs::site_nodes_cache (public)
::acs::KeyPartitionedCache ::acs::site_nodes_cachePartitioned Cache for handling generic site node information. Site node caching is implemented using three different caches.
- See Also:
- ::acs::site_nodes_cache set -partition_key /integer/ /key/ /value/
- ::acs::site_nodes_cache flush_pattern -partition_key /integer/ /pattern/
- ::acs::site_nodes_cache init
- ::acs::site_nodes_cache show_all
- ::acs::site_nodes_cache flush_all ?-partition_key /value/?
- ::acs::site_nodes_cache eval ?-partition_key /value/? ?-expires /value/? ?-timeout /value/? ?-per_request? /key/ /command/
- ::acs::site_nodes_cache get ?-partition_key /value/? /key/
- ::acs::site_nodes_cache flush ?-partition_key /value/? /key/
- ::acs::site_nodes_cache flush_cache ?-partition_key /value/?
- Testcases:
- No testcase defined.
Object ::acs::site_nodes_children_cache (public)
::acs::KeyPartitionedCache ::acs::site_nodes_children_cachePartitioned Cache for handling site node children. Site node caching is implemented using three different caches.
- See Also:
- ::acs::site_nodes_children_cache set -partition_key /integer/ /key/ /value/
- ::acs::site_nodes_children_cache flush_pattern -partition_key /integer/ /pattern/
- ::acs::site_nodes_children_cache init
- ::acs::site_nodes_children_cache show_all
- ::acs::site_nodes_children_cache flush_all ?-partition_key /value/?
- ::acs::site_nodes_children_cache eval ?-partition_key /value/? ?-expires /value/? ?-timeout /value/? ?-per_request? /key/ /command/
- ::acs::site_nodes_children_cache get ?-partition_key /value/? /key/
- ::acs::site_nodes_children_cache flush ?-partition_key /value/? /key/
- ::acs::site_nodes_children_cache flush_cache ?-partition_key /value/?
- Testcases:
- No testcase defined.
Object ::acs::site_nodes_id_cache (public)
::acs::HashKeyPartitionedCache ::acs::site_nodes_id_cachePartitioned Cache for handling site node IDs. Site node caching is implemented using three different caches.
- See Also:
- ::acs::site_nodes_id_cache set -partition_key /value/ /key/ /value/
- ::acs::site_nodes_id_cache flush_pattern -partition_key /value/ /pattern/
- ::acs::site_nodes_id_cache init
- ::acs::site_nodes_id_cache show_all
- ::acs::site_nodes_id_cache flush_all ?-partition_key /value/?
- ::acs::site_nodes_id_cache eval ?-partition_key /value/? ?-expires /value/? ?-timeout /value/? ?-per_request? /key/ /command/
- ::acs::site_nodes_id_cache get ?-partition_key /value/? /key/
- ::acs::site_nodes_id_cache flush ?-partition_key /value/? /key/
- ::acs::site_nodes_id_cache flush_cache ?-partition_key /value/?
- Testcases:
- No testcase defined.
Object ::xo::xotcl_object_cache (public)
::acs::PartitionedCache ::xo::xotcl_object_cacheXOTcl Object cache. This partitioned cache is used for objects with numeric keys based on the acs_object_ids of OpenACS. Most of these objects refer to content items or content revisions. In case of bottlenecks, increase the number of partitions and the cache size.
- ::xo::xotcl_object_cache init
- ::xo::xotcl_object_cache show_all
- ::xo::xotcl_object_cache flush_all ?-partition_key /value/?
- ::xo::xotcl_object_cache set ?-partition_key /value/? /key/ /value/
- ::xo::xotcl_object_cache flush_pattern ?-partition_key /value/? /pattern/
- ::xo::xotcl_object_cache eval ?-partition_key /value/? ?-expires /value/? ?-timeout /value/? ?-per_request? /key/ /command/
- ::xo::xotcl_object_cache get ?-partition_key /value/? /key/
- ::xo::xotcl_object_cache flush ?-partition_key /value/? /key/
- ::xo::xotcl_object_cache flush_cache ?-partition_key /value/?
- Testcases:
- No testcase defined.
Object ::xo::xotcl_object_type_cache (public)
::acs::KeyPartitionedCache ::xo::xotcl_object_type_cacheXOTcl Object type cache. This partitioned cache is used for obtaining types for objects and for the lookup of item_ids via parent_id and name for the content repository. In case of bottlenecks, increase the number of partitions and the cache size.
- ::xo::xotcl_object_type_cache set -partition_key /integer/ /key/ /value/
- ::xo::xotcl_object_type_cache flush_pattern -partition_key /integer/ /pattern/
- ::xo::xotcl_object_type_cache init
- ::xo::xotcl_object_type_cache show_all
- ::xo::xotcl_object_type_cache flush_all ?-partition_key /value/?
- ::xo::xotcl_object_type_cache eval ?-partition_key /value/? ?-expires /value/? ?-timeout /value/? ?-per_request? /key/ /command/
- ::xo::xotcl_object_type_cache get ?-partition_key /value/? /key/
- ::xo::xotcl_object_type_cache flush ?-partition_key /value/? /key/
- ::xo::xotcl_object_type_cache flush_cache ?-partition_key /value/?
- Testcases:
- No testcase defined.
Object ::xo::xotcl_package_cache (public)
::acs::Cache ::xo::xotcl_package_cacheXOTcl Object package cache. This cache is used for package_ids of package names, for ids of root folders, and for certain properties of the database (has_ltree, has_hstore). In case of bottlenecks, increase the number of partitions and the cache size.
- ::xo::xotcl_package_cache show_all
- ::xo::xotcl_package_cache init
- ::xo::xotcl_package_cache set ?-partition_key /value/? /key/ /value/
- ::xo::xotcl_package_cache flush_pattern ?-partition_key /value/? /pattern/
- ::xo::xotcl_package_cache eval ?-partition_key /value/? ?-expires /value/? ?-timeout /value/? ?-per_request? /key/ /command/
- ::xo::xotcl_package_cache get ?-partition_key /value/? /key/
- ::xo::xotcl_package_cache flush ?-partition_key /value/? /key/
- ::xo::xotcl_package_cache flush_all
- ::xo::xotcl_package_cache flush_cache ?-partition_key /value/?
- Testcases:
- No testcase defined.
Object ::xowiki::cache (public)
::acs::KeyPartitionedCache ::xowiki::cacheXowiki cache. This partitioned cache is used for various caching purposes for xowiki. It is used for example for caching includlets (when requested), or for full file names of xowiki::File objects. In case of bottlenecks, increase the number of partitions and the cache size.
- ::xowiki::cache set -partition_key /integer/ /key/ /value/
- ::xowiki::cache flush_pattern -partition_key /integer/ /pattern/
- ::xowiki::cache init
- ::xowiki::cache show_all
- ::xowiki::cache flush_all ?-partition_key /value/?
- ::xowiki::cache eval ?-partition_key /value/? ?-expires /value/? ?-timeout /value/? ?-per_request? /key/ /command/
- ::xowiki::cache get ?-partition_key /value/? /key/
- ::xowiki::cache flush ?-partition_key /value/? /key/
- ::xowiki::cache flush_cache ?-partition_key /value/?
- Testcases:
- No testcase defined.
acs::Cache method flush (public)
<instance of acs::Cache> flush [ -partition_key partition_key ] \
keyFlush a single entry in the cache
- Switches:
- -partition_key (optional)
- Parameters:
- key (required)
- Testcases:
- No testcase defined.
acs::Cache method flush_all (public)
<instance of acs::Cache> flush_allFlush all contents of all (partitioned) caches. In the case of a base ::acs::Cache, it is identical to "flush_cash".
- Testcases:
- No testcase defined.
acs::Cache method flush_cache (public)
<instance of acs::Cache> flush_cache \
[ -partition_key partition_key ]Flush all entries in a cache.
- Switches:
- -partition_key (optional)
- Testcases:
- No testcase defined.
acs::Cache method flush_pattern (public)
<instance of acs::Cache> flush_pattern \
[ -partition_key partition_key ] patternFlush in the cache a value based on a pattern operation. Use this function rarely, since on large caches (e.g. 100k entries or more) the glob operation will cause long locks, which should be avoided. The partitioned variants can help to reduce the lock times.
- Switches:
- -partition_key (optional)
- Parameters:
- pattern (required)
- Testcases:
- No testcase defined.
acs::Cache method get (public)
<instance of acs::Cache> get [ -partition_key partition_key ] \
keyThe "get" method retrieves data from the cache. It should not be used for new applications due to likely race conditions, but legacy applications use this. As implementation, we use the AOLserver API emulation.
- Switches:
- -partition_key (optional)
- Parameters:
- key (required)
- Testcases:
- No testcase defined.
acs::Cache method init (public)
<instance of acs::Cache> initIf the name was not provided, use the object name as default.
- Testcases:
- No testcase defined.
acs::Cache method set (public)
<instance of acs::Cache> set [ -partition_key partition_key ] \
key valueSet a single value in the cache. This code uses ns_cache_eval to achieve this behavior, which is typically an AOLserver idiom and should be avoided.
- Switches:
- -partition_key (optional)
- Parameters:
- key (required)
- value (required)
- Testcases:
- No testcase defined.
acs::Cache method show_all (public)
<instance of acs::Cache> show_allLog all cache keys to the system log. The primary usage is for debugging.
- Testcases:
- No testcase defined.
acs::HashKeyPartitionedCache method flush_pattern (public)
<instance of acs::HashKeyPartitionedCache> flush_pattern \
-partition_key partition_key patternflush just in all partitions
- Switches:
- -partition_key (required)
- Parameters:
- pattern (required)
- Testcases:
- No testcase defined.
acs::HashKeyPartitionedCache method set (public)
<instance of acs::HashKeyPartitionedCache> set \
-partition_key partition_key key valueSet a single value in the cache. It transforms the partition key into a hash value. This code uses ns_cache_eval to achieve this behavior, which is typically an AOLserver idiom and should be avoided.
- Switches:
- -partition_key (required)
- Parameters:
- key (required)
- value (required)
- Testcases:
- No testcase defined.
acs::KeyPartitionedCache method flush_pattern (public)
<instance of acs::KeyPartitionedCache> flush_pattern \
-partition_key partition_key patternFlush just in the determined partition
- Switches:
- -partition_key (required, integer)
- Parameters:
- pattern (required)
- Testcases:
- No testcase defined.
acs::KeyPartitionedCache method set (public)
<instance of acs::KeyPartitionedCache> set \
-partition_key partition_key key valueSet a single value in the cache. This code uses ns_cache_eval to achieve this behavior, which is typically an AOLserver idiom and should be avoided.
- Switches:
- -partition_key (required, integer)
- Parameters:
- key (required)
- value (required)
- Testcases:
- No testcase defined.
acs::LockfreeCache method eval (public)
<instance of acs::LockfreeCache> eval -key key \
[ -no_cache no_cache ] [ -no_empty ] \
[ -from_cache_indicator from_cache_indicator ] cmdUse the "prefix" to determine whether the cache is per-thread or per-request.
- Switches:
- -key (required)
- key for caching, should start with package-key and a dot to avoid name clashes
- -no_cache (optional)
- list of returned values that should not be cached
- -no_empty (optional, defaults to
"false")- don't cache empty values. This flag is deprecated, one should use the no_cache flag instead.
- -from_cache_indicator (optional)
- variable name to indicate whether the returned value was from cache or not
- Parameters:
- cmd (required)
- command to be executed.
- Returns:
- return the last value set (don't use "return").
- Testcases:
- No testcase defined.
acs::LockfreeCache method flush (public)
<instance of acs::LockfreeCache> flush [ -pattern pattern ]Flush a cache entry based on the pattern (which might be wild-card-free). Currently, the clusterwide flushing is omitted. We have the per-request cache (clusterwide operations do not make sense for this) and per-thread caching. The per-thread caching application have to be aware that flushing is happening only in one thread, so clusterwide operations will only start to make sense, when the all threads of a server would be cleaned.
- Switches:
- -pattern (optional, defaults to
"*")- Testcases:
- No testcase defined.
acs::LockfreeCache method get (public)
<instance of acs::LockfreeCache> get -key key varGet entry with the provided key from this cache if it exists. In most cases, the "eval" method should be used.
- Switches:
- -key (required)
- cache key
- Parameters:
- var (required)
- Returns:
- return boolean value indicating success.
- Testcases:
- No testcase defined.
acs::PartitionedCache method flush_all (public)
<instance of acs::PartitionedCache> flush_all \
[ -partition_key partition_key ]Flush all entries in all partitions of a cache.
- Switches:
- -partition_key (optional)
- Testcases:
- No testcase defined.
acs::PartitionedCache method init (public)
<instance of acs::PartitionedCache> initIf the name was not provided, use the object name as default for the cache name.
- Testcases:
- No testcase defined.
acs::PartitionedCache method show_all (public)
<instance of acs::PartitionedCache> show_allLog all cache keys of all partitions to the system log. The primary usage is for debugging.
- Testcases:
- No testcase defined.
acs::disk_cache_eval (public)
acs::disk_cache_eval -call call -key key -id id
Evaluate an expression. When the acs-tcl.DiskCache parameter is set, cache the result on the disk. If a cache already exists, return the cached value.
- Switches:
- -call (required)
- a Tcl snippet executed in the caller scope.
- -key (required)
- a key used to name the directory where the disk cache will be stored.
- -id (required)
- an id used to name the file where the disk cache will be stored. The name will also depend on a hash of the actual snippet.
- Partial Call Graph (max 5 caller/called nodes):
- Testcases:
- disk_cache
acs::disk_cache_flush (public)
acs::disk_cache_flush -key key -id id
Flushes the filesystem cache.
- Switches:
- -key (required)
- the key used to name the directory where the disk cache is stored.
- -id (required)
- the id used to name the file where the disk cache is stored.
- See Also:
- Partial Call Graph (max 5 caller/called nodes):
- Testcases:
- disk_cache
Content File Source
# # Copyright (C) 2018 Gustaf Neumann, neumann@wu-wien.ac.at # # Vienna University of Economics and Business # Institute of Information Systems and New Media # A-1020, Welthandelsplatz 1 # Vienna, Austria # # This is a BSD-Style license applicable for this file. # # Permission to use, copy, modify, distribute, and sell this # software and its documentation for any purpose is hereby granted # without fee, provided that the above copyright notice appears in # all copies and that both that copyright notice and this permission # notice appear in supporting documentation. We make no # representations about the suitability of this software for any # purpose. It is provided "as is" without express or implied # warranty. # namespace eval ::acs { ########################################################################## # # Generic Cache class # ########################################################################## nx::Class create ::acs::Cache { # # Base class for cache management # :property name :property parameter:required :property package_key:required :property maxentry:integer :property {timeout 5m} :property {default_size 100KB} :method cache_name {key} { # # More or less dummy function, which can be refined. The # base definition completely ignores "key". # return ${:name} } :method get_size {} { # # Determine the cache size depending on configuration # variables. # set specifiedSize [::parameter::get_from_package_key \ -package_key ${:package_key} \ -parameter "${:parameter}Size" \ -default ${:default_size}] if {[::nsf::is integer $specifiedSize]} { set size $specifiedSize } else { set size [ns_baseunit -size $specifiedSize] } return $size } :public method flush {{-partition_key} key} { # # Flush a single entry in the cache # if {![info exists partition_key]} { set partition_key $key } ::acs::clusterwide ns_cache flush [:cache_name $partition_key] $key } :public method eval {{-partition_key} {-expires} {-timeout} {-per_request:switch} key command} { # # Evaluate the command unless the result was already computed before and cached. # # @param expires Lifetime of the cache entry. # The entry will be purged automatically when the time is reached. The time is in seconds # unless a time unit is specified (e.g., 5m) # @param timeout Maximum time to wait for the command to complete. The time is in seconds # unless a time unit is specified (e.g., 2.5m) # @param partition_key Used for determining the cache # name in partitioned caches. The partition key is computed typically # automatically depending on the cache type. # @param per_request When set, cache the result per # request. So far, no attempt is made to flush # the result during the lifetime of the request. # @param key The cache key # @param command The command to be executed when the result is not yet cached. # if {![info exists partition_key]} { set partition_key $key } foreach optional_parameter {expires timeout} { if {[info exists $optional_parameter]} { set ${optional_parameter}_flag [list -$optional_parameter [set $optional_parameter]] } else { set ${optional_parameter}_flag "" } } set cache_name [:cache_name $partition_key] try { if {$per_request} { acs::per_request_cache eval -key ::acs-${cache_name}($key) { :uplevel [list ns_cache_eval \ {*}$expires_flag {*}$timeout_flag -- \ $cache_name $key $command] } } else { :uplevel [list ns_cache_eval {*}$expires_flag {*}$timeout_flag -- \ $cache_name $key $command] } } on break {r} { # # When the command ends with "break", it means: # "don't cache". We return in this case always a # 0. # #ns_log notice "====================== [self] $key -> break -> <$r>" return 0 } on ok {r} { return $r } } :public method set {-partition_key key value} { # # Set a single value in the cache. This code uses # ns_cache_eval to achieve this behavior, which is # typically an AOLserver idiom and should be avoided. # if {![info exists partition_key]} { set partition_key $key } :uplevel [list ns_cache_eval -force -- [:cache_name $partition_key] $key [list set _ $value]] } :public method flush_pattern {{-partition_key ""} pattern} { # # Flush in the cache a value based on a pattern # operation. Use this function rarely, since on large # caches (e.g. 100k entries or more) the glob # operation will cause long locks, which should be # avoided. The partitioned variants can help to reduce # the lock times. # return [::acs::clusterwide ns_cache_flush -glob [:cache_name $partition_key] $pattern] } :method cache_create {name size} { # # Create a cache. # ns_cache_create \ -timeout ${:timeout} \ {*}[expr {[info exists :maxentry] ? "-maxentry ${:maxentry}" : ""}] \ $name $size } :public method get {-partition_key key} { # # The "get" method retrieves data from the cache. It # should not be used for new applications due to likely # race conditions, but legacy applications use this. As # implementation, we use the AOLserver API emulation. # if {![info exists partition_key]} { set partition_key $key } return [ns_cache get [:cache_name $partition_key] $key] } :public method show_all {} { # # Log all cache keys to the system log. The primary usage # is for debugging. # ns_log notice "content of ${:name}: [ns_cache_keys ${:name}]" } :public method flush_cache {{-partition_key ""}} { # # Flush all entries in a cache. # ::acs::clusterwide ns_cache_flush [:cache_name $partition_key] #ns_log notice "flush_all -> ns_cache_flush [:cache_name $partition_key]" #ns_log notice "... content of ${:name}: [ns_cache_keys ${:name}]" } :public method flush_all {} { # # Flush all contents of all (partitioned) caches. In the # case of a base ::acs::Cache, it is identical to # "flush_cash". # :flush_cache } :public method init {} { # # If the name was not provided, use the object name as # default. # if {![info exists :name]} { set :name [namespace tail [current]] } :cache_create ${:name} [:get_size] } } ########################################################################## # # Simple Partitioned Cache class # # Partitioning is based on a modulo function using the cache # key, which has to be numeric. # ########################################################################## nx::Class create ::acs::PartitionedCache -superclasses ::acs::Cache { # # Partitioned cache infrastructure. Partition numbers are # computed via a modulo function from the numeric keys. # :property {partitions:integer 1} :protected method cache_name {key:integer} { # # Return the cache_name always as the same Tcl_Obj (list # element) rather than concatenating always a fresh # Tcl_Obj dynamically the fly (type string). Caching the # cache structure in the dynamic Tcl_Obj can't not work. # return [lindex ${:partition_names} [expr {$key % ${:partitions}}]] } :public method init {} { # # If the name was not provided, use the object name as # default for the cache name. # if {![info exists :name]} { set :name [namespace tail [current]] } set :partitions [::parameter::get_from_package_key \ -package_key ${:package_key} \ -parameter "${:parameter}Partitions" \ -default ${:partitions}] # # Create multiple separate caches depending on the # partitions. A PartitionedCache requires to have a # partitioning function that determines the nth partition # number from some partition_key. # set size [expr {[:get_size] / ${:partitions}}] set :partition_names {} for {set i 0} {$i < ${:partitions}} {incr i} { lappend :partition_names ${:name}-$i :cache_create ${:name}-$i $size } } :public method flush_all {{-partition_key ""}} { # # Flush all entries in all partitions of a cache. # for {set i 0} {$i < ${:partitions}} {incr i} { ::acs::clusterwide ns_cache_flush ${:name}-$i #ns_log notice "flush_all: ns_cache_flush ${:name}-$i" #ns_log notice "... content of ${:name}-$i: [ns_cache_keys ${:name}-$i]" } } :method flush_pattern_in_all_partitions {pattern} { # # Flush matching entries in all partitions of a cache based on # a pattern. # for {set i 0} {$i < ${:partitions}} {incr i} { ::acs::clusterwide ns_cache_flush -glob ${:name}-$i $pattern ns_log notice "flush_pattern_in_all_partitions: ns_cache_flush ${:name}-$i $pattern" #ns_log notice "... content of ${:name}-$i: [ns_cache_keys ${:name}-$i]" } } :public method show_all {} { # # Log all cache keys of all partitions to the system # log. The primary usage is for debugging. # for {set i 0} {$i < ${:partitions}} {incr i} { ns_log notice "content of ${:name}-$i: [ns_cache_keys ${:name}-$i]" } } } ########################################################################## # # Class for key-partitioned caches # ########################################################################## nx::Class create ::acs::KeyPartitionedCache -superclasses ::acs::PartitionedCache { # # Partitioned cache, where the partition numbers are computed # via a modulo function from the numeric keys. # :property {partitions:integer 1} :public method flush_pattern {{-partition_key:integer,required} pattern} { # # Flush just in the determined partition # next } #:public method flush {{-partition_key:integer,required} key} { # next #} :public method set {{-partition_key:integer,required} key value} { # # Set a single value in the cache. This code uses # ns_cache_eval to achieve this behavior, which is # typically an AOLserver idiom and should be avoided. # next } } ########################################################################## # # Class for hash-key-partitioned caches # ########################################################################## nx::Class create ::acs::HashKeyPartitionedCache -superclasses ::acs::KeyPartitionedCache { # # Partitioned cache, where the partition numbers are computed # via a hash function. # # Key-partitioning is based on a modulo function using a special # partition_key, which has to be numeric # :property {partitions:integer 2} :public method flush_pattern {{-partition_key:required} pattern} { # # flush just in all partitions # :flush_pattern_in_all_partitions $pattern } :public method set {{-partition_key:required} key value} { # # Set a single value in the cache. It transforms the # partition key into a hash value. This code uses # ns_cache_eval to achieve this behavior, which is # typically an AOLserver idiom and should be avoided. # next [list -partition_key [ns_hash $partition_key] $pattern] } :protected method cache_name {key} { next [list [ns_hash $key]] } } } namespace eval ::acs { ########################################################################## # # ::acs::LockfreeCache: Per-thread and per-request Cache # ########################################################################## nx::Class create ::acs::LockfreeCache { # # Lockfree caches are provided either as per-thread caches or # per-request caches, sharing the property that accessing these # values does not require locks. # # Typical applications of these caches are the per_request_cache and per_thread_cache. # # @see Object ::acs::per_request_cache # @see Object ::acs::per_thread_cache # :property {prefix} :public method get { {-key:required} var } { # # Get entry with the provided key from this cache if it # exists. In most cases, the "eval" method should be used. # # @param key cache key # @return return boolean value indicating success. # if {[info exists ${:prefix}] && [dict exists [set ${:prefix}] $key]} { :upvar $var value set value [dict get [set ${:prefix}] $key] return 1 } return 0 } :public method eval { {-key:required} {-no_cache} {-no_empty:switch false} {-from_cache_indicator} cmd } { # # Use the "prefix" to determine whether the cache is # per-thread or per-request. # # @param key key for caching, should start with package-key # and a dot to avoid name clashes # @param cmd command to be executed. # @param no_empty don't cache empty values. This flag is # deprecated, one should use the no_cache flag # instead. # @param no_cache list of returned values that should not be cached # @param from_cache_indicator variable name to indicate whether # the returned value was from cache or not # # @return return the last value set (don't use "return"). # if {[info exists from_cache_indicator]} { :upvar $from_cache_indicator from_cache } #if {![info exists ${:prefix}]} { # ns_log notice "### exists ${:prefix} ==> 0" #} else { # ns_log notice "### [list dict exists [set ${:prefix}] $key] ==> [dict exists [set ${:prefix}] $key]" #} if {![info exists ${:prefix}] || ![dict exists [set ${:prefix}] $key]} { #ns_log notice "### call cmd <$cmd>" set from_cache 0 set value [:uplevel $cmd] if {$no_empty} { ad_log warning "no_empty flag is deprecated and will be dropped in the future." lappend no_cache "" } if {[info exists no_cache] && $value in $no_cache} { #ns_log notice "### cache eval $key returns <$value> without caching" return $value } #if {$value eq "0"} { # ns_log notice "### cache eval $key returns <$value> with caching" #} dict set ${:prefix} $key $value #ns_log notice "### [list dict set ${:prefix} $key $value]" } else { set from_cache 1 set value [dict get [set ${:prefix}] $key] } #ns_log notice "### will return [list dict get ${:prefix} $key]" return $value } #:public method flush { # {-pattern *} #} { # # # # Flush a cache entry based on the pattern (which might be # # wild-card-free). # # # ::acs::clusterwide [self] flush_local -pattern $pattern #} :public method flush { {-pattern *} } { # # Flush a cache entry based on the pattern (which might be # wild-card-free). Currently, the clusterwide flushing is # omitted. # # We have the per-request cache (clusterwide operations do # not make sense for this) and per-thread caching. The # per-thread caching application have to be aware that # flushing is happening only in one thread, so clusterwide # operations will only start to make sense, when the all # threads of a server would be cleaned. # if {[info exists ${:prefix}]} { if {$pattern eq "*"} { #ns_log notice "### dict flush ${:prefix} <$pattern>" unset -nocomplain ${:prefix} } elseif {[string first "*" $pattern] != -1} { # # A real pattern with wild-card was provided. # set keys [dict keys [set ${:prefix}] $pattern] #ns_log notice "### dict flush ${:prefix} <$pattern> -> [llength $keys]" foreach key $keys { dict unset ${:prefix} $key } } elseif [dict exists [set ${:prefix}] $pattern] { # # A "pattern" without a wildcard was provided # dict unset ${:prefix} $pattern } } } :create per_request_cache -prefix ::__acs_cache { # # Lockfree cache with per-request live time of the # entries. # # The purpose of the per-request cache is to cache # computation results of a single request. The entries of # this cache are therefore very short-lived. Some values # are needed multiple times per request, and/or they # should show consistently the same value during the same # request, no matter, if concurrently, a value is changed # (e.g. permissions). # # The per-request cache uses a Tcl variable in the global # Tcl namespace, such it will be automatically reclaimed # after the request. The per-request cache uses the prefix # "::__acs_cache". # } # # Define the "per_thread_cache" # set docString { # # Lockfree cache with per-thread live time of the entries. # # The per-thread caches use namespaced variables, # which are not touched by the automatic per-request # cleanup routines of the server. So, the values # cached in one requests can be used by some later # request in the same thread. The entries are kept in # per-thread caches as long as the thread lives, there # is so far no automatic mechanism to flush these. So, # per-thread caches are typically used for values # fetched from the database, which do not change, # unless the server is restarted. # # Note: the usage of per-thread caches is only # recommended for static values, which do no change # during the life time of the server, since there is # so far no automatic measure in place to the flush # values in every thread. } if {[ns_config "ns/parameters" cachingmode "per-node"] eq "none"} { # # If caching mode is "none", let the "per_thread_cache" behave # like the "per_request_cache". # :create per_thread_cache -prefix ::__acs_cache $docString ns_log notice "cachingmode [ns_config "ns/parameters" cachingmode singlenode]" \ "-> per_thread_cache behaves like per-request_cache" } else { # # The per-thread cache uses namespaced Tcl variables, identified # by the prefix "::acs:cache" # :create per_thread_cache -prefix ::acs::cache $docString } } namespace eval ::acs::cache {} } namespace eval ::acs { ad_proc -private try_cache {cache operation args} { Function to support caching during bootstrap. When the provided cache exists, then use it for caching, otherwise perform uncalled call. This function is made intentionally private, since this should only be required during bootstrapping. It does not make sense to wrap arbitrary caching calls with this function. } { if { [namespace which $cache] ne "" && [$cache info lookup methods $operation] ne "" } { return [uplevel 1 [list $cache $operation {*}$args]] } else { # # Complain only, when # a) not during initial install, and # b) if this is not during startup of an installed version # set complain_p [expr {[ns_ictl epoch] > 0 && [nsv_names acs_installer] eq ""}] if {$operation eq "eval"} { nsf::parseargs {{-partition_key} {-expires} {-per_request:switch} key command} $args if {$complain_p} { ns_log warning "no cache $cache: need direct call $key $args" } #ns_log warning "no cache $cache: need direct call $key [info exists partition_key] <$command>" return [uplevel 1 $command] } if {$complain_p} { ns_log warning "no cache $cache: call ignored" } } } } namespace eval ::acs { # # Experimental disk-cache, to test whether this can speed up long # calls, producing potentially large output .. # # The interface should be probably streamlined with the other # chaching infrastructure. # # Documentation follows. if { [apm_first_time_loading_p] } { nsv_set ad_disk_cache mutex [ns_mutex create disk_cache] } d_proc -public disk_cache_flush { -key:required -id:required } { Flushes the filesystem cache. @param key the key used to name the directory where the disk cache is stored. @param id the id used to name the file where the disk cache is stored. @see acs::disk_cache_eval } { set dir [ad_tmpdir]/oacs-cache/$key foreach file [glob -nocomplain $dir/$id-*] { file delete -- $file ns_log notice "FLUSH file delete -- $file" } } d_proc -public disk_cache_eval { -call:required -key:required -id:required } { Evaluate an expression. When the acs-tcl.DiskCache parameter is set, cache the result on the disk. If a cache already exists, return the cached value. @param call a Tcl snippet executed in the caller scope. @param key a key used to name the directory where the disk cache will be stored. @param id an id used to name the file where the disk cache will be stored. The name will also depend on a hash of the actual snippet. } { set cache [::parameter::get_from_package_key \ -package_key acs-tcl \ -parameter DiskCache \ -default 1] if {$cache} { set hash [ns_sha1 $call] set dir [ad_tmpdir]/oacs-cache/$key set file_name $dir/$id-$hash if {![ad_file isdirectory $dir]} { file mkdir $dir } ns_mutex eval [nsv_get ad_disk_cache mutex] { if {[ad_file readable $file_name]} { set result [template::util::read_file $file_name] } else { set result [uplevel $call] template::util::write_file $file_name $result } } } else { set result [uplevel $call] } return $result } } # Local variables: # mode: tcl # tcl-indent-level: 4 # indent-tabs-mode: nil # End:
