The general-accumulator Reference Manual

Table of Contents

The general-accumulator Reference Manual

This is the general-accumulator Reference Manual, generated automatically by Declt version 3.0 "Montgomery Scott" on Mon Apr 19 14:48:50 2021 GMT+0.

1 Introduction

General accumulator

A general-purpose, extensible value accumulator library for Common Lisp

Introduction

General accumulator is a general-purpose, extensible value accumulator library for the Common Lisp language. Its main interface is with-accumulator macro which sets an environment for easy accumulation. The library provides several built-in accumulators which should cover the most common use-cases but any kind of accumulators can be added because the accumulator back-end is implemented through generic functions.

(with-accumulator (NAME OBJECT &key KEYWORD-ARGUMENTS ...)
  BODY ...)

The with-accumulator macro creates an accumulation environment in which the local function name handles the accumulation. Accumulator's type is defined by the object argument. Then all body forms are executed normally and the return value of the last form is returned.

The local function name can optionally take one argument which is an object to be accumulated. If the function is called without arguments it returns the currently accumulated value. The accumulation process is handled by generic functions initialize, accumulate and value.

For more information see the documentation of with-accumulator in the next section.

License and Source Code

Author: Teemu Likonen <tlikonen@iki.fi>

OpenPGP key: 4E10 55DC 84E9 DFF6 13D7 8557 719D 69D3 2453 9450

License: Creative Commons CC0 (public domain dedication)

The source code repository: https://github.com/tlikonen/cl-general-accumulator

The Programming Interface

Function: accumulate

The lambda list:

 (accumulator object)

Accumulate object to accumulator instance. Methods of this generic function should specialize at least on the first argument (accumulator) and they should accumulate the second argument (object) to the accumulator object.

Function: initialize

The lambda list:

 (object &key &allow-other-keys)

Return an accumulator object which is used to keep the information of an accumulation process.

The object argument can anything and its primary purpose is a method dispatching: different classes of the object establish different kind of accumulators. Methods can use the object value too, as well as any keyword arguments passed to the generic function.

Methods should return an object, usually an instance of some class. That object can later be used with generic functions accumulate and value.

Function: value

The lambda list:

 (accumulator)

Return the accumulated value of accumulator object.

Macro: with-accumulator

The lambda list:

 ((name object &rest keyword-arguments) &body body)

Create a local function name for handling an accumulation of type object. Execute body forms and return the value of the last form.

This macro uses generic functions to handle the accumulation. There are some built-in methods defined for common use-cases (see below) but user can add more methods and therefore any kind of accumulation is possible.

First a new accumulator object is created with the generic function initialize. The object argument (evaluated) and optional keyword-arguments (evaluated) are passed to initialize and it should return an accumulator object that stores the state of the accumulation.

Then a local function name is created for simple accumulation. The function can optionally take one argument which is an object to be accumulated. The generic function accumulate is used to handle the accumulation. The return value of the local function comes from the generic function accumulate. The built-in accumulators return the input argument.

If the local function is called without arguments then the generic function value is called. It should return the currently accumulated value.

Built-in accumulators

The object argument is used to define the type of accumulation process. There are several built-in types:

• :list

  Creates a list collector. Each accumulated object is collected to a list. Example:

  GENACC> (with-accumulator (collect :list)
            (collect 1) (collect 2) (collect 3)
            (collect))
  (1 2 3)
  

  The collecting is done destructively. The applicable accumulate method maintains a pointer to the last cons cell of the list and each time modifies its cdr value to point to a new cons cell.

• [a list]

  If object is of type list then new elements are collected at the end. Example:

  GENACC> (with-accumulator (collect (list 1 2 3))
            (collect 4) (collect 5)
            (collect))
  (1 2 3 4 5)
  

  This is a destructive operation. The cdr value of the last cons cell of the original list is modified and linked to a new cons cell.

• :vector

  Creates a general vector collector. It creates an adjustable vector with a fill pointer 0 and element type T. New elements are pushed to that vector with cl:vector-push-extend function. Example:

  GENACC> (with-accumulator (collect :vector)
            (collect "first") (collect "second")
            (collect))
  #("first" "second")
  

• :string

  This is similar to :vector but the element type is character. The underlying accumulate methods can take a single character or a sequence of characters as the argument. Example:

  GENACC> (with-accumulator (collect :string)
            (collect #\a)
            (collect "bcd")
            (collect #(#\e #\f))
            (collect '(#\g #\h #\i))
            (collect))
  "abcdefghi"
  

• :bit-vector

  This is similar to :string but the element type is bit. The argument for the accumulator function can a bit or a sequence of bits.

• [a vector]

  If object is of type vector which satisfies the test cl:array-has-fill-pointer-p then that vector is appended starting from its current fill pointer.

  GENACC> (with-accumulator
              (collect (make-array 2 :fill-pointer 2 :adjustable t
                                   :initial-contents (vector 1 2)))
            (collect 3)
            (collect 4)
            (collect))
  #(1 2 3 4)
  

  Note that if the vector is not adjustable then the accumulator may reach vector's limits and cl:vector-push-extend signals an error.

• [a function]

  If object is of type function then the accumulator behaves like the cl:reduce function: all accumulated objects are combined into one by calling the given reducer function. Examples:

  GENACC> (with-accumulator (summing #'+)
            (summing 5) (summing 7) (summing 11)
            (summing))
  23
  
  GENACC> (with-accumulator (nc #'nconc)
            (nc (list 1 2 3))
            (nc (list 4 5 6))
            (nc (list 7 8 9))
            (nc))
  (1 2 3 4 5 6 7 8 9)
  
  GENACC> (with-accumulator (early-char (lambda (a b)
                                          (if (char< a b) a b)))
            (early-char #\o)
            (early-char #\b)
            (early-char #\s)
            (early-char))
  #\b
  

Adding a custom accumulator

The whole accumulation process is handled by three generic functions: initialize, accumulate and value. Writing new methods for those functions allow adding any kind of accumulators. The following example adds an accumulator which calculates the arithmetic mean of accumulated numbers.

First we define a class whose instances will keep the state of the accumulator. In this case we need to store the sum and the count of accumulated numbers so we create slots for them.

(defclass mean-accumulator ()
  ((sum :initform 0)
   (count :initform 0)))

Then we add a method for initializing an instance of the class. The generic function initialize is used for that. It is called with the object argument of with-accumulator macro and with optional keyword-arguments. In this example we use an eql specializer for symbol :mean. We don't use any keyword arguments so there's just empty &key at the end of the lambda list.

(defmethod genacc:initialize ((type (eql :mean)) &key)
  (make-instance 'mean-accumulator))

Now we create a method for generic function accumulate. The function is called with two arguments: (1) the accumulator object created by initialize and (2) the object that is meant to be accumulated. This method specializes on our mean-accumulator class as well as on number class. The number is added to the previous value and the count is increased by one.

(defmethod genacc:accumulate ((object mean-accumulator)
                              (number number))
  (with-slots (sum count) object
    (incf sum number)
    (incf count 1)))

For returning the accumulated mean value we create a method for the generic function value. This method, too, must specialize on the mean-accumulator class. We get the current accumulated mean value by dividing the value of sum slot with the value of count slot.

(defmethod genacc:value ((object mean-accumulator))
  (with-slots (sum count) object
    (/ sum count)))

Now the custom accumulator is ready and it can be used with the with-accumulator macro. Example:

GENACC> (with-accumulator (mean :mean)
          (loop repeat 10 do (mean (random 1000)))
          (format t "The mean so far: ~A~%" (mean))
          (loop repeat 10 do (mean (random 1000)))
          (format t "The final mean:  ~A~%" (mean)))
The mean so far: 2512/5
The final mean:  2704/5
NIL

2 Systems

The main system appears first, followed by any subsystem dependency.

2.1 general-accumulator

Author

Teemu Likonen <tlikonen@iki.fi>

License

Creative Commons CC0 (public domain dedication)

Description

A general-purpose, extensible value accumulator

Source

general-accumulator.asd (file)

Component

accumulator.lisp (file)

3 Files

Files are sorted by type and then listed depth-first from the systems components trees.

3.1 Lisp

3.1.1 general-accumulator.asd

Location

general-accumulator.asd

Systems

general-accumulator (system)

3.1.2 general-accumulator/accumulator.lisp

Parent

general-accumulator (system)

Location

accumulator.lisp

Packages

general-accumulator

Exported Definitions

• accumulate (generic function)
• accumulate (method)
• accumulate (method)
• accumulate (method)
• accumulate (method)
• accumulate (method)
• accumulate (method)
• initialize (generic function)
• initialize (method)
• initialize (method)
• initialize (method)
• initialize (method)
• initialize (method)
• initialize (method)
• initialize (method)
• value (generic function)
• value (method)
• with-accumulator (macro)

Internal Definitions

• accumulator (class)
• list-accumulator (class)
• reduce-accumulator (class)
• special-vector-accumulator (class)
• vector-accumulator (class)

4 Packages

Packages are listed by definition order.

4.1 general-accumulator

Source

accumulator.lisp (file)

Nickname

genacc

Use List

common-lisp

Exported Definitions

• accumulate (generic function)
• accumulate (method)
• accumulate (method)
• accumulate (method)
• accumulate (method)
• accumulate (method)
• accumulate (method)
• initialize (generic function)
• initialize (method)
• initialize (method)
• initialize (method)
• initialize (method)
• initialize (method)
• initialize (method)
• initialize (method)
• value (generic function)
• value (method)
• with-accumulator (macro)

Internal Definitions

• accumulator (class)
• list-accumulator (class)
• reduce-accumulator (class)
• special-vector-accumulator (class)
• vector-accumulator (class)

5 Definitions

Definitions are sorted by export status, category, package, and then by lexicographic order.

5.1 Exported definitions

5.1.1 Macros

Macro: with-accumulator (NAME OBJECT &rest KEYWORD-ARGUMENTS) &body BODY

Create a local function ‘name‘ for handling an accumulation of type _object_. Execute _body_ forms and return the value of the last form.

This macro uses generic functions to handle the accumulation. There are some built-in methods defined for common use-cases (see below) but user can add more methods and therefore any kind of accumulation is possible.

First a new accumulator object is created with the generic function ‘initialize‘. The _object_ argument (evaluated) and optional _keyword-arguments_ (evaluated) are passed to ‘initialize‘ and it should return an accumulator object that stores the state of the accumulation.

Then a local function ‘name‘ is created for simple accumulation. The function can optionally take one argument which is an object to be accumulated. The generic function ‘accumulate‘ is used to handle the accumulation. The return value of the local function comes from the generic function ‘accumulate‘. The built-in accumulators return the input argument.

If the local function is called without arguments then the generic function ‘value‘ is called. It should return the currently accumulated value.

#### Built-in accumulators

The _object_ argument is used to define the type of accumulation process. There are several built-in types:

* ‘:list‘

Creates a list collector. Each accumulated object is collected to a list. Example:

GENACC> (with-accumulator (collect :list)
(collect 1) (collect 2) (collect 3) (collect))
(1 2 3)

The collecting is done destructively. The applicable ‘accumulate‘ method maintains a pointer to the last cons cell of the list and each time modifies its cdr value to point to a new cons cell.

* [a list]

If _object_ is of type ‘list‘ then new elements are collected at the end. Example:

GENACC> (with-accumulator (collect (list 1 2 3))
(collect 4) (collect 5) (collect))
(1 2 3 4 5)

This is a destructive operation. The cdr value of the last cons cell of the original list is modified and linked to a new cons cell.

* ‘:vector‘

Creates a general vector collector. It creates an adjustable vector with a fill pointer 0 and element type T. New elements are pushed to that vector with ‘cl:vector-push-extend‘ function. Example:

GENACC> (with-accumulator (collect :vector)
(collect "first") (collect "second") (collect))
#("first" "second")

* ‘:string‘

This is similar to ‘:vector‘ but the element type is ‘character‘. The underlying ‘accumulate‘ methods can take a single character or a sequence of characters as the argument. Example:

GENACC> (with-accumulator (collect :string)
(collect #\a)
(collect "bcd")
(collect #(#\e #\f))
(collect ’(#\g #\h #\i)) (collect))
"abcdefghi"

* ‘:bit-vector‘

This is similar to ‘:string‘ but the element type is ‘bit‘. The argument for the accumulator function can a bit or a sequence of bits.

* [a vector]

If _object_ is of type ‘vector‘ which satisfies the test ‘cl:array-has-fill-pointer-p‘ then that vector is appended starting from its current fill pointer.

GENACC> (with-accumulator
(collect (make-array 2 :fill-pointer 2 :adjustable t :initial-contents (vector 1 2))) (collect 3)
(collect 4)
(collect))
#(1 2 3 4)

Note that if the vector is not adjustable then the accumulator may reach vector’s limits and ‘cl:vector-push-extend‘ signals an error.

* [a function]

If _object_ is of type ‘function‘ then the accumulator behaves like the ‘cl:reduce‘ function: all accumulated objects are combined into one by calling the given reducer function. Examples:

GENACC> (with-accumulator (summing #’+)
(summing 5) (summing 7) (summing 11) (summing))
23

GENACC> (with-accumulator (nc #’nconc)
(nc (list 1 2 3))
(nc (list 4 5 6))
(nc (list 7 8 9))
(nc))
(1 2 3 4 5 6 7 8 9)

GENACC> (with-accumulator (early-char (lambda (a b)
(if (char< a b) a b))) (early-char #\o)
(early-char #\b)
(early-char #\s)
(early-char))
#\b

#### Adding a custom accumulator

The whole accumulation process is handled by three generic functions: ‘initialize‘, ‘accumulate‘ and ‘value‘. Writing new methods for those functions allow adding any kind of accumulators. The following example adds an accumulator which calculates the arithmetic mean of accumulated numbers.

First we define a class whose instances will keep the state of the accumulator. In this case we need to store the sum and the count of accumulated numbers so we create slots for them.

(defclass mean-accumulator ()
((sum :initform 0)
(count :initform 0)))

Then we add a method for initializing an instance of the class. The generic function ‘initialize‘ is used for that. It is called with the _object_ argument of ‘with-accumulator‘ macro and with optional _keyword-arguments_. In this example we use an _eql_ specializer for symbol ‘:mean‘. We don’t use any keyword arguments so there’s just empty _&key_ at the end of the lambda list.

(defmethod genacc:initialize ((type (eql :mean)) &key) (make-instance ’mean-accumulator))

Now we create a method for generic function ‘accumulate‘. The function is called with two arguments: (1) the accumulator object created by ‘initialize‘ and (2) the object that is meant to be accumulated. This method specializes on our ‘mean-accumulator‘ class as well as on number class. The number is added to the previous value and the count is increased by one.

(defmethod genacc:accumulate ((object mean-accumulator)
(number number))
(with-slots (sum count) object
(incf sum number)
(incf count 1)))

For returning the accumulated mean value we create a method for the generic function ‘value‘. This method, too, must specialize on the ‘mean-accumulator‘ class. We get the current accumulated mean value by dividing the value of _sum_ slot with the value of _count_ slot.

(defmethod genacc:value ((object mean-accumulator))
(with-slots (sum count) object
(/ sum count)))

Now the custom accumulator is ready and it can be used with the ‘with-accumulator‘ macro. Example:

GENACC> (with-accumulator (mean :mean)
(loop repeat 10 do (mean (random 1000)))
(format t "The mean so far: ~A~%" (mean))
(loop repeat 10 do (mean (random 1000)))
(format t "The final mean: ~A~%" (mean)))
The mean so far: 2512/5
The final mean: 2704/5
NIL

Package

general-accumulator

Source

accumulator.lisp (file)

5.1.2 Generic functions

Generic Function: accumulate ACCUMULATOR OBJECT

Accumulate _object_ to _accumulator_ instance. Methods of this generic function should specialize at least on the first argument (_accumulator_) and they should accumulate the second argument (_object_) to the accumulator object.

Package

general-accumulator

Source

accumulator.lisp (file)

Methods

Method: accumulate (ACC reduce-accumulator) ITEM

Method: accumulate (ACC list-accumulator) ITEM

Method: accumulate (ACC special-vector-accumulator) (ITEM cons)

Method: accumulate (ACC special-vector-accumulator) (ITEM vector)

Method: accumulate (ACC vector-accumulator) ITEM

Method: accumulate (ACC accumulator) ITEM around

Generic Function: initialize OBJECT &key &allow-other-keys

Return an accumulator object which is used to keep the information of an accumulation process.

The _object_ argument can anything and its primary purpose is a method dispatching: different classes of the _object_ establish different kind of accumulators. Methods can use the _object_ value too, as well as any keyword arguments passed to the generic function.

Methods should return an object, usually an instance of some class. That object can later be used with generic functions ‘accumulate‘ and ‘value‘.

Package

general-accumulator

Source

accumulator.lisp (file)

Methods

Method: initialize (FUNCTION function) &key

Method: initialize (OBJECT (eql list)) &key

Method: initialize (OBJECT list) &key

Method: initialize (OBJECT (eql bit-vector)) &key

Method: initialize (OBJECT (eql string)) &key

Method: initialize (OBJECT (eql vector)) &key

Method: initialize (OBJECT vector) &key

Generic Function: value ACCUMULATOR

Return the accumulated value of _accumulator_ object.

Package

general-accumulator

Source

accumulator.lisp (file)

Methods

Method: value (ACCUMULATOR accumulator)

automatically generated reader method

5.2 Internal definitions

5.2.1 Classes

Class: accumulator ()

Package

general-accumulator

Source

accumulator.lisp (file)

Direct superclasses

standard-object (class)

Direct subclasses

• vector-accumulator (class)
• list-accumulator (class)
• reduce-accumulator (class)

Direct methods

• accumulate (method)
• value (method)

Direct slots

Slot: value

Initargs

:value

Readers

value (generic function)

Class: list-accumulator ()

Package

general-accumulator

Source

accumulator.lisp (file)

Direct superclasses

accumulator (class)

Direct methods

accumulate (method)

Direct slots

Slot: last-cons

Initargs

:last-cons

Class: reduce-accumulator ()

Package

general-accumulator

Source

accumulator.lisp (file)

Direct superclasses

accumulator (class)

Direct methods

accumulate (method)

Direct slots

Slot: function

Initargs

:function

Class: special-vector-accumulator ()

Package

general-accumulator

Source

accumulator.lisp (file)

Direct superclasses

vector-accumulator (class)

Direct methods

• accumulate (method)
• accumulate (method)

Class: vector-accumulator ()

Package

general-accumulator

Source

accumulator.lisp (file)

Direct superclasses

accumulator (class)

Direct subclasses

special-vector-accumulator (class)

Direct methods

accumulate (method)

Appendix A Indexes

A.1 Concepts

A.2 Functions

A.3 Variables

A.4 Data types