This is the cl-online-learning Reference Manual, version 0.5, generated automatically by Declt version 4.0 beta 2 "William Riker" on Sun Sep 15 04:17:55 2024 GMT+0.
The main system appears first, followed by any subsystem dependency.
cl-online-learning
Online Machine Learning for Common Lisp
Satoshi Imai
MIT Licence
* Cl-Online-Learning
[[http://quickdocs.org/cl-online-learning/][http://quickdocs.org/badge/cl-online-learning.svg]]
[[https://github.com/masatoi/cl-online-learning/actions?query=workflow%3ACI][https://github.com/masatoi/cl-online-learning/workflows/CI/badge.svg]]
A collection of machine learning algorithms for online linear classification written in Common Lisp.
** Implemented algorithms
*** Binary classifier
- Perceptron
- AROW (Crammer, Koby, Alex Kulesza, and Mark Dredze. "Adaptive regularization of weight vectors." Advances in neural information processing systems. 2009.)
- SCW-I (Soft Confidence Weighted) (Wang, Jialei, Peilin Zhao, and Steven C. Hoi. "Exact Soft Confidence-Weighted Learning." Proceedings of the 29th International Conference on Machine Learning (ICML-12). 2012.)
- Logistic Regression with SGD or ADAM optimizer (Kingma, Diederik, and Jimmy Ba. "Adam: A method for stochastic optimization." ICLR 2015)
*** Multiclass classifier
- one-vs-rest ( K binary classifier required )
- one-vs-one ( K*(K-1)/2 binary classifier required )
*** Command line tools
- Implemented as roswell script
- See https://github.com/masatoi/cl-online-learning/wiki/Using-as-command-line-tools
** Installation
cl-online-learning is available from Quicklisp.
#+BEGIN_SRC
(ql:quickload :cl-online-learning)
#+END_SRC
When install from github repository,
#+BEGIN_SRC
cd ~/quicklisp/local-projects/
git clone https://github.com/masatoi/cl-online-learning.git
#+END_SRC
When using Roswell,
#+BEGIN_SRC
ros install masatoi/cl-online-learning
#+END_SRC
** Usage
*** Prepare dataset
A data point is a pair of a class label (+1 or -1) and a input vector. Both of them have to be declared as single-float.
And dataset is represented as a sequence of data points.
READ-DATA function is available to make a dataset from a sparse format used in LIBSVM (http://www.csie.ntu.edu.tw/~cjlin/libsvmtools/datasets/). This function requires the number of features of that dataset.
#+BEGIN_SRC lisp
;; Number of features
(defparameter a1a-dim 123)
;; Read dataset from file
(defparameter a1a
(clol.utils:read-data
(merge-pathnames #P"t/dataset/a1a" (asdf:system-source-directory :cl-online-learning))
a1a-dim))
;; A data point
(car a1a)
; (-1.0
; . #(0.0 0.0 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 0.0 0.0
; 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0
; 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0
; 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 0.0 0.0 0.0
; 1.0 0.0 1.0 1.0 0.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0
; 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0
; 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0))
#+END_SRC
*** Define learner
A learner object is just a struct, therefore their constructor is available to make it.
#+BEGIN_SRC lisp
(defparameter arow-learner (clol:make-arow a1a-dim 10))
#+END_SRC
*** Update and Train
To update the model destructively with one data point, use an update function corresponding to the model type.
#+BEGIN_SRC lisp
(clol:arow-update arow-learner
(cdar a1a) ; input
(caar a1a)) ; label
#+END_SRC
TRAIN function can be used to learn the dataset collectively.
#+BEGIN_SRC lisp
(clol:train arow-learner a1a)
#+END_SRC
It may be necessary to call this function several times until learning converges. For now, the convergence test has not been implemented yet.
*** Predict and Test
#+BEGIN_SRC lisp
(clol:arow-predict arow-learner (cdar a1a))
; => -1.0
(clol:test arow-learner a1a)
; Accuracy: 84.85981%, Correct: 1362, Total: 1605
#+END_SRC
*** Multiclass classification
For multiclass data, the label of the data point is an integer representing the index of the class. READ-DATA function with MULTICLASS-P keyword option is available for make such a dataset.
#+BEGIN_SRC lisp
(defparameter iris-dim 4)
; A dataset in which a same label appears consecutively need to be shuffled
(defparameter iris
(clol.utils:shuffle-vector
(coerce (clol.utils:read-data
(merge-pathnames #P"t/dataset/iris.scale"
(asdf:system-source-directory :cl-online-learning))
iris-dim :multiclass-p t)
’simple-vector)))
(defparameter iris-train (subseq iris 0 100))
(defparameter iris-test (subseq iris 100))
#+END_SRC
ONE-VS-REST and ONE-VS-ONE are available for multiclass classification by using multiple binary classifiers. In many cases, ONE-VS-ONE is more accurate, but it requires more computational resource as the number of classes increases.
#+BEGIN_SRC lisp
;; Define model
(defparameter arow-1vs1
(clol:make-one-vs-one iris-dim ; Input data dimension
3 ; Number of class
’arow 0.1)) ; Binary classifier type and its parameters
;; Train and test model
(clol:train arow-1vs1 iris-train)
(clol:test arow-1vs1 iris-test)
; Accuracy: 98.0%, Correct: 49, Total: 50
#+END_SRC
*** Sparse data
For sparse data (most elements are 0), the data point is a pair of a class label and a instance of SPARSE-VECTOR struct, and a learner with SPARSE- prefix is used. READ-DATA function with SPARSE-P keyword option is available for make such a dataset.
For example, news20.binary data has too high dimensional features to handle with normal learners. However, by using the sparse version, the learner can be trained with practical computational resources.
#+BEGIN_SRC lisp
(defparameter news20.binary-dim 1355191)
(defparameter news20.binary (clol.utils:read-data "/path/to/news20.binary" news20.binary-dim :sparse-p t))
(defparameter news20.binary.arow (clol:make-sparse-arow news20.binary-dim 10))
(time (loop repeat 20 do (clol:train news20.binary.arow news20.binary)))
;; Evaluation took:
;; 1.527 seconds of real time
;; 1.526852 seconds of total run time (1.526852 user, 0.000000 system)
;; 100.00% CPU
;; 5,176,917,149 processor cycles
;; 11,436,032 bytes consed
(clol:test news20.binary.arow news20.binary)
; Accuracy: 99.74495%, Correct: 19945, Total: 19996
#+END_SRC
In a similar way, the sparse version learners are also available in multiclass classification.
#+BEGIN_SRC lisp
(defparameter news20-dim 62060)
(defparameter news20-train (clol.utils:read-data "/path/to/news20.scale" news20-dim :sparse-p t :multiclass-p t))
(defparameter news20-test (clol.utils:read-data "/path/to/news20.t.scale" news20-dim :sparse-p t :multiclass-p t))
(defparameter news20-arow (clol:make-one-vs-rest news20-dim 20 ’sparse-arow 10))
(loop repeat 12 do (clol:train news20-arow news20-train))
(clol:test news20-arow news20-test)
; Accuracy: 86.90208%, Correct: 3470, Total: 3993
#+END_SRC
# *** Benchimark
*** Save/Restore model
For saving a learner model to a file or restoring from the model file, SAVE and RESTORE function are available respectively.
For the above multiclass classification example, saving / restoring code would be:
#+BEGIN_SRC lisp
;; Save
(clol:save arow-1vs1 #P"/tmp/iris.model")
;; Restore
(defparameter restored-learner (clol:restore #P"/tmp/iris.model"))
(clol:test restored-learner iris-test)
; Accuracy: 98.0%, Correct: 49, Total: 50
#+END_SRC
** Author
Satoshi Imai (satoshi.imai@gmail.com)
** Licence
This software is released under the MIT License, see LICENSE.txt.
0.5
cl-libsvm-format
(system).
cl-store
(system).
src
(module).
Modules are listed depth-first from the system components tree.
cl-online-learning/src
cl-online-learning
(system).
vector.lisp
(file).
utils.lisp
(file).
cl-online-learning.lisp
(file).
rls.lisp
(file).
Files are sorted by type and then listed depth-first from the systems components trees.
cl-online-learning/cl-online-learning.asd
cl-online-learning/src/vector.lisp
cl-online-learning/src/utils.lisp
cl-online-learning/src/cl-online-learning.lisp
cl-online-learning/src/rls.lisp
cl-online-learning/cl-online-learning.asd
cl-online-learning
(system).
cl-online-learning/src/vector.lisp
src
(module).
dosvec
(macro).
dot
(function).
dot!
(function).
dovec
(macro).
dps-v*
(function).
dps-v+
(function).
dps-v-
(function).
ds-dot
(function).
ds-dot!
(function).
ds-v*
(function).
ds-v+
(function).
ds-v-
(function).
ds-v/
(function).
ds2s-v*
(function).
make-empty-sparse-vector
(function).
make-sparse-vector
(function).
make-vec
(function).
ps-v*n
(function).
s-v*n
(function).
sparse-vector
(structure).
sparse-vector-index-vector
(reader).
(setf sparse-vector-index-vector)
(writer).
sparse-vector-length
(reader).
(setf sparse-vector-length)
(writer).
sparse-vector-value-vector
(reader).
(setf sparse-vector-value-vector)
(writer).
sps-v*n
(function).
v*
(function).
v*n
(function).
v+
(function).
v+n
(function).
v-
(function).
v-sqrt
(function).
v/
(function).
%make-sparse-vector
(function).
copy-sparse-vector
(function).
sparse-vector-p
(function).
cl-online-learning/src/utils.lisp
vector.lisp
(file).
src
(module).
class-min/max
(function).
defmain
(macro).
read-data
(function).
shuffle-vector
(function).
to-float
(function).
to-int
(function).
arg-list->lambda-arg
(function).
argument-error
(condition).
argument-error-message
(reader method).
(setf argument-error-message)
(writer method).
doseq
(macro).
flatten
(function).
group-arg-list
(function).
mean-vector
(function).
read-datum
(function).
read-datum-sparse
(function).
sanity-check
(function).
split-lambda-list
(function).
standard-deviation-vector
(function).
cl-online-learning/src/cl-online-learning.lisp
vector.lisp
(file).
src
(module).
arow-predict
(function).
arow-test
(function).
arow-train
(function).
arow-update
(function).
dim-of
(function).
lr+adam-predict
(function).
lr+adam-test
(function).
lr+adam-train
(function).
lr+adam-update
(function).
lr+sgd-predict
(function).
lr+sgd-test
(function).
lr+sgd-train
(function).
lr+sgd-update
(function).
make-arow
(function).
make-lr+adam
(function).
make-lr+sgd
(function).
make-one-vs-one
(function).
make-one-vs-rest
(function).
make-perceptron
(function).
make-scw
(function).
make-sparse-arow
(function).
make-sparse-lr+adam
(function).
make-sparse-lr+sgd
(function).
make-sparse-perceptron
(function).
make-sparse-scw
(function).
n-class-of
(function).
one-vs-one-predict
(function).
one-vs-one-test
(function).
one-vs-one-train
(function).
one-vs-one-update
(function).
one-vs-rest-predict
(function).
one-vs-rest-test
(function).
one-vs-rest-train
(function).
one-vs-rest-update
(function).
perceptron-predict
(function).
perceptron-test
(function).
perceptron-train
(function).
perceptron-update
(function).
print-object
(method).
print-object
(method).
print-object
(method).
print-object
(method).
print-object
(method).
print-object
(method).
print-object
(method).
print-object
(method).
print-object
(method).
print-object
(method).
restore
(function).
save
(function).
scw-predict
(function).
scw-test
(function).
scw-train
(function).
scw-update
(function).
sparse-arow-predict
(function).
sparse-arow-test
(function).
sparse-arow-train
(function).
sparse-arow-update
(function).
sparse-learner?
(function).
sparse-lr+adam-predict
(function).
sparse-lr+adam-test
(function).
sparse-lr+adam-train
(function).
sparse-lr+adam-update
(function).
sparse-lr+sgd-predict
(function).
sparse-lr+sgd-test
(function).
sparse-lr+sgd-train
(function).
sparse-lr+sgd-update
(function).
sparse-perceptron-predict
(function).
sparse-perceptron-test
(function).
sparse-perceptron-train
(function).
sparse-perceptron-update
(function).
sparse-scw-predict
(function).
sparse-scw-test
(function).
sparse-scw-train
(function).
sparse-scw-update
(function).
test
(function).
train
(function).
%make-arow
(function).
%make-lr+adam
(function).
%make-lr+sgd
(function).
%make-one-vs-one
(function).
%make-one-vs-rest
(function).
%make-perceptron
(function).
%make-scw
(function).
%make-sparse-arow
(function).
%make-sparse-lr+adam
(function).
%make-sparse-lr+sgd
(function).
%make-sparse-perceptron
(function).
%make-sparse-scw
(function).
%print-arow
(function).
%print-lr+adam
(function).
%print-one-vs-one
(function).
%print-one-vs-rest
(function).
%print-perceptron
(function).
%print-scw
(function).
%print-sparse-arow
(function).
%print-sparse-lr+adam
(function).
%print-sparse-perceptron
(function).
%print-sparse-scw
(function).
arow
(structure).
arow-bias
(reader).
(setf arow-bias)
(writer).
arow-gamma
(reader).
(setf arow-gamma)
(writer).
arow-input-dimension
(reader).
(setf arow-input-dimension)
(writer).
arow-p
(function).
arow-sigma
(reader).
(setf arow-sigma)
(writer).
arow-sigma0
(reader).
(setf arow-sigma0)
(writer).
arow-tmp-float
(reader).
(setf arow-tmp-float)
(writer).
arow-tmp-vec1
(reader).
(setf arow-tmp-vec1)
(writer).
arow-tmp-vec2
(reader).
(setf arow-tmp-vec2)
(writer).
arow-weight
(reader).
(setf arow-weight)
(writer).
catstr
(macro).
copy-arow
(function).
copy-lr+adam
(function).
copy-lr+sgd
(function).
copy-one-vs-one
(function).
copy-one-vs-rest
(function).
copy-perceptron
(function).
copy-scw
(function).
copy-sparse-arow
(function).
copy-sparse-lr+adam
(function).
copy-sparse-lr+sgd
(function).
copy-sparse-perceptron
(function).
copy-sparse-scw
(function).
define-learner
(macro).
define-multi-class-learner-train/test-functions
(macro).
f
(function).
f!
(function).
function-by-name
(macro).
index-of-learner
(function).
inverse-erf
(function).
logistic-regression-gradient!
(function).
logistic-regression-gradient-sparse!
(function).
lr+adam
(structure).
lr+adam-alpha
(reader).
(setf lr+adam-alpha)
(writer).
lr+adam-beta1
(reader).
(setf lr+adam-beta1)
(writer).
lr+adam-beta1^t
(reader).
(setf lr+adam-beta1^t)
(writer).
lr+adam-beta2
(reader).
(setf lr+adam-beta2)
(writer).
lr+adam-beta2^t
(reader).
(setf lr+adam-beta2^t)
(writer).
lr+adam-bias
(reader).
(setf lr+adam-bias)
(writer).
lr+adam-c
(reader).
(setf lr+adam-c)
(writer).
lr+adam-epsilon
(reader).
(setf lr+adam-epsilon)
(writer).
lr+adam-g
(reader).
(setf lr+adam-g)
(writer).
lr+adam-input-dimension
(reader).
(setf lr+adam-input-dimension)
(writer).
lr+adam-m
(reader).
(setf lr+adam-m)
(writer).
lr+adam-m0
(reader).
(setf lr+adam-m0)
(writer).
lr+adam-p
(function).
lr+adam-tmp-float
(reader).
(setf lr+adam-tmp-float)
(writer).
lr+adam-tmp-vec
(reader).
(setf lr+adam-tmp-vec)
(writer).
lr+adam-v
(reader).
(setf lr+adam-v)
(writer).
lr+adam-v0
(reader).
(setf lr+adam-v0)
(writer).
lr+adam-weight
(reader).
(setf lr+adam-weight)
(writer).
lr+sgd
(structure).
lr+sgd-bias
(reader).
(setf lr+sgd-bias)
(writer).
lr+sgd-c
(reader).
(setf lr+sgd-c)
(writer).
lr+sgd-eta
(reader).
(setf lr+sgd-eta)
(writer).
lr+sgd-g
(reader).
(setf lr+sgd-g)
(writer).
lr+sgd-input-dimension
(reader).
(setf lr+sgd-input-dimension)
(writer).
lr+sgd-p
(function).
lr+sgd-tmp-float
(reader).
(setf lr+sgd-tmp-float)
(writer).
lr+sgd-tmp-vec
(reader).
(setf lr+sgd-tmp-vec)
(writer).
lr+sgd-weight
(reader).
(setf lr+sgd-weight)
(writer).
one-vs-one
(structure).
one-vs-one-clear-functions-for-store
(function).
one-vs-one-input-dimension
(reader).
(setf one-vs-one-input-dimension)
(writer).
one-vs-one-learner-predict
(reader).
(setf one-vs-one-learner-predict)
(writer).
one-vs-one-learner-update
(reader).
(setf one-vs-one-learner-update)
(writer).
one-vs-one-learners-vector
(reader).
(setf one-vs-one-learners-vector)
(writer).
one-vs-one-n-class
(reader).
(setf one-vs-one-n-class)
(writer).
one-vs-one-p
(function).
one-vs-one-restore-functions
(function).
one-vs-rest
(structure).
one-vs-rest-clear-functions-for-store
(function).
one-vs-rest-input-dimension
(reader).
(setf one-vs-rest-input-dimension)
(writer).
one-vs-rest-learner-activate
(reader).
(setf one-vs-rest-learner-activate)
(writer).
one-vs-rest-learner-bias
(reader).
(setf one-vs-rest-learner-bias)
(writer).
one-vs-rest-learner-update
(reader).
(setf one-vs-rest-learner-update)
(writer).
one-vs-rest-learner-weight
(reader).
(setf one-vs-rest-learner-weight)
(writer).
one-vs-rest-learners-vector
(reader).
(setf one-vs-rest-learners-vector)
(writer).
one-vs-rest-n-class
(reader).
(setf one-vs-rest-n-class)
(writer).
one-vs-rest-p
(function).
one-vs-rest-restore-functions
(function).
perceptron
(structure).
perceptron-bias
(reader).
(setf perceptron-bias)
(writer).
perceptron-input-dimension
(reader).
(setf perceptron-input-dimension)
(writer).
perceptron-p
(function).
perceptron-tmp-float
(reader).
(setf perceptron-tmp-float)
(writer).
perceptron-weight
(reader).
(setf perceptron-weight)
(writer).
probit
(function).
scw
(structure).
scw-bias
(reader).
(setf scw-bias)
(writer).
scw-c
(reader).
(setf scw-c)
(writer).
scw-eta
(reader).
(setf scw-eta)
(writer).
scw-input-dimension
(reader).
(setf scw-input-dimension)
(writer).
scw-p
(function).
scw-phi
(reader).
(setf scw-phi)
(writer).
scw-psi
(reader).
(setf scw-psi)
(writer).
scw-sigma
(reader).
(setf scw-sigma)
(writer).
scw-sigma0
(reader).
(setf scw-sigma0)
(writer).
scw-tmp-float
(reader).
(setf scw-tmp-float)
(writer).
scw-tmp-vec1
(reader).
(setf scw-tmp-vec1)
(writer).
scw-tmp-vec2
(reader).
(setf scw-tmp-vec2)
(writer).
scw-weight
(reader).
(setf scw-weight)
(writer).
scw-zeta
(reader).
(setf scw-zeta)
(writer).
sf
(function).
sf!
(function).
sigmoid
(macro).
sign
(function).
sparse-arow
(structure).
sparse-arow-bias
(reader).
(setf sparse-arow-bias)
(writer).
sparse-arow-gamma
(reader).
(setf sparse-arow-gamma)
(writer).
sparse-arow-input-dimension
(reader).
(setf sparse-arow-input-dimension)
(writer).
sparse-arow-p
(function).
sparse-arow-sigma
(reader).
(setf sparse-arow-sigma)
(writer).
sparse-arow-sigma0
(reader).
(setf sparse-arow-sigma0)
(writer).
sparse-arow-tmp-float
(reader).
(setf sparse-arow-tmp-float)
(writer).
sparse-arow-tmp-vec1
(reader).
(setf sparse-arow-tmp-vec1)
(writer).
sparse-arow-tmp-vec2
(reader).
(setf sparse-arow-tmp-vec2)
(writer).
sparse-arow-weight
(reader).
(setf sparse-arow-weight)
(writer).
sparse-lr+adam
(structure).
sparse-lr+adam-alpha
(reader).
(setf sparse-lr+adam-alpha)
(writer).
sparse-lr+adam-beta1
(reader).
(setf sparse-lr+adam-beta1)
(writer).
sparse-lr+adam-beta1^t
(reader).
(setf sparse-lr+adam-beta1^t)
(writer).
sparse-lr+adam-beta2
(reader).
(setf sparse-lr+adam-beta2)
(writer).
sparse-lr+adam-beta2^t
(reader).
(setf sparse-lr+adam-beta2^t)
(writer).
sparse-lr+adam-bias
(reader).
(setf sparse-lr+adam-bias)
(writer).
sparse-lr+adam-c
(reader).
(setf sparse-lr+adam-c)
(writer).
sparse-lr+adam-epsilon
(reader).
(setf sparse-lr+adam-epsilon)
(writer).
sparse-lr+adam-g
(reader).
(setf sparse-lr+adam-g)
(writer).
sparse-lr+adam-input-dimension
(reader).
(setf sparse-lr+adam-input-dimension)
(writer).
sparse-lr+adam-m
(reader).
(setf sparse-lr+adam-m)
(writer).
sparse-lr+adam-m0
(reader).
(setf sparse-lr+adam-m0)
(writer).
sparse-lr+adam-p
(function).
sparse-lr+adam-tmp-float
(reader).
(setf sparse-lr+adam-tmp-float)
(writer).
sparse-lr+adam-tmp-vec
(reader).
(setf sparse-lr+adam-tmp-vec)
(writer).
sparse-lr+adam-v
(reader).
(setf sparse-lr+adam-v)
(writer).
sparse-lr+adam-v0
(reader).
(setf sparse-lr+adam-v0)
(writer).
sparse-lr+adam-weight
(reader).
(setf sparse-lr+adam-weight)
(writer).
sparse-lr+sgd
(structure).
sparse-lr+sgd-bias
(reader).
(setf sparse-lr+sgd-bias)
(writer).
sparse-lr+sgd-c
(reader).
(setf sparse-lr+sgd-c)
(writer).
sparse-lr+sgd-eta
(reader).
(setf sparse-lr+sgd-eta)
(writer).
sparse-lr+sgd-g
(reader).
(setf sparse-lr+sgd-g)
(writer).
sparse-lr+sgd-input-dimension
(reader).
(setf sparse-lr+sgd-input-dimension)
(writer).
sparse-lr+sgd-p
(function).
sparse-lr+sgd-tmp-float
(reader).
(setf sparse-lr+sgd-tmp-float)
(writer).
sparse-lr+sgd-tmp-vec
(reader).
(setf sparse-lr+sgd-tmp-vec)
(writer).
sparse-lr+sgd-weight
(reader).
(setf sparse-lr+sgd-weight)
(writer).
sparse-perceptron
(structure).
sparse-perceptron-bias
(reader).
(setf sparse-perceptron-bias)
(writer).
sparse-perceptron-input-dimension
(reader).
(setf sparse-perceptron-input-dimension)
(writer).
sparse-perceptron-p
(function).
sparse-perceptron-tmp-float
(reader).
(setf sparse-perceptron-tmp-float)
(writer).
sparse-perceptron-weight
(reader).
(setf sparse-perceptron-weight)
(writer).
sparse-scw
(structure).
sparse-scw-bias
(reader).
(setf sparse-scw-bias)
(writer).
sparse-scw-c
(reader).
(setf sparse-scw-c)
(writer).
sparse-scw-eta
(reader).
(setf sparse-scw-eta)
(writer).
sparse-scw-input-dimension
(reader).
(setf sparse-scw-input-dimension)
(writer).
sparse-scw-p
(function).
sparse-scw-phi
(reader).
(setf sparse-scw-phi)
(writer).
sparse-scw-psi
(reader).
(setf sparse-scw-psi)
(writer).
sparse-scw-sigma
(reader).
(setf sparse-scw-sigma)
(writer).
sparse-scw-sigma0
(reader).
(setf sparse-scw-sigma0)
(writer).
sparse-scw-tmp-float
(reader).
(setf sparse-scw-tmp-float)
(writer).
sparse-scw-tmp-vec1
(reader).
(setf sparse-scw-tmp-vec1)
(writer).
sparse-scw-tmp-vec2
(reader).
(setf sparse-scw-tmp-vec2)
(writer).
sparse-scw-weight
(reader).
(setf sparse-scw-weight)
(writer).
sparse-scw-zeta
(reader).
(setf sparse-scw-zeta)
(writer).
sparse-symbol?
(function).
sum-permutation
(function).
cl-online-learning/src/rls.lisp
vector.lisp
(file).
cl-online-learning.lisp
(file).
src
(module).
make-rls
(function).
make-sparse-rls
(function).
print-object
(method).
print-object
(method).
rls-predict
(function).
rls-test
(function).
rls-train
(function).
rls-update
(function).
sparse-rls-predict
(function).
sparse-rls-test
(function).
sparse-rls-train
(function).
sparse-rls-update
(function).
%make-rls
(function).
%make-sparse-rls
(function).
%print-rls
(function).
%print-sparse-rls
(function).
copy-rls
(function).
copy-sparse-rls
(function).
define-regression-learner
(macro).
rls
(structure).
rls-bias
(reader).
(setf rls-bias)
(writer).
rls-gamma
(reader).
(setf rls-gamma)
(writer).
rls-input-dimension
(reader).
(setf rls-input-dimension)
(writer).
rls-p
(function).
rls-sigma
(reader).
(setf rls-sigma)
(writer).
rls-sigma0
(reader).
(setf rls-sigma0)
(writer).
rls-tmp-float
(reader).
(setf rls-tmp-float)
(writer).
rls-tmp-vec1
(reader).
(setf rls-tmp-vec1)
(writer).
rls-tmp-vec2
(reader).
(setf rls-tmp-vec2)
(writer).
rls-weight
(reader).
(setf rls-weight)
(writer).
sparse-rls
(structure).
sparse-rls-bias
(reader).
(setf sparse-rls-bias)
(writer).
sparse-rls-gamma
(reader).
(setf sparse-rls-gamma)
(writer).
sparse-rls-input-dimension
(reader).
(setf sparse-rls-input-dimension)
(writer).
sparse-rls-p
(function).
sparse-rls-sigma
(reader).
(setf sparse-rls-sigma)
(writer).
sparse-rls-sigma0
(reader).
(setf sparse-rls-sigma0)
(writer).
sparse-rls-tmp-float
(reader).
(setf sparse-rls-tmp-float)
(writer).
sparse-rls-tmp-vec1
(reader).
(setf sparse-rls-tmp-vec1)
(writer).
sparse-rls-tmp-vec2
(reader).
(setf sparse-rls-tmp-vec2)
(writer).
sparse-rls-weight
(reader).
(setf sparse-rls-weight)
(writer).
Packages are listed by definition order.
cl-online-learning.utils
clol.utils
cl-online-learning.vector
.
common-lisp
.
class-min/max
(function).
defmain
(macro).
read-data
(function).
shuffle-vector
(function).
to-float
(function).
to-int
(function).
arg-list->lambda-arg
(function).
argument-error
(condition).
argument-error-message
(generic reader).
(setf argument-error-message)
(generic writer).
doseq
(macro).
flatten
(function).
group-arg-list
(function).
mean-vector
(function).
read-datum
(function).
read-datum-sparse
(function).
sanity-check
(function).
split-lambda-list
(function).
standard-deviation-vector
(function).
cl-online-learning
clol
cl-online-learning.vector
.
common-lisp
.
arow-predict
(function).
arow-test
(function).
arow-train
(function).
arow-update
(function).
dim-of
(function).
lr+adam-predict
(function).
lr+adam-test
(function).
lr+adam-train
(function).
lr+adam-update
(function).
lr+sgd-predict
(function).
lr+sgd-test
(function).
lr+sgd-train
(function).
lr+sgd-update
(function).
make-arow
(function).
make-lr+adam
(function).
make-lr+sgd
(function).
make-one-vs-one
(function).
make-one-vs-rest
(function).
make-perceptron
(function).
make-rls
(function).
make-scw
(function).
make-sparse-arow
(function).
make-sparse-lr+adam
(function).
make-sparse-lr+sgd
(function).
make-sparse-perceptron
(function).
make-sparse-rls
(function).
make-sparse-scw
(function).
n-class-of
(function).
one-vs-one-predict
(function).
one-vs-one-test
(function).
one-vs-one-train
(function).
one-vs-one-update
(function).
one-vs-rest-predict
(function).
one-vs-rest-test
(function).
one-vs-rest-train
(function).
one-vs-rest-update
(function).
perceptron-predict
(function).
perceptron-test
(function).
perceptron-train
(function).
perceptron-update
(function).
restore
(function).
rls-predict
(function).
rls-test
(function).
rls-train
(function).
rls-update
(function).
save
(function).
scw-predict
(function).
scw-test
(function).
scw-train
(function).
scw-update
(function).
sparse-arow-predict
(function).
sparse-arow-test
(function).
sparse-arow-train
(function).
sparse-arow-update
(function).
sparse-learner?
(function).
sparse-lr+adam-predict
(function).
sparse-lr+adam-test
(function).
sparse-lr+adam-train
(function).
sparse-lr+adam-update
(function).
sparse-lr+sgd-predict
(function).
sparse-lr+sgd-test
(function).
sparse-lr+sgd-train
(function).
sparse-lr+sgd-update
(function).
sparse-perceptron-predict
(function).
sparse-perceptron-test
(function).
sparse-perceptron-train
(function).
sparse-perceptron-update
(function).
sparse-rls-predict
(function).
sparse-rls-test
(function).
sparse-rls-train
(function).
sparse-rls-update
(function).
sparse-scw-predict
(function).
sparse-scw-test
(function).
sparse-scw-train
(function).
sparse-scw-update
(function).
test
(function).
train
(function).
%make-arow
(function).
%make-lr+adam
(function).
%make-lr+sgd
(function).
%make-one-vs-one
(function).
%make-one-vs-rest
(function).
%make-perceptron
(function).
%make-rls
(function).
%make-scw
(function).
%make-sparse-arow
(function).
%make-sparse-lr+adam
(function).
%make-sparse-lr+sgd
(function).
%make-sparse-perceptron
(function).
%make-sparse-rls
(function).
%make-sparse-scw
(function).
%print-arow
(function).
%print-lr+adam
(function).
%print-one-vs-one
(function).
%print-one-vs-rest
(function).
%print-perceptron
(function).
%print-rls
(function).
%print-scw
(function).
%print-sparse-arow
(function).
%print-sparse-lr+adam
(function).
%print-sparse-perceptron
(function).
%print-sparse-rls
(function).
%print-sparse-scw
(function).
arow
(structure).
arow-bias
(reader).
(setf arow-bias)
(writer).
arow-gamma
(reader).
(setf arow-gamma)
(writer).
arow-input-dimension
(reader).
(setf arow-input-dimension)
(writer).
arow-p
(function).
arow-sigma
(reader).
(setf arow-sigma)
(writer).
arow-sigma0
(reader).
(setf arow-sigma0)
(writer).
arow-tmp-float
(reader).
(setf arow-tmp-float)
(writer).
arow-tmp-vec1
(reader).
(setf arow-tmp-vec1)
(writer).
arow-tmp-vec2
(reader).
(setf arow-tmp-vec2)
(writer).
arow-weight
(reader).
(setf arow-weight)
(writer).
catstr
(macro).
copy-arow
(function).
copy-lr+adam
(function).
copy-lr+sgd
(function).
copy-one-vs-one
(function).
copy-one-vs-rest
(function).
copy-perceptron
(function).
copy-rls
(function).
copy-scw
(function).
copy-sparse-arow
(function).
copy-sparse-lr+adam
(function).
copy-sparse-lr+sgd
(function).
copy-sparse-perceptron
(function).
copy-sparse-rls
(function).
copy-sparse-scw
(function).
define-learner
(macro).
define-multi-class-learner-train/test-functions
(macro).
define-regression-learner
(macro).
f
(function).
f!
(function).
function-by-name
(macro).
index-of-learner
(function).
inverse-erf
(function).
logistic-regression-gradient!
(function).
logistic-regression-gradient-sparse!
(function).
lr+adam
(structure).
lr+adam-alpha
(reader).
(setf lr+adam-alpha)
(writer).
lr+adam-beta1
(reader).
(setf lr+adam-beta1)
(writer).
lr+adam-beta1^t
(reader).
(setf lr+adam-beta1^t)
(writer).
lr+adam-beta2
(reader).
(setf lr+adam-beta2)
(writer).
lr+adam-beta2^t
(reader).
(setf lr+adam-beta2^t)
(writer).
lr+adam-bias
(reader).
(setf lr+adam-bias)
(writer).
lr+adam-c
(reader).
(setf lr+adam-c)
(writer).
lr+adam-epsilon
(reader).
(setf lr+adam-epsilon)
(writer).
lr+adam-g
(reader).
(setf lr+adam-g)
(writer).
lr+adam-input-dimension
(reader).
(setf lr+adam-input-dimension)
(writer).
lr+adam-m
(reader).
(setf lr+adam-m)
(writer).
lr+adam-m0
(reader).
(setf lr+adam-m0)
(writer).
lr+adam-p
(function).
lr+adam-tmp-float
(reader).
(setf lr+adam-tmp-float)
(writer).
lr+adam-tmp-vec
(reader).
(setf lr+adam-tmp-vec)
(writer).
lr+adam-v
(reader).
(setf lr+adam-v)
(writer).
lr+adam-v0
(reader).
(setf lr+adam-v0)
(writer).
lr+adam-weight
(reader).
(setf lr+adam-weight)
(writer).
lr+sgd
(structure).
lr+sgd-bias
(reader).
(setf lr+sgd-bias)
(writer).
lr+sgd-c
(reader).
(setf lr+sgd-c)
(writer).
lr+sgd-eta
(reader).
(setf lr+sgd-eta)
(writer).
lr+sgd-g
(reader).
(setf lr+sgd-g)
(writer).
lr+sgd-input-dimension
(reader).
(setf lr+sgd-input-dimension)
(writer).
lr+sgd-p
(function).
lr+sgd-tmp-float
(reader).
(setf lr+sgd-tmp-float)
(writer).
lr+sgd-tmp-vec
(reader).
(setf lr+sgd-tmp-vec)
(writer).
lr+sgd-weight
(reader).
(setf lr+sgd-weight)
(writer).
one-vs-one
(structure).
one-vs-one-clear-functions-for-store
(function).
one-vs-one-input-dimension
(reader).
(setf one-vs-one-input-dimension)
(writer).
one-vs-one-learner-predict
(reader).
(setf one-vs-one-learner-predict)
(writer).
one-vs-one-learner-update
(reader).
(setf one-vs-one-learner-update)
(writer).
one-vs-one-learners-vector
(reader).
(setf one-vs-one-learners-vector)
(writer).
one-vs-one-n-class
(reader).
(setf one-vs-one-n-class)
(writer).
one-vs-one-p
(function).
one-vs-one-restore-functions
(function).
one-vs-rest
(structure).
one-vs-rest-clear-functions-for-store
(function).
one-vs-rest-input-dimension
(reader).
(setf one-vs-rest-input-dimension)
(writer).
one-vs-rest-learner-activate
(reader).
(setf one-vs-rest-learner-activate)
(writer).
one-vs-rest-learner-bias
(reader).
(setf one-vs-rest-learner-bias)
(writer).
one-vs-rest-learner-update
(reader).
(setf one-vs-rest-learner-update)
(writer).
one-vs-rest-learner-weight
(reader).
(setf one-vs-rest-learner-weight)
(writer).
one-vs-rest-learners-vector
(reader).
(setf one-vs-rest-learners-vector)
(writer).
one-vs-rest-n-class
(reader).
(setf one-vs-rest-n-class)
(writer).
one-vs-rest-p
(function).
one-vs-rest-restore-functions
(function).
perceptron
(structure).
perceptron-bias
(reader).
(setf perceptron-bias)
(writer).
perceptron-input-dimension
(reader).
(setf perceptron-input-dimension)
(writer).
perceptron-p
(function).
perceptron-tmp-float
(reader).
(setf perceptron-tmp-float)
(writer).
perceptron-weight
(reader).
(setf perceptron-weight)
(writer).
probit
(function).
rls
(structure).
rls-bias
(reader).
(setf rls-bias)
(writer).
rls-gamma
(reader).
(setf rls-gamma)
(writer).
rls-input-dimension
(reader).
(setf rls-input-dimension)
(writer).
rls-p
(function).
rls-sigma
(reader).
(setf rls-sigma)
(writer).
rls-sigma0
(reader).
(setf rls-sigma0)
(writer).
rls-tmp-float
(reader).
(setf rls-tmp-float)
(writer).
rls-tmp-vec1
(reader).
(setf rls-tmp-vec1)
(writer).
rls-tmp-vec2
(reader).
(setf rls-tmp-vec2)
(writer).
rls-weight
(reader).
(setf rls-weight)
(writer).
scw
(structure).
scw-bias
(reader).
(setf scw-bias)
(writer).
scw-c
(reader).
(setf scw-c)
(writer).
scw-eta
(reader).
(setf scw-eta)
(writer).
scw-input-dimension
(reader).
(setf scw-input-dimension)
(writer).
scw-p
(function).
scw-phi
(reader).
(setf scw-phi)
(writer).
scw-psi
(reader).
(setf scw-psi)
(writer).
scw-sigma
(reader).
(setf scw-sigma)
(writer).
scw-sigma0
(reader).
(setf scw-sigma0)
(writer).
scw-tmp-float
(reader).
(setf scw-tmp-float)
(writer).
scw-tmp-vec1
(reader).
(setf scw-tmp-vec1)
(writer).
scw-tmp-vec2
(reader).
(setf scw-tmp-vec2)
(writer).
scw-weight
(reader).
(setf scw-weight)
(writer).
scw-zeta
(reader).
(setf scw-zeta)
(writer).
sf
(function).
sf!
(function).
sigmoid
(macro).
sign
(function).
sparse-arow
(structure).
sparse-arow-bias
(reader).
(setf sparse-arow-bias)
(writer).
sparse-arow-gamma
(reader).
(setf sparse-arow-gamma)
(writer).
sparse-arow-input-dimension
(reader).
(setf sparse-arow-input-dimension)
(writer).
sparse-arow-p
(function).
sparse-arow-sigma
(reader).
(setf sparse-arow-sigma)
(writer).
sparse-arow-sigma0
(reader).
(setf sparse-arow-sigma0)
(writer).
sparse-arow-tmp-float
(reader).
(setf sparse-arow-tmp-float)
(writer).
sparse-arow-tmp-vec1
(reader).
(setf sparse-arow-tmp-vec1)
(writer).
sparse-arow-tmp-vec2
(reader).
(setf sparse-arow-tmp-vec2)
(writer).
sparse-arow-weight
(reader).
(setf sparse-arow-weight)
(writer).
sparse-lr+adam
(structure).
sparse-lr+adam-alpha
(reader).
(setf sparse-lr+adam-alpha)
(writer).
sparse-lr+adam-beta1
(reader).
(setf sparse-lr+adam-beta1)
(writer).
sparse-lr+adam-beta1^t
(reader).
(setf sparse-lr+adam-beta1^t)
(writer).
sparse-lr+adam-beta2
(reader).
(setf sparse-lr+adam-beta2)
(writer).
sparse-lr+adam-beta2^t
(reader).
(setf sparse-lr+adam-beta2^t)
(writer).
sparse-lr+adam-bias
(reader).
(setf sparse-lr+adam-bias)
(writer).
sparse-lr+adam-c
(reader).
(setf sparse-lr+adam-c)
(writer).
sparse-lr+adam-epsilon
(reader).
(setf sparse-lr+adam-epsilon)
(writer).
sparse-lr+adam-g
(reader).
(setf sparse-lr+adam-g)
(writer).
sparse-lr+adam-input-dimension
(reader).
(setf sparse-lr+adam-input-dimension)
(writer).
sparse-lr+adam-m
(reader).
(setf sparse-lr+adam-m)
(writer).
sparse-lr+adam-m0
(reader).
(setf sparse-lr+adam-m0)
(writer).
sparse-lr+adam-p
(function).
sparse-lr+adam-tmp-float
(reader).
(setf sparse-lr+adam-tmp-float)
(writer).
sparse-lr+adam-tmp-vec
(reader).
(setf sparse-lr+adam-tmp-vec)
(writer).
sparse-lr+adam-v
(reader).
(setf sparse-lr+adam-v)
(writer).
sparse-lr+adam-v0
(reader).
(setf sparse-lr+adam-v0)
(writer).
sparse-lr+adam-weight
(reader).
(setf sparse-lr+adam-weight)
(writer).
sparse-lr+sgd
(structure).
sparse-lr+sgd-bias
(reader).
(setf sparse-lr+sgd-bias)
(writer).
sparse-lr+sgd-c
(reader).
(setf sparse-lr+sgd-c)
(writer).
sparse-lr+sgd-eta
(reader).
(setf sparse-lr+sgd-eta)
(writer).
sparse-lr+sgd-g
(reader).
(setf sparse-lr+sgd-g)
(writer).
sparse-lr+sgd-input-dimension
(reader).
(setf sparse-lr+sgd-input-dimension)
(writer).
sparse-lr+sgd-p
(function).
sparse-lr+sgd-tmp-float
(reader).
(setf sparse-lr+sgd-tmp-float)
(writer).
sparse-lr+sgd-tmp-vec
(reader).
(setf sparse-lr+sgd-tmp-vec)
(writer).
sparse-lr+sgd-weight
(reader).
(setf sparse-lr+sgd-weight)
(writer).
sparse-perceptron
(structure).
sparse-perceptron-bias
(reader).
(setf sparse-perceptron-bias)
(writer).
sparse-perceptron-input-dimension
(reader).
(setf sparse-perceptron-input-dimension)
(writer).
sparse-perceptron-p
(function).
sparse-perceptron-tmp-float
(reader).
(setf sparse-perceptron-tmp-float)
(writer).
sparse-perceptron-weight
(reader).
(setf sparse-perceptron-weight)
(writer).
sparse-rls
(structure).
sparse-rls-bias
(reader).
(setf sparse-rls-bias)
(writer).
sparse-rls-gamma
(reader).
(setf sparse-rls-gamma)
(writer).
sparse-rls-input-dimension
(reader).
(setf sparse-rls-input-dimension)
(writer).
sparse-rls-p
(function).
sparse-rls-sigma
(reader).
(setf sparse-rls-sigma)
(writer).
sparse-rls-sigma0
(reader).
(setf sparse-rls-sigma0)
(writer).
sparse-rls-tmp-float
(reader).
(setf sparse-rls-tmp-float)
(writer).
sparse-rls-tmp-vec1
(reader).
(setf sparse-rls-tmp-vec1)
(writer).
sparse-rls-tmp-vec2
(reader).
(setf sparse-rls-tmp-vec2)
(writer).
sparse-rls-weight
(reader).
(setf sparse-rls-weight)
(writer).
sparse-scw
(structure).
sparse-scw-bias
(reader).
(setf sparse-scw-bias)
(writer).
sparse-scw-c
(reader).
(setf sparse-scw-c)
(writer).
sparse-scw-eta
(reader).
(setf sparse-scw-eta)
(writer).
sparse-scw-input-dimension
(reader).
(setf sparse-scw-input-dimension)
(writer).
sparse-scw-p
(function).
sparse-scw-phi
(reader).
(setf sparse-scw-phi)
(writer).
sparse-scw-psi
(reader).
(setf sparse-scw-psi)
(writer).
sparse-scw-sigma
(reader).
(setf sparse-scw-sigma)
(writer).
sparse-scw-sigma0
(reader).
(setf sparse-scw-sigma0)
(writer).
sparse-scw-tmp-float
(reader).
(setf sparse-scw-tmp-float)
(writer).
sparse-scw-tmp-vec1
(reader).
(setf sparse-scw-tmp-vec1)
(writer).
sparse-scw-tmp-vec2
(reader).
(setf sparse-scw-tmp-vec2)
(writer).
sparse-scw-weight
(reader).
(setf sparse-scw-weight)
(writer).
sparse-scw-zeta
(reader).
(setf sparse-scw-zeta)
(writer).
sparse-symbol?
(function).
sum-permutation
(function).
cl-online-learning.vector
clol.vector
common-lisp
.
dosvec
(macro).
dot
(function).
dot!
(function).
dovec
(macro).
dps-v*
(function).
dps-v+
(function).
dps-v-
(function).
ds-dot
(function).
ds-dot!
(function).
ds-v*
(function).
ds-v+
(function).
ds-v-
(function).
ds-v/
(function).
ds2s-v*
(function).
make-empty-sparse-vector
(function).
make-sparse-vector
(function).
make-vec
(function).
ps-v*n
(function).
s-v*n
(function).
sparse-vector
(structure).
sparse-vector-index-vector
(reader).
(setf sparse-vector-index-vector)
(writer).
sparse-vector-length
(reader).
(setf sparse-vector-length)
(writer).
sparse-vector-value-vector
(reader).
(setf sparse-vector-value-vector)
(writer).
sps-v*n
(function).
v*
(function).
v*n
(function).
v+
(function).
v+n
(function).
v-
(function).
v-sqrt
(function).
v/
(function).
%make-sparse-vector
(function).
copy-sparse-vector
(function).
sparse-vector-p
(function).
Definitions are sorted by export status, category, package, and then by lexicographic order.
sparse-scw
) stream) ¶perceptron
) stream) ¶one-vs-rest
) stream) ¶one-vs-one
) stream) ¶sparse-lr+adam
) stream) ¶sparse-rls
) stream) ¶sparse-arow
) stream) ¶sparse-perceptron
) stream) ¶structure-object
.
common-lisp
.
fixnum
0
(simple-array fixnum)
#()
(simple-array single-float)
#()
bias
.
bias
.
m0
.
v0
.
bias
.
eta
.
bias
.
bias
.
bias
.
c
.
g
.
m
.
m0
.
v
.
v0
.
bias
.
c
.
eta
.
g
.
bias
.
bias
.
bias
.
c
.
eta
.
phi
.
psi
.
zeta
.
argument-error
)) ¶argument-error
)) ¶simple-error
.
(quote nil)
:argument-error-message
structure-object
.
structure-object
.
structure-object
.
structure-object
.
structure-object
.
structure-object
.
structure-object
.
structure-object
.
structure-object
.
structure-object
.
structure-object
.
Jump to: | %
(
A C D F G I L M N O P R S T V |
---|
Jump to: | %
(
A C D F G I L M N O P R S T V |
---|
Jump to: | A B C E G I L M N P S T V W Z |
---|
Jump to: | A B C E G I L M N P S T V W Z |
---|
Jump to: | A C F L M O P R S U V |
---|
Jump to: | A C F L M O P R S U V |
---|