This is the cl-online-learning Reference Manual, version 0.5, generated automatically by Declt version 4.0 beta 2 "William Riker" on Tue Jul 15 04:10:35 2025 GMT+0.
The main system appears first, followed by any subsystem dependency.
cl-online-learningOnline Machine Learning for Common Lisp
Satoshi Imai
MIT Licence
* Cl-Online-Learning
[[http://quickdocs.org/cl-online-learning/][http://quickdocs.org/badge/cl-online-learning.svg]]
[[https://github.com/masatoi/cl-online-learning/actions?query=workflow%3ACI][https://github.com/masatoi/cl-online-learning/workflows/CI/badge.svg]]
A collection of machine learning algorithms for online linear classification written in Common Lisp.
** Implemented algorithms
*** Binary classifier
- Perceptron
- AROW (Crammer, Koby, Alex Kulesza, and Mark Dredze. "Adaptive regularization of weight vectors." Advances in neural information processing systems. 2009.)
- SCW-I (Soft Confidence Weighted) (Wang, Jialei, Peilin Zhao, and Steven C. Hoi. "Exact Soft Confidence-Weighted Learning." Proceedings of the 29th International Conference on Machine Learning (ICML-12). 2012.)
- Logistic Regression with SGD or ADAM optimizer (Kingma, Diederik, and Jimmy Ba. "Adam: A method for stochastic optimization." ICLR 2015)
*** Multiclass classifier
- one-vs-rest ( K binary classifier required )
- one-vs-one ( K*(K-1)/2 binary classifier required )
*** Command line tools
- Implemented as roswell script
- See https://github.com/masatoi/cl-online-learning/wiki/Using-as-command-line-tools
** Installation
cl-online-learning is available from Quicklisp.
#+BEGIN_SRC
(ql:quickload :cl-online-learning)
#+END_SRC
When install from github repository,
#+BEGIN_SRC
cd ~/quicklisp/local-projects/
git clone https://github.com/masatoi/cl-online-learning.git
#+END_SRC
When using Roswell,
#+BEGIN_SRC
ros install masatoi/cl-online-learning
#+END_SRC
** Usage
*** Prepare dataset
A data point is a pair of a class label (+1 or -1) and a input vector. Both of them have to be declared as single-float.
And dataset is represented as a sequence of data points.
READ-DATA function is available to make a dataset from a sparse format used in LIBSVM (http://www.csie.ntu.edu.tw/~cjlin/libsvmtools/datasets/). This function requires the number of features of that dataset.
#+BEGIN_SRC lisp
;; Number of features
(defparameter a1a-dim 123)
;; Read dataset from file
(defparameter a1a
(clol.utils:read-data
(merge-pathnames #P"t/dataset/a1a" (asdf:system-source-directory :cl-online-learning))
a1a-dim))
;; A data point
(car a1a)
; (-1.0
; . #(0.0 0.0 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 0.0 0.0
; 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0
; 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0
; 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 0.0 0.0 0.0
; 1.0 0.0 1.0 1.0 0.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0
; 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0
; 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0))
#+END_SRC
*** Define learner
A learner object is just a struct, therefore their constructor is available to make it.
#+BEGIN_SRC lisp
(defparameter arow-learner (clol:make-arow a1a-dim 10))
#+END_SRC
*** Update and Train
To update the model destructively with one data point, use an update function corresponding to the model type.
#+BEGIN_SRC lisp
(clol:arow-update arow-learner
(cdar a1a) ; input
(caar a1a)) ; label
#+END_SRC
TRAIN function can be used to learn the dataset collectively.
#+BEGIN_SRC lisp
(clol:train arow-learner a1a)
#+END_SRC
It may be necessary to call this function several times until learning converges. For now, the convergence test has not been implemented yet.
*** Predict and Test
#+BEGIN_SRC lisp
(clol:arow-predict arow-learner (cdar a1a))
; => -1.0
(clol:test arow-learner a1a)
; Accuracy: 84.85981%, Correct: 1362, Total: 1605
#+END_SRC
*** Multiclass classification
For multiclass data, the label of the data point is an integer representing the index of the class. READ-DATA function with MULTICLASS-P keyword option is available for make such a dataset.
#+BEGIN_SRC lisp
(defparameter iris-dim 4)
; A dataset in which a same label appears consecutively need to be shuffled
(defparameter iris
(clol.utils:shuffle-vector
(coerce (clol.utils:read-data
(merge-pathnames #P"t/dataset/iris.scale"
(asdf:system-source-directory :cl-online-learning))
iris-dim :multiclass-p t)
’simple-vector)))
(defparameter iris-train (subseq iris 0 100))
(defparameter iris-test (subseq iris 100))
#+END_SRC
ONE-VS-REST and ONE-VS-ONE are available for multiclass classification by using multiple binary classifiers. In many cases, ONE-VS-ONE is more accurate, but it requires more computational resource as the number of classes increases.
#+BEGIN_SRC lisp
;; Define model
(defparameter arow-1vs1
(clol:make-one-vs-one iris-dim ; Input data dimension
3 ; Number of class
’arow 0.1)) ; Binary classifier type and its parameters
;; Train and test model
(clol:train arow-1vs1 iris-train)
(clol:test arow-1vs1 iris-test)
; Accuracy: 98.0%, Correct: 49, Total: 50
#+END_SRC
*** Sparse data
For sparse data (most elements are 0), the data point is a pair of a class label and a instance of SPARSE-VECTOR struct, and a learner with SPARSE- prefix is used. READ-DATA function with SPARSE-P keyword option is available for make such a dataset.
For example, news20.binary data has too high dimensional features to handle with normal learners. However, by using the sparse version, the learner can be trained with practical computational resources.
#+BEGIN_SRC lisp
(defparameter news20.binary-dim 1355191)
(defparameter news20.binary (clol.utils:read-data "/path/to/news20.binary" news20.binary-dim :sparse-p t))
(defparameter news20.binary.arow (clol:make-sparse-arow news20.binary-dim 10))
(time (loop repeat 20 do (clol:train news20.binary.arow news20.binary)))
;; Evaluation took:
;; 1.527 seconds of real time
;; 1.526852 seconds of total run time (1.526852 user, 0.000000 system)
;; 100.00% CPU
;; 5,176,917,149 processor cycles
;; 11,436,032 bytes consed
(clol:test news20.binary.arow news20.binary)
; Accuracy: 99.74495%, Correct: 19945, Total: 19996
#+END_SRC
In a similar way, the sparse version learners are also available in multiclass classification.
#+BEGIN_SRC lisp
(defparameter news20-dim 62060)
(defparameter news20-train (clol.utils:read-data "/path/to/news20.scale" news20-dim :sparse-p t :multiclass-p t))
(defparameter news20-test (clol.utils:read-data "/path/to/news20.t.scale" news20-dim :sparse-p t :multiclass-p t))
(defparameter news20-arow (clol:make-one-vs-rest news20-dim 20 ’sparse-arow 10))
(loop repeat 12 do (clol:train news20-arow news20-train))
(clol:test news20-arow news20-test)
; Accuracy: 86.90208%, Correct: 3470, Total: 3993
#+END_SRC
# *** Benchimark
*** Save/Restore model
For saving a learner model to a file or restoring from the model file, SAVE and RESTORE function are available respectively.
For the above multiclass classification example, saving / restoring code would be:
#+BEGIN_SRC lisp
;; Save
(clol:save arow-1vs1 #P"/tmp/iris.model")
;; Restore
(defparameter restored-learner (clol:restore #P"/tmp/iris.model"))
(clol:test restored-learner iris-test)
; Accuracy: 98.0%, Correct: 49, Total: 50
#+END_SRC
** Author
Satoshi Imai (satoshi.imai@gmail.com)
** Licence
This software is released under the MIT License, see LICENSE.txt.
0.5
cl-libsvm-format (system).
cl-store (system).
src (module).
Modules are listed depth-first from the system components tree.
cl-online-learning/srccl-online-learning (system).
vector.lisp (file).
utils.lisp (file).
cl-online-learning.lisp (file).
rls.lisp (file).
Files are sorted by type and then listed depth-first from the systems components trees.
cl-online-learning/cl-online-learning.asdcl-online-learning/src/vector.lispcl-online-learning/src/utils.lispcl-online-learning/src/cl-online-learning.lispcl-online-learning/src/rls.lispcl-online-learning/cl-online-learning.asdcl-online-learning (system).
cl-online-learning/src/vector.lispsrc (module).
dosvec (macro).
dot (function).
dot! (function).
dovec (macro).
dps-v* (function).
dps-v+ (function).
dps-v- (function).
ds-dot (function).
ds-dot! (function).
ds-v* (function).
ds-v+ (function).
ds-v- (function).
ds-v/ (function).
ds2s-v* (function).
make-empty-sparse-vector (function).
make-sparse-vector (function).
make-vec (function).
ps-v*n (function).
s-v*n (function).
sparse-vector (structure).
sparse-vector-index-vector (reader).
(setf sparse-vector-index-vector) (writer).
sparse-vector-length (reader).
(setf sparse-vector-length) (writer).
sparse-vector-value-vector (reader).
(setf sparse-vector-value-vector) (writer).
sps-v*n (function).
v* (function).
v*n (function).
v+ (function).
v+n (function).
v- (function).
v-sqrt (function).
v/ (function).
%make-sparse-vector (function).
copy-sparse-vector (function).
sparse-vector-p (function).
cl-online-learning/src/utils.lispvector.lisp (file).
src (module).
class-min/max (function).
defmain (macro).
read-data (function).
shuffle-vector (function).
to-float (function).
to-int (function).
arg-list->lambda-arg (function).
argument-error (condition).
argument-error-message (reader method).
(setf argument-error-message) (writer method).
doseq (macro).
flatten (function).
group-arg-list (function).
mean-vector (function).
read-datum (function).
read-datum-sparse (function).
sanity-check (function).
split-lambda-list (function).
standard-deviation-vector (function).
cl-online-learning/src/cl-online-learning.lispvector.lisp (file).
src (module).
arow-predict (function).
arow-test (function).
arow-train (function).
arow-update (function).
dim-of (function).
lr+adam-predict (function).
lr+adam-test (function).
lr+adam-train (function).
lr+adam-update (function).
lr+sgd-predict (function).
lr+sgd-test (function).
lr+sgd-train (function).
lr+sgd-update (function).
make-arow (function).
make-lr+adam (function).
make-lr+sgd (function).
make-one-vs-one (function).
make-one-vs-rest (function).
make-perceptron (function).
make-scw (function).
make-sparse-arow (function).
make-sparse-lr+adam (function).
make-sparse-lr+sgd (function).
make-sparse-perceptron (function).
make-sparse-scw (function).
n-class-of (function).
one-vs-one-predict (function).
one-vs-one-test (function).
one-vs-one-train (function).
one-vs-one-update (function).
one-vs-rest-predict (function).
one-vs-rest-test (function).
one-vs-rest-train (function).
one-vs-rest-update (function).
perceptron-predict (function).
perceptron-test (function).
perceptron-train (function).
perceptron-update (function).
print-object (method).
print-object (method).
print-object (method).
print-object (method).
print-object (method).
print-object (method).
print-object (method).
print-object (method).
print-object (method).
print-object (method).
restore (function).
save (function).
scw-predict (function).
scw-test (function).
scw-train (function).
scw-update (function).
sparse-arow-predict (function).
sparse-arow-test (function).
sparse-arow-train (function).
sparse-arow-update (function).
sparse-learner? (function).
sparse-lr+adam-predict (function).
sparse-lr+adam-test (function).
sparse-lr+adam-train (function).
sparse-lr+adam-update (function).
sparse-lr+sgd-predict (function).
sparse-lr+sgd-test (function).
sparse-lr+sgd-train (function).
sparse-lr+sgd-update (function).
sparse-perceptron-predict (function).
sparse-perceptron-test (function).
sparse-perceptron-train (function).
sparse-perceptron-update (function).
sparse-scw-predict (function).
sparse-scw-test (function).
sparse-scw-train (function).
sparse-scw-update (function).
test (function).
train (function).
%make-arow (function).
%make-lr+adam (function).
%make-lr+sgd (function).
%make-one-vs-one (function).
%make-one-vs-rest (function).
%make-perceptron (function).
%make-scw (function).
%make-sparse-arow (function).
%make-sparse-lr+adam (function).
%make-sparse-lr+sgd (function).
%make-sparse-perceptron (function).
%make-sparse-scw (function).
%print-arow (function).
%print-lr+adam (function).
%print-one-vs-one (function).
%print-one-vs-rest (function).
%print-perceptron (function).
%print-scw (function).
%print-sparse-arow (function).
%print-sparse-lr+adam (function).
%print-sparse-perceptron (function).
%print-sparse-scw (function).
arow (structure).
arow-bias (reader).
(setf arow-bias) (writer).
arow-gamma (reader).
(setf arow-gamma) (writer).
arow-input-dimension (reader).
(setf arow-input-dimension) (writer).
arow-p (function).
arow-sigma (reader).
(setf arow-sigma) (writer).
arow-sigma0 (reader).
(setf arow-sigma0) (writer).
arow-tmp-float (reader).
(setf arow-tmp-float) (writer).
arow-tmp-vec1 (reader).
(setf arow-tmp-vec1) (writer).
arow-tmp-vec2 (reader).
(setf arow-tmp-vec2) (writer).
arow-weight (reader).
(setf arow-weight) (writer).
catstr (macro).
copy-arow (function).
copy-lr+adam (function).
copy-lr+sgd (function).
copy-one-vs-one (function).
copy-one-vs-rest (function).
copy-perceptron (function).
copy-scw (function).
copy-sparse-arow (function).
copy-sparse-lr+adam (function).
copy-sparse-lr+sgd (function).
copy-sparse-perceptron (function).
copy-sparse-scw (function).
define-learner (macro).
define-multi-class-learner-train/test-functions (macro).
f (function).
f! (function).
function-by-name (macro).
index-of-learner (function).
inverse-erf (function).
logistic-regression-gradient! (function).
logistic-regression-gradient-sparse! (function).
lr+adam (structure).
lr+adam-alpha (reader).
(setf lr+adam-alpha) (writer).
lr+adam-beta1 (reader).
(setf lr+adam-beta1) (writer).
lr+adam-beta1^t (reader).
(setf lr+adam-beta1^t) (writer).
lr+adam-beta2 (reader).
(setf lr+adam-beta2) (writer).
lr+adam-beta2^t (reader).
(setf lr+adam-beta2^t) (writer).
lr+adam-bias (reader).
(setf lr+adam-bias) (writer).
lr+adam-c (reader).
(setf lr+adam-c) (writer).
lr+adam-epsilon (reader).
(setf lr+adam-epsilon) (writer).
lr+adam-g (reader).
(setf lr+adam-g) (writer).
lr+adam-input-dimension (reader).
(setf lr+adam-input-dimension) (writer).
lr+adam-m (reader).
(setf lr+adam-m) (writer).
lr+adam-m0 (reader).
(setf lr+adam-m0) (writer).
lr+adam-p (function).
lr+adam-tmp-float (reader).
(setf lr+adam-tmp-float) (writer).
lr+adam-tmp-vec (reader).
(setf lr+adam-tmp-vec) (writer).
lr+adam-v (reader).
(setf lr+adam-v) (writer).
lr+adam-v0 (reader).
(setf lr+adam-v0) (writer).
lr+adam-weight (reader).
(setf lr+adam-weight) (writer).
lr+sgd (structure).
lr+sgd-bias (reader).
(setf lr+sgd-bias) (writer).
lr+sgd-c (reader).
(setf lr+sgd-c) (writer).
lr+sgd-eta (reader).
(setf lr+sgd-eta) (writer).
lr+sgd-g (reader).
(setf lr+sgd-g) (writer).
lr+sgd-input-dimension (reader).
(setf lr+sgd-input-dimension) (writer).
lr+sgd-p (function).
lr+sgd-tmp-float (reader).
(setf lr+sgd-tmp-float) (writer).
lr+sgd-tmp-vec (reader).
(setf lr+sgd-tmp-vec) (writer).
lr+sgd-weight (reader).
(setf lr+sgd-weight) (writer).
one-vs-one (structure).
one-vs-one-clear-functions-for-store (function).
one-vs-one-input-dimension (reader).
(setf one-vs-one-input-dimension) (writer).
one-vs-one-learner-predict (reader).
(setf one-vs-one-learner-predict) (writer).
one-vs-one-learner-update (reader).
(setf one-vs-one-learner-update) (writer).
one-vs-one-learners-vector (reader).
(setf one-vs-one-learners-vector) (writer).
one-vs-one-n-class (reader).
(setf one-vs-one-n-class) (writer).
one-vs-one-p (function).
one-vs-one-restore-functions (function).
one-vs-rest (structure).
one-vs-rest-clear-functions-for-store (function).
one-vs-rest-input-dimension (reader).
(setf one-vs-rest-input-dimension) (writer).
one-vs-rest-learner-activate (reader).
(setf one-vs-rest-learner-activate) (writer).
one-vs-rest-learner-bias (reader).
(setf one-vs-rest-learner-bias) (writer).
one-vs-rest-learner-update (reader).
(setf one-vs-rest-learner-update) (writer).
one-vs-rest-learner-weight (reader).
(setf one-vs-rest-learner-weight) (writer).
one-vs-rest-learners-vector (reader).
(setf one-vs-rest-learners-vector) (writer).
one-vs-rest-n-class (reader).
(setf one-vs-rest-n-class) (writer).
one-vs-rest-p (function).
one-vs-rest-restore-functions (function).
perceptron (structure).
perceptron-bias (reader).
(setf perceptron-bias) (writer).
perceptron-input-dimension (reader).
(setf perceptron-input-dimension) (writer).
perceptron-p (function).
perceptron-tmp-float (reader).
(setf perceptron-tmp-float) (writer).
perceptron-weight (reader).
(setf perceptron-weight) (writer).
probit (function).
scw (structure).
scw-bias (reader).
(setf scw-bias) (writer).
scw-c (reader).
(setf scw-c) (writer).
scw-eta (reader).
(setf scw-eta) (writer).
scw-input-dimension (reader).
(setf scw-input-dimension) (writer).
scw-p (function).
scw-phi (reader).
(setf scw-phi) (writer).
scw-psi (reader).
(setf scw-psi) (writer).
scw-sigma (reader).
(setf scw-sigma) (writer).
scw-sigma0 (reader).
(setf scw-sigma0) (writer).
scw-tmp-float (reader).
(setf scw-tmp-float) (writer).
scw-tmp-vec1 (reader).
(setf scw-tmp-vec1) (writer).
scw-tmp-vec2 (reader).
(setf scw-tmp-vec2) (writer).
scw-weight (reader).
(setf scw-weight) (writer).
scw-zeta (reader).
(setf scw-zeta) (writer).
sf (function).
sf! (function).
sigmoid (macro).
sign (function).
sparse-arow (structure).
sparse-arow-bias (reader).
(setf sparse-arow-bias) (writer).
sparse-arow-gamma (reader).
(setf sparse-arow-gamma) (writer).
sparse-arow-input-dimension (reader).
(setf sparse-arow-input-dimension) (writer).
sparse-arow-p (function).
sparse-arow-sigma (reader).
(setf sparse-arow-sigma) (writer).
sparse-arow-sigma0 (reader).
(setf sparse-arow-sigma0) (writer).
sparse-arow-tmp-float (reader).
(setf sparse-arow-tmp-float) (writer).
sparse-arow-tmp-vec1 (reader).
(setf sparse-arow-tmp-vec1) (writer).
sparse-arow-tmp-vec2 (reader).
(setf sparse-arow-tmp-vec2) (writer).
sparse-arow-weight (reader).
(setf sparse-arow-weight) (writer).
sparse-lr+adam (structure).
sparse-lr+adam-alpha (reader).
(setf sparse-lr+adam-alpha) (writer).
sparse-lr+adam-beta1 (reader).
(setf sparse-lr+adam-beta1) (writer).
sparse-lr+adam-beta1^t (reader).
(setf sparse-lr+adam-beta1^t) (writer).
sparse-lr+adam-beta2 (reader).
(setf sparse-lr+adam-beta2) (writer).
sparse-lr+adam-beta2^t (reader).
(setf sparse-lr+adam-beta2^t) (writer).
sparse-lr+adam-bias (reader).
(setf sparse-lr+adam-bias) (writer).
sparse-lr+adam-c (reader).
(setf sparse-lr+adam-c) (writer).
sparse-lr+adam-epsilon (reader).
(setf sparse-lr+adam-epsilon) (writer).
sparse-lr+adam-g (reader).
(setf sparse-lr+adam-g) (writer).
sparse-lr+adam-input-dimension (reader).
(setf sparse-lr+adam-input-dimension) (writer).
sparse-lr+adam-m (reader).
(setf sparse-lr+adam-m) (writer).
sparse-lr+adam-m0 (reader).
(setf sparse-lr+adam-m0) (writer).
sparse-lr+adam-p (function).
sparse-lr+adam-tmp-float (reader).
(setf sparse-lr+adam-tmp-float) (writer).
sparse-lr+adam-tmp-vec (reader).
(setf sparse-lr+adam-tmp-vec) (writer).
sparse-lr+adam-v (reader).
(setf sparse-lr+adam-v) (writer).
sparse-lr+adam-v0 (reader).
(setf sparse-lr+adam-v0) (writer).
sparse-lr+adam-weight (reader).
(setf sparse-lr+adam-weight) (writer).
sparse-lr+sgd (structure).
sparse-lr+sgd-bias (reader).
(setf sparse-lr+sgd-bias) (writer).
sparse-lr+sgd-c (reader).
(setf sparse-lr+sgd-c) (writer).
sparse-lr+sgd-eta (reader).
(setf sparse-lr+sgd-eta) (writer).
sparse-lr+sgd-g (reader).
(setf sparse-lr+sgd-g) (writer).
sparse-lr+sgd-input-dimension (reader).
(setf sparse-lr+sgd-input-dimension) (writer).
sparse-lr+sgd-p (function).
sparse-lr+sgd-tmp-float (reader).
(setf sparse-lr+sgd-tmp-float) (writer).
sparse-lr+sgd-tmp-vec (reader).
(setf sparse-lr+sgd-tmp-vec) (writer).
sparse-lr+sgd-weight (reader).
(setf sparse-lr+sgd-weight) (writer).
sparse-perceptron (structure).
sparse-perceptron-bias (reader).
(setf sparse-perceptron-bias) (writer).
sparse-perceptron-input-dimension (reader).
(setf sparse-perceptron-input-dimension) (writer).
sparse-perceptron-p (function).
sparse-perceptron-tmp-float (reader).
(setf sparse-perceptron-tmp-float) (writer).
sparse-perceptron-weight (reader).
(setf sparse-perceptron-weight) (writer).
sparse-scw (structure).
sparse-scw-bias (reader).
(setf sparse-scw-bias) (writer).
sparse-scw-c (reader).
(setf sparse-scw-c) (writer).
sparse-scw-eta (reader).
(setf sparse-scw-eta) (writer).
sparse-scw-input-dimension (reader).
(setf sparse-scw-input-dimension) (writer).
sparse-scw-p (function).
sparse-scw-phi (reader).
(setf sparse-scw-phi) (writer).
sparse-scw-psi (reader).
(setf sparse-scw-psi) (writer).
sparse-scw-sigma (reader).
(setf sparse-scw-sigma) (writer).
sparse-scw-sigma0 (reader).
(setf sparse-scw-sigma0) (writer).
sparse-scw-tmp-float (reader).
(setf sparse-scw-tmp-float) (writer).
sparse-scw-tmp-vec1 (reader).
(setf sparse-scw-tmp-vec1) (writer).
sparse-scw-tmp-vec2 (reader).
(setf sparse-scw-tmp-vec2) (writer).
sparse-scw-weight (reader).
(setf sparse-scw-weight) (writer).
sparse-scw-zeta (reader).
(setf sparse-scw-zeta) (writer).
sparse-symbol? (function).
sum-permutation (function).
cl-online-learning/src/rls.lispvector.lisp (file).
cl-online-learning.lisp (file).
src (module).
make-rls (function).
make-sparse-rls (function).
print-object (method).
print-object (method).
rls-predict (function).
rls-test (function).
rls-train (function).
rls-update (function).
sparse-rls-predict (function).
sparse-rls-test (function).
sparse-rls-train (function).
sparse-rls-update (function).
%make-rls (function).
%make-sparse-rls (function).
%print-rls (function).
%print-sparse-rls (function).
copy-rls (function).
copy-sparse-rls (function).
define-regression-learner (macro).
rls (structure).
rls-bias (reader).
(setf rls-bias) (writer).
rls-gamma (reader).
(setf rls-gamma) (writer).
rls-input-dimension (reader).
(setf rls-input-dimension) (writer).
rls-p (function).
rls-sigma (reader).
(setf rls-sigma) (writer).
rls-sigma0 (reader).
(setf rls-sigma0) (writer).
rls-tmp-float (reader).
(setf rls-tmp-float) (writer).
rls-tmp-vec1 (reader).
(setf rls-tmp-vec1) (writer).
rls-tmp-vec2 (reader).
(setf rls-tmp-vec2) (writer).
rls-weight (reader).
(setf rls-weight) (writer).
sparse-rls (structure).
sparse-rls-bias (reader).
(setf sparse-rls-bias) (writer).
sparse-rls-gamma (reader).
(setf sparse-rls-gamma) (writer).
sparse-rls-input-dimension (reader).
(setf sparse-rls-input-dimension) (writer).
sparse-rls-p (function).
sparse-rls-sigma (reader).
(setf sparse-rls-sigma) (writer).
sparse-rls-sigma0 (reader).
(setf sparse-rls-sigma0) (writer).
sparse-rls-tmp-float (reader).
(setf sparse-rls-tmp-float) (writer).
sparse-rls-tmp-vec1 (reader).
(setf sparse-rls-tmp-vec1) (writer).
sparse-rls-tmp-vec2 (reader).
(setf sparse-rls-tmp-vec2) (writer).
sparse-rls-weight (reader).
(setf sparse-rls-weight) (writer).
Packages are listed by definition order.
cl-online-learning.utilsclol.utils
cl-online-learning.vector.
common-lisp.
class-min/max (function).
defmain (macro).
read-data (function).
shuffle-vector (function).
to-float (function).
to-int (function).
arg-list->lambda-arg (function).
argument-error (condition).
argument-error-message (generic reader).
(setf argument-error-message) (generic writer).
doseq (macro).
flatten (function).
group-arg-list (function).
mean-vector (function).
read-datum (function).
read-datum-sparse (function).
sanity-check (function).
split-lambda-list (function).
standard-deviation-vector (function).
cl-online-learningclol
cl-online-learning.vector.
common-lisp.
arow-predict (function).
arow-test (function).
arow-train (function).
arow-update (function).
dim-of (function).
lr+adam-predict (function).
lr+adam-test (function).
lr+adam-train (function).
lr+adam-update (function).
lr+sgd-predict (function).
lr+sgd-test (function).
lr+sgd-train (function).
lr+sgd-update (function).
make-arow (function).
make-lr+adam (function).
make-lr+sgd (function).
make-one-vs-one (function).
make-one-vs-rest (function).
make-perceptron (function).
make-rls (function).
make-scw (function).
make-sparse-arow (function).
make-sparse-lr+adam (function).
make-sparse-lr+sgd (function).
make-sparse-perceptron (function).
make-sparse-rls (function).
make-sparse-scw (function).
n-class-of (function).
one-vs-one-predict (function).
one-vs-one-test (function).
one-vs-one-train (function).
one-vs-one-update (function).
one-vs-rest-predict (function).
one-vs-rest-test (function).
one-vs-rest-train (function).
one-vs-rest-update (function).
perceptron-predict (function).
perceptron-test (function).
perceptron-train (function).
perceptron-update (function).
restore (function).
rls-predict (function).
rls-test (function).
rls-train (function).
rls-update (function).
save (function).
scw-predict (function).
scw-test (function).
scw-train (function).
scw-update (function).
sparse-arow-predict (function).
sparse-arow-test (function).
sparse-arow-train (function).
sparse-arow-update (function).
sparse-learner? (function).
sparse-lr+adam-predict (function).
sparse-lr+adam-test (function).
sparse-lr+adam-train (function).
sparse-lr+adam-update (function).
sparse-lr+sgd-predict (function).
sparse-lr+sgd-test (function).
sparse-lr+sgd-train (function).
sparse-lr+sgd-update (function).
sparse-perceptron-predict (function).
sparse-perceptron-test (function).
sparse-perceptron-train (function).
sparse-perceptron-update (function).
sparse-rls-predict (function).
sparse-rls-test (function).
sparse-rls-train (function).
sparse-rls-update (function).
sparse-scw-predict (function).
sparse-scw-test (function).
sparse-scw-train (function).
sparse-scw-update (function).
test (function).
train (function).
%make-arow (function).
%make-lr+adam (function).
%make-lr+sgd (function).
%make-one-vs-one (function).
%make-one-vs-rest (function).
%make-perceptron (function).
%make-rls (function).
%make-scw (function).
%make-sparse-arow (function).
%make-sparse-lr+adam (function).
%make-sparse-lr+sgd (function).
%make-sparse-perceptron (function).
%make-sparse-rls (function).
%make-sparse-scw (function).
%print-arow (function).
%print-lr+adam (function).
%print-one-vs-one (function).
%print-one-vs-rest (function).
%print-perceptron (function).
%print-rls (function).
%print-scw (function).
%print-sparse-arow (function).
%print-sparse-lr+adam (function).
%print-sparse-perceptron (function).
%print-sparse-rls (function).
%print-sparse-scw (function).
arow (structure).
arow-bias (reader).
(setf arow-bias) (writer).
arow-gamma (reader).
(setf arow-gamma) (writer).
arow-input-dimension (reader).
(setf arow-input-dimension) (writer).
arow-p (function).
arow-sigma (reader).
(setf arow-sigma) (writer).
arow-sigma0 (reader).
(setf arow-sigma0) (writer).
arow-tmp-float (reader).
(setf arow-tmp-float) (writer).
arow-tmp-vec1 (reader).
(setf arow-tmp-vec1) (writer).
arow-tmp-vec2 (reader).
(setf arow-tmp-vec2) (writer).
arow-weight (reader).
(setf arow-weight) (writer).
catstr (macro).
copy-arow (function).
copy-lr+adam (function).
copy-lr+sgd (function).
copy-one-vs-one (function).
copy-one-vs-rest (function).
copy-perceptron (function).
copy-rls (function).
copy-scw (function).
copy-sparse-arow (function).
copy-sparse-lr+adam (function).
copy-sparse-lr+sgd (function).
copy-sparse-perceptron (function).
copy-sparse-rls (function).
copy-sparse-scw (function).
define-learner (macro).
define-multi-class-learner-train/test-functions (macro).
define-regression-learner (macro).
f (function).
f! (function).
function-by-name (macro).
index-of-learner (function).
inverse-erf (function).
logistic-regression-gradient! (function).
logistic-regression-gradient-sparse! (function).
lr+adam (structure).
lr+adam-alpha (reader).
(setf lr+adam-alpha) (writer).
lr+adam-beta1 (reader).
(setf lr+adam-beta1) (writer).
lr+adam-beta1^t (reader).
(setf lr+adam-beta1^t) (writer).
lr+adam-beta2 (reader).
(setf lr+adam-beta2) (writer).
lr+adam-beta2^t (reader).
(setf lr+adam-beta2^t) (writer).
lr+adam-bias (reader).
(setf lr+adam-bias) (writer).
lr+adam-c (reader).
(setf lr+adam-c) (writer).
lr+adam-epsilon (reader).
(setf lr+adam-epsilon) (writer).
lr+adam-g (reader).
(setf lr+adam-g) (writer).
lr+adam-input-dimension (reader).
(setf lr+adam-input-dimension) (writer).
lr+adam-m (reader).
(setf lr+adam-m) (writer).
lr+adam-m0 (reader).
(setf lr+adam-m0) (writer).
lr+adam-p (function).
lr+adam-tmp-float (reader).
(setf lr+adam-tmp-float) (writer).
lr+adam-tmp-vec (reader).
(setf lr+adam-tmp-vec) (writer).
lr+adam-v (reader).
(setf lr+adam-v) (writer).
lr+adam-v0 (reader).
(setf lr+adam-v0) (writer).
lr+adam-weight (reader).
(setf lr+adam-weight) (writer).
lr+sgd (structure).
lr+sgd-bias (reader).
(setf lr+sgd-bias) (writer).
lr+sgd-c (reader).
(setf lr+sgd-c) (writer).
lr+sgd-eta (reader).
(setf lr+sgd-eta) (writer).
lr+sgd-g (reader).
(setf lr+sgd-g) (writer).
lr+sgd-input-dimension (reader).
(setf lr+sgd-input-dimension) (writer).
lr+sgd-p (function).
lr+sgd-tmp-float (reader).
(setf lr+sgd-tmp-float) (writer).
lr+sgd-tmp-vec (reader).
(setf lr+sgd-tmp-vec) (writer).
lr+sgd-weight (reader).
(setf lr+sgd-weight) (writer).
one-vs-one (structure).
one-vs-one-clear-functions-for-store (function).
one-vs-one-input-dimension (reader).
(setf one-vs-one-input-dimension) (writer).
one-vs-one-learner-predict (reader).
(setf one-vs-one-learner-predict) (writer).
one-vs-one-learner-update (reader).
(setf one-vs-one-learner-update) (writer).
one-vs-one-learners-vector (reader).
(setf one-vs-one-learners-vector) (writer).
one-vs-one-n-class (reader).
(setf one-vs-one-n-class) (writer).
one-vs-one-p (function).
one-vs-one-restore-functions (function).
one-vs-rest (structure).
one-vs-rest-clear-functions-for-store (function).
one-vs-rest-input-dimension (reader).
(setf one-vs-rest-input-dimension) (writer).
one-vs-rest-learner-activate (reader).
(setf one-vs-rest-learner-activate) (writer).
one-vs-rest-learner-bias (reader).
(setf one-vs-rest-learner-bias) (writer).
one-vs-rest-learner-update (reader).
(setf one-vs-rest-learner-update) (writer).
one-vs-rest-learner-weight (reader).
(setf one-vs-rest-learner-weight) (writer).
one-vs-rest-learners-vector (reader).
(setf one-vs-rest-learners-vector) (writer).
one-vs-rest-n-class (reader).
(setf one-vs-rest-n-class) (writer).
one-vs-rest-p (function).
one-vs-rest-restore-functions (function).
perceptron (structure).
perceptron-bias (reader).
(setf perceptron-bias) (writer).
perceptron-input-dimension (reader).
(setf perceptron-input-dimension) (writer).
perceptron-p (function).
perceptron-tmp-float (reader).
(setf perceptron-tmp-float) (writer).
perceptron-weight (reader).
(setf perceptron-weight) (writer).
probit (function).
rls (structure).
rls-bias (reader).
(setf rls-bias) (writer).
rls-gamma (reader).
(setf rls-gamma) (writer).
rls-input-dimension (reader).
(setf rls-input-dimension) (writer).
rls-p (function).
rls-sigma (reader).
(setf rls-sigma) (writer).
rls-sigma0 (reader).
(setf rls-sigma0) (writer).
rls-tmp-float (reader).
(setf rls-tmp-float) (writer).
rls-tmp-vec1 (reader).
(setf rls-tmp-vec1) (writer).
rls-tmp-vec2 (reader).
(setf rls-tmp-vec2) (writer).
rls-weight (reader).
(setf rls-weight) (writer).
scw (structure).
scw-bias (reader).
(setf scw-bias) (writer).
scw-c (reader).
(setf scw-c) (writer).
scw-eta (reader).
(setf scw-eta) (writer).
scw-input-dimension (reader).
(setf scw-input-dimension) (writer).
scw-p (function).
scw-phi (reader).
(setf scw-phi) (writer).
scw-psi (reader).
(setf scw-psi) (writer).
scw-sigma (reader).
(setf scw-sigma) (writer).
scw-sigma0 (reader).
(setf scw-sigma0) (writer).
scw-tmp-float (reader).
(setf scw-tmp-float) (writer).
scw-tmp-vec1 (reader).
(setf scw-tmp-vec1) (writer).
scw-tmp-vec2 (reader).
(setf scw-tmp-vec2) (writer).
scw-weight (reader).
(setf scw-weight) (writer).
scw-zeta (reader).
(setf scw-zeta) (writer).
sf (function).
sf! (function).
sigmoid (macro).
sign (function).
sparse-arow (structure).
sparse-arow-bias (reader).
(setf sparse-arow-bias) (writer).
sparse-arow-gamma (reader).
(setf sparse-arow-gamma) (writer).
sparse-arow-input-dimension (reader).
(setf sparse-arow-input-dimension) (writer).
sparse-arow-p (function).
sparse-arow-sigma (reader).
(setf sparse-arow-sigma) (writer).
sparse-arow-sigma0 (reader).
(setf sparse-arow-sigma0) (writer).
sparse-arow-tmp-float (reader).
(setf sparse-arow-tmp-float) (writer).
sparse-arow-tmp-vec1 (reader).
(setf sparse-arow-tmp-vec1) (writer).
sparse-arow-tmp-vec2 (reader).
(setf sparse-arow-tmp-vec2) (writer).
sparse-arow-weight (reader).
(setf sparse-arow-weight) (writer).
sparse-lr+adam (structure).
sparse-lr+adam-alpha (reader).
(setf sparse-lr+adam-alpha) (writer).
sparse-lr+adam-beta1 (reader).
(setf sparse-lr+adam-beta1) (writer).
sparse-lr+adam-beta1^t (reader).
(setf sparse-lr+adam-beta1^t) (writer).
sparse-lr+adam-beta2 (reader).
(setf sparse-lr+adam-beta2) (writer).
sparse-lr+adam-beta2^t (reader).
(setf sparse-lr+adam-beta2^t) (writer).
sparse-lr+adam-bias (reader).
(setf sparse-lr+adam-bias) (writer).
sparse-lr+adam-c (reader).
(setf sparse-lr+adam-c) (writer).
sparse-lr+adam-epsilon (reader).
(setf sparse-lr+adam-epsilon) (writer).
sparse-lr+adam-g (reader).
(setf sparse-lr+adam-g) (writer).
sparse-lr+adam-input-dimension (reader).
(setf sparse-lr+adam-input-dimension) (writer).
sparse-lr+adam-m (reader).
(setf sparse-lr+adam-m) (writer).
sparse-lr+adam-m0 (reader).
(setf sparse-lr+adam-m0) (writer).
sparse-lr+adam-p (function).
sparse-lr+adam-tmp-float (reader).
(setf sparse-lr+adam-tmp-float) (writer).
sparse-lr+adam-tmp-vec (reader).
(setf sparse-lr+adam-tmp-vec) (writer).
sparse-lr+adam-v (reader).
(setf sparse-lr+adam-v) (writer).
sparse-lr+adam-v0 (reader).
(setf sparse-lr+adam-v0) (writer).
sparse-lr+adam-weight (reader).
(setf sparse-lr+adam-weight) (writer).
sparse-lr+sgd (structure).
sparse-lr+sgd-bias (reader).
(setf sparse-lr+sgd-bias) (writer).
sparse-lr+sgd-c (reader).
(setf sparse-lr+sgd-c) (writer).
sparse-lr+sgd-eta (reader).
(setf sparse-lr+sgd-eta) (writer).
sparse-lr+sgd-g (reader).
(setf sparse-lr+sgd-g) (writer).
sparse-lr+sgd-input-dimension (reader).
(setf sparse-lr+sgd-input-dimension) (writer).
sparse-lr+sgd-p (function).
sparse-lr+sgd-tmp-float (reader).
(setf sparse-lr+sgd-tmp-float) (writer).
sparse-lr+sgd-tmp-vec (reader).
(setf sparse-lr+sgd-tmp-vec) (writer).
sparse-lr+sgd-weight (reader).
(setf sparse-lr+sgd-weight) (writer).
sparse-perceptron (structure).
sparse-perceptron-bias (reader).
(setf sparse-perceptron-bias) (writer).
sparse-perceptron-input-dimension (reader).
(setf sparse-perceptron-input-dimension) (writer).
sparse-perceptron-p (function).
sparse-perceptron-tmp-float (reader).
(setf sparse-perceptron-tmp-float) (writer).
sparse-perceptron-weight (reader).
(setf sparse-perceptron-weight) (writer).
sparse-rls (structure).
sparse-rls-bias (reader).
(setf sparse-rls-bias) (writer).
sparse-rls-gamma (reader).
(setf sparse-rls-gamma) (writer).
sparse-rls-input-dimension (reader).
(setf sparse-rls-input-dimension) (writer).
sparse-rls-p (function).
sparse-rls-sigma (reader).
(setf sparse-rls-sigma) (writer).
sparse-rls-sigma0 (reader).
(setf sparse-rls-sigma0) (writer).
sparse-rls-tmp-float (reader).
(setf sparse-rls-tmp-float) (writer).
sparse-rls-tmp-vec1 (reader).
(setf sparse-rls-tmp-vec1) (writer).
sparse-rls-tmp-vec2 (reader).
(setf sparse-rls-tmp-vec2) (writer).
sparse-rls-weight (reader).
(setf sparse-rls-weight) (writer).
sparse-scw (structure).
sparse-scw-bias (reader).
(setf sparse-scw-bias) (writer).
sparse-scw-c (reader).
(setf sparse-scw-c) (writer).
sparse-scw-eta (reader).
(setf sparse-scw-eta) (writer).
sparse-scw-input-dimension (reader).
(setf sparse-scw-input-dimension) (writer).
sparse-scw-p (function).
sparse-scw-phi (reader).
(setf sparse-scw-phi) (writer).
sparse-scw-psi (reader).
(setf sparse-scw-psi) (writer).
sparse-scw-sigma (reader).
(setf sparse-scw-sigma) (writer).
sparse-scw-sigma0 (reader).
(setf sparse-scw-sigma0) (writer).
sparse-scw-tmp-float (reader).
(setf sparse-scw-tmp-float) (writer).
sparse-scw-tmp-vec1 (reader).
(setf sparse-scw-tmp-vec1) (writer).
sparse-scw-tmp-vec2 (reader).
(setf sparse-scw-tmp-vec2) (writer).
sparse-scw-weight (reader).
(setf sparse-scw-weight) (writer).
sparse-scw-zeta (reader).
(setf sparse-scw-zeta) (writer).
sparse-symbol? (function).
sum-permutation (function).
cl-online-learning.vectorclol.vector
common-lisp.
dosvec (macro).
dot (function).
dot! (function).
dovec (macro).
dps-v* (function).
dps-v+ (function).
dps-v- (function).
ds-dot (function).
ds-dot! (function).
ds-v* (function).
ds-v+ (function).
ds-v- (function).
ds-v/ (function).
ds2s-v* (function).
make-empty-sparse-vector (function).
make-sparse-vector (function).
make-vec (function).
ps-v*n (function).
s-v*n (function).
sparse-vector (structure).
sparse-vector-index-vector (reader).
(setf sparse-vector-index-vector) (writer).
sparse-vector-length (reader).
(setf sparse-vector-length) (writer).
sparse-vector-value-vector (reader).
(setf sparse-vector-value-vector) (writer).
sps-v*n (function).
v* (function).
v*n (function).
v+ (function).
v+n (function).
v- (function).
v-sqrt (function).
v/ (function).
%make-sparse-vector (function).
copy-sparse-vector (function).
sparse-vector-p (function).
Definitions are sorted by export status, category, package, and then by lexicographic order.
sparse-scw) stream) ¶perceptron) stream) ¶one-vs-rest) stream) ¶one-vs-one) stream) ¶sparse-lr+adam) stream) ¶sparse-rls) stream) ¶sparse-arow) stream) ¶sparse-perceptron) stream) ¶structure-object.
common-lisp.
fixnum
0
(simple-array fixnum)
#()
(simple-array single-float)
#()
bias.
bias.
m0.
v0.
bias.
eta.
bias.
bias.
bias.
c.
g.
m.
m0.
v.
v0.
bias.
c.
eta.
g.
bias.
bias.
bias.
c.
eta.
phi.
psi.
zeta.
argument-error)) ¶argument-error)) ¶simple-error.
(quote nil)
:argument-error-message
structure-object.
structure-object.
structure-object.
structure-object.
structure-object.
structure-object.
structure-object.
structure-object.
structure-object.
structure-object.
structure-object.
| Jump to: | %
(
A C D F G I L M N O P R S T V |
|---|
| Jump to: | %
(
A C D F G I L M N O P R S T V |
|---|
| Jump to: | A B C E G I L M N P S T V W Z |
|---|
| Jump to: | A B C E G I L M N P S T V W Z |
|---|
| Jump to: | A C F L M O P R S U V |
|---|
| Jump to: | A C F L M O P R S U V |
|---|