This is the tagger Reference Manual, generated automatically by Declt version 4.0 beta 2 "William Riker" on Sun Jun 15 07:35:31 2025 GMT+0.
tagger/tagger.asdtagger/package.lisptagger/cltl1-compat.lisptagger/sysdcl/tdb-sysdcl-sysdcl.lisptagger/util/cl-extensions.lisptagger/util/string-resource.lisptagger/util/cons-resource.lisptagger/util/sv-resource.lisptagger/util/io-structs.lisptagger/util/io-byte8.lisptagger/util/io-builtin.lisptagger/util/svb.lisptagger/util/trie.lisptagger/util/ssb.lisptagger/util/variable-storage.lisptagger/util/vector-resource.lisptagger/util/float-vector.lisptagger/util/hmm.lisptagger/util/skip-list.lisptagger/corpus/corpus-protocol.lisptagger/fsa/fsa-basics.lisptagger/fsa/standard-states.lisptagger/fsa/standard-symbols.lisptagger/fsa/list-sets.lisptagger/fsa/skip-list-relations.lisptagger/fsa/fsa-standard.lisptagger/fsa/fsa-calculus.lisptagger/analysis/analysis-protocol.lisptagger/analysis/lexicon-protocol.lisptagger/analysis/tag-basics.lisptagger/analysis/tag-analysis.lisptagger/analysis/class-guesser.lisptagger/analysis/fsa-tokenizer.lisptagger/analysis/vector-lexicon.lisptagger/analysis/tag-brown.lisptagger/analysis/tag-english.lisptagger/analysis/tag-trainer.lisptag-brownfinite-state-automataskip-listtag-basicsssbtagger.internalcons-resourcebinary-ioskip-list-relationstag-analysissv-resourcevector-lexicontag-trainertag-englishvector-resourcesvbvariable-storagetriefsa-tokenizertaggerfloat-vectorstring-resourcestandard-symbolslist-setsstandard-statestdbhmmclass-guesserfsa-standardcl-extensionsThe main system appears first, followed by any subsystem dependency.
taggerThe Xerox Part-of-Speech Tagger Version 1.2
Doug Cutting and Jan Pedersen of the Xerox Palo Alto Research Center
Use, reproduction, and distribution of this software is permitted, but only for non-commercial research or educational purposes. see the tagger/COPYRIGHT file for more information.
closer-mop (system).
package.lisp (file).
cltl1-compat.lisp (file).
sysdcl (module).
util (module).
corpus (module).
fsa (module).
analysis (module).
Modules are listed depth-first from the system components tree.
tagger/sysdclcltl1-compat.lisp (file).
tagger (system).
tdb-sysdcl-sysdcl.lisp (file).
tagger/utilsysdcl (module).
tagger (system).
cl-extensions.lisp (file).
string-resource.lisp (file).
cons-resource.lisp (file).
sv-resource.lisp (file).
io-structs.lisp (file).
io-byte8.lisp (file).
io-builtin.lisp (file).
svb.lisp (file).
trie.lisp (file).
ssb.lisp (file).
variable-storage.lisp (file).
vector-resource.lisp (file).
float-vector.lisp (file).
hmm.lisp (file).
skip-list.lisp (file).
tagger/corpusutil (module).
tagger (system).
corpus-protocol.lisp (file).
tagger/fsacorpus (module).
tagger (system).
fsa-basics.lisp (file).
standard-states.lisp (file).
standard-symbols.lisp (file).
list-sets.lisp (file).
skip-list-relations.lisp (file).
fsa-standard.lisp (file).
fsa-calculus.lisp (file).
tagger/analysisfsa (module).
tagger (system).
analysis-protocol.lisp (file).
lexicon-protocol.lisp (file).
tag-basics.lisp (file).
tag-analysis.lisp (file).
class-guesser.lisp (file).
fsa-tokenizer.lisp (file).
vector-lexicon.lisp (file).
tag-brown.lisp (file).
tag-english.lisp (file).
tag-trainer.lisp (file).
Files are sorted by type and then listed depth-first from the systems components trees.
tagger/tagger.asdtagger/package.lisptagger/cltl1-compat.lisptagger/sysdcl/tdb-sysdcl-sysdcl.lisptagger/util/cl-extensions.lisptagger/util/string-resource.lisptagger/util/cons-resource.lisptagger/util/sv-resource.lisptagger/util/io-structs.lisptagger/util/io-byte8.lisptagger/util/io-builtin.lisptagger/util/svb.lisptagger/util/trie.lisptagger/util/ssb.lisptagger/util/variable-storage.lisptagger/util/vector-resource.lisptagger/util/float-vector.lisptagger/util/hmm.lisptagger/util/skip-list.lisptagger/corpus/corpus-protocol.lisptagger/fsa/fsa-basics.lisptagger/fsa/standard-states.lisptagger/fsa/standard-symbols.lisptagger/fsa/list-sets.lisptagger/fsa/skip-list-relations.lisptagger/fsa/fsa-standard.lisptagger/fsa/fsa-calculus.lisptagger/analysis/analysis-protocol.lisptagger/analysis/lexicon-protocol.lisptagger/analysis/tag-basics.lisptagger/analysis/tag-analysis.lisptagger/analysis/class-guesser.lisptagger/analysis/fsa-tokenizer.lisptagger/analysis/vector-lexicon.lisptagger/analysis/tag-brown.lisptagger/analysis/tag-english.lisptagger/analysis/tag-trainer.lisptagger/package.lisptagger (system).
tag-brown.
finite-state-automata.
skip-list.
tag-basics.
ssb.
tagger.internal.
cons-resource.
binary-io.
skip-list-relations.
tag-analysis.
sv-resource.
vector-lexicon.
tag-trainer.
tag-english.
vector-resource.
svb.
variable-storage.
trie.
fsa-tokenizer.
tagger.
float-vector.
string-resource.
standard-symbols.
list-sets.
standard-states.
tdb.
hmm.
class-guesser.
fsa-standard.
cl-extensions.
tagger/cltl1-compat.lisppackage.lisp (file).
tagger (system).
cltl1-eval-when (macro).
defun-compile-time (macro).
tagger/sysdcl/tdb-sysdcl-sysdcl.lispsysdcl (module).
*highly-optimized* (special variable).
*normally-optimized* (special variable).
def-tdb-system (macro).
tdb-compile (function).
tdb-dirpath (function).
tdb-pathname (function).
*tdb-binary-subdirectory* (special variable).
*tdb-systems* (special variable).
tagger/util/cl-extensions.lisputil (module).
add-process (macro).
byte16 (type).
byte28 (type).
byte32 (type).
byte7 (type).
byte8 (type).
define-list-sorter (macro).
effective-function (function).
fast-read-char (macro).
fast-read-file-char (macro).
format-name (function).
get-qua (macro).
int29 (type).
kill-process (macro).
make-lock (macro).
once-only (macro).
process-block (macro).
this-process (macro).
with-collection (macro).
with-effective-function (macro).
with-lock (macro).
with-locks (macro).
without-interrupts (macro).
*the-class-t* (special variable).
file-length (method).
file-length (method).
get-qua-internal (function).
tagger/util/string-resource.lisputil (module).
+max-string-length+ (constant).
alloc-string (function).
free-string (function).
simple-string-copy (function).
string-copy (function).
*string-fill-pointers* (special variable).
*string-table* (special variable).
*string-table-lengths* (special variable).
string-fill-pointer (macro).
string-table-length (macro).
tagger/util/cons-resource.lisputil (module).
%cons (function).
%copy-list (function).
%copy-tree (function).
%delete (function).
%list (macro).
%make-list (function).
%pop (macro).
%push (macro).
%with-collection (macro).
free-cell (function).
free-list (function).
free-tree (function).
*cons-cells* (special variable).
tagger/util/sv-resource.lisputil (module).
*sv-fill-pointers* (special variable).
*sv-table* (special variable).
*sv-table-lengths* (special variable).
+max-sv-length+ (constant).
sv-fill-pointer (macro).
sv-table-length (macro).
tagger/util/io-structs.lisputil (module).
define-io-fns (macro).
define-io-struct (macro).
find-io-fns (macro).
io-copy-fn (reader).
(setf io-copy-fn) (writer).
io-fns (structure).
io-fns-arg (function).
io-fns-name (reader).
io-fns-p (function).
io-free-fn (reader).
(setf io-free-fn) (writer).
io-order-fn (reader).
(setf io-order-fn) (writer).
io-read-fn (reader).
(setf io-read-fn) (writer).
io-size-fn (reader).
(setf io-size-fn) (writer).
io-write-fn (reader).
(setf io-write-fn) (writer).
make-io-fns (function).
make-ordered-io-fns (function).
ordered-io-fns (structure).
ordered-io-fns-p (function).
print-object (method).
print-object (method).
%print-io-fns (function).
*fns-being-debugged* (special variable).
*io-fns* (special variable).
copy-io-fns (function).
copy-ordered-io-fns (function).
io-copy-fn-name (reader).
(setf io-copy-fn-name) (writer).
io-free-fn-name (reader).
(setf io-free-fn-name) (writer).
io-io-copy-fn (function).
(setf io-io-copy-fn) (function).
io-io-copy-fn-name (function).
(setf io-io-copy-fn-name) (function).
io-io-fns-name (function).
io-io-free-fn (function).
(setf io-io-free-fn) (function).
io-io-free-fn-name (function).
(setf io-io-free-fn-name) (function).
io-io-read-fn (function).
(setf io-io-read-fn) (function).
io-io-read-fn-name (function).
(setf io-io-read-fn-name) (function).
io-io-size-fn (function).
(setf io-io-size-fn) (function).
io-io-size-fn-name (function).
(setf io-io-size-fn-name) (function).
io-io-write-fn (function).
(setf io-io-write-fn) (function).
io-io-write-fn-name (function).
(setf io-io-write-fn-name) (function).
io-order-fn-name (reader).
(setf io-order-fn-name) (writer).
io-read-fn-name (reader).
(setf io-read-fn-name) (writer).
io-size-fn-name (reader).
(setf io-size-fn-name) (writer).
io-write-fn-name (reader).
(setf io-write-fn-name) (writer).
make-pis (function).
pis-accessors (function).
(setf pis-accessors) (function).
pis-slot-names (function).
(setf pis-slot-names) (function).
pis-slot-types (function).
(setf pis-slot-types) (function).
tagger/util/io-byte8.lisputil (module).
*default-byte8-stream-buffer-size* (special variable).
byte16-read (function).
byte16-write (function).
byte8-read (macro).
byte8-stream-length (macro).
byte8-write (macro).
close-byte8-stream (macro).
flush-byte8-stream (macro).
get-byte8-stream-position (macro).
int29-read (function).
int29-write (function).
open-byte8-stream (macro).
pad-byte8-stream (macro).
read-byte32 (function).
set-byte8-stream-position (macro).
with-open-byte8-stream (macro).
write-byte32 (function).
tagger/util/io-builtin.lisputil (module).
byte16-order (function).
byte32-read (function).
byte32-write (function).
debug-io-fns (function).
int29-order (function).
int29-size (function).
integer-order (function).
integer-read (function).
integer-size (function).
integer-write (function).
simple-string-order (function).
simple-string-size (function).
simple-stringp-order (function).
single-float-order (function).
single-float-read (function).
single-float-size (function).
single-float-write (function).
string-order (function).
string-read (function).
string-size (function).
string-write (function).
stringp-order (function).
swapped-byte32 (type).
undebug-io-fns (function).
*lower-case* (special variable).
tagger/util/svb.lisputil (module).
copy-string-to-svb (function).
copy-svb (function).
copy-svb-to-string (function).
extend-svb (function).
make-svb (function).
print-object (method).
svb (structure).
svb-buffer (reader).
(setf svb-buffer) (writer).
svb-pointer (reader).
(setf svb-pointer) (writer).
svb-push-extend (macro).
svb-size (reader).
(setf svb-size) (writer).
svbref (macro).
%make-svb (function).
%print-svb (function).
*default-svb-size* (special variable).
sv-replace (function).
svb-p (function).
tagger/util/trie.lisputil (module).
define-trie (macro).
make-simple-vector-trie (function).
make-string-trie (function).
map-st (function).
map-svt (function).
print-object (method).
sort-trie (function).
st-get (function).
(setf st-get) (function).
svt-get (function).
(setf svt-get) (function).
trie (structure).
trie-node-key (reader).
(setf trie-node-key) (writer).
trie-node-value (reader).
(setf trie-node-value) (writer).
walk-string (function).
%print-trie (function).
copy-trie (function).
copy-trie-node (function).
make-trie (function).
make-trie-node (function).
sort-trie-node (function).
trie-inverse-key-fn (reader).
(setf trie-inverse-key-fn) (writer).
trie-key-fn (reader).
(setf trie-key-fn) (writer).
trie-node (structure).
trie-node-next (reader).
(setf trie-node-next) (writer).
trie-node-p (function).
trie-node-subnode (reader).
(setf trie-node-subnode) (writer).
trie-p (function).
trie-root-subnodes (reader).
(setf trie-root-subnodes) (writer).
trie-root-value (reader).
(setf trie-root-value) (writer).
tagger/util/ssb.lisputil (module).
copy-ssb (function).
make-ssb (function).
print-object (method).
reinitialize-ssb (function).
ssb-buffer (reader).
(setf ssb-buffer) (writer).
ssb-pointer (reader).
(setf ssb-pointer) (writer).
ssb-push-extend (macro).
ssb-read-line (function).
ssb-string (function).
ssb-string= (function).
%make-ssb (function).
%print-ssb (function).
*default-ssb-size* (special variable).
extend-ssb (function).
ssb-size (reader).
(setf ssb-size) (writer).
sstring-buffer (structure).
sstring-buffer-p (function).
sstring-replace (function).
tagger/util/variable-storage.lisputil (module).
alloc-item (function).
clear-variable-storage (function).
free-item (function).
make-variable-storage (function).
print-object (method).
print-variable-storage (function).
with-storage-balance (macro).
*all-buckets* (special variable).
*allocated-items* (special variable).
*hash-storage-p* (special variable).
*storage-count* (special variable).
+end-buckets+ (constant).
+largest-bucket+ (constant).
+significant-bit-mask+ (constant).
+significant-bit-shift+ (constant).
+significant-bits+ (constant).
ash-1 (macro).
bucket-size (function).
copy-storage-bucket (function).
default-cons (function).
f+ (macro).
fash (macro).
fast-integer-length (function).
fits-bucket-p (macro).
fixnum-vector (type).
int (macro).
make-storage-bucket (function).
print-storage-bucket (function).
round-bucket (function).
sb-buckets (reader).
(setf sb-buckets) (writer).
sb-cons-fn (reader).
(setf sb-cons-fn) (writer).
sb-name (reader).
(setf sb-name) (writer).
sb-out-count (reader).
(setf sb-out-count) (writer).
sb-out-size (reader).
(setf sb-out-size) (writer).
size-bucket (function).
storage-bucket (structure).
storage-bucket-p (function).
tagger/util/vector-resource.lisputil (module).
adjust-byte32v (function).
adjust-fixv (function).
adjust-lbyte32v (function).
adjust-lfixv (function).
adjust-lsfv (function).
adjust-lsv (function).
adjust-sfv (function).
adjust-sv (function).
alloc-byte32v (function).
alloc-fixv (function).
alloc-lbyte32v (function).
alloc-lfixv (function).
alloc-lsfv (function).
alloc-lsv (function).
alloc-sfv (function).
alloc-sv (function).
byte32-vector (type).
byte32v-length (macro).
(setf byte32v-length) (setf expander).
byte32vref (macro).
clear-byte32v-storage (function).
clear-fixv-storage (function).
clear-sfv-storage (function).
clear-sv-storage (function).
copy-byte32v (function).
copy-fixv (function).
copy-sfv (function).
copy-sv (function).
fill-byte32v (function).
fill-fixv (function).
fill-lbyte32v (function).
fill-lfixv (function).
fill-lsfv (function).
fill-lsv (function).
fill-sfv (function).
fill-sv (function).
fixnum-vector (type).
fixv-length (macro).
(setf fixv-length) (setf expander).
fixvref (macro).
free-byte32v (function).
free-fixv (function).
free-fn (macro).
(setf free-fn) (setf expander).
free-sfv (function).
free-sv (function).
lert (macro).
lert* (macro).
let-byte32v (macro).
let-fixv (macro).
let-sfv (macro).
let-sv (macro).
make-byte32v (function).
make-fixv (function).
make-sfv (function).
make-sv (function).
resource-type (macro).
(setf resource-type) (setf expander).
sfv-add (function).
sfv-div (function).
sfv-length (macro).
(setf sfv-length) (setf expander).
sfv-max (function).
sfvref (macro).
single-float-vector (type).
sv-length (macro).
(setf sv-length) (setf expander).
%alloc-byte32v (function).
%alloc-fixv (function).
%alloc-sfv (function).
%alloc-sv (function).
*byte32v-storage* (special variable).
*fixv-storage* (special variable).
*sfv-storage* (special variable).
*sv-storage* (special variable).
define-vector-resource (macro).
tagger/util/hmm.lisputil (module).
hmm (structure).
hmm-a (reader).
(setf hmm-a) (writer).
hmm-b (reader).
(setf hmm-b) (writer).
hmm-est (structure).
hmm-m (reader).
(setf hmm-m) (writer).
hmm-maximal-path (function).
hmm-n (reader).
(setf hmm-n) (writer).
hmm-pi (reader).
(setf hmm-pi) (writer).
hmm-read (function).
hmm-read-file (function).
hmm-train (function).
hmm-train-multiple (function).
hmm-write (function).
hmm-write-file (function).
make-hmm (function).
make-hmm-est (function).
make-sfm (function).
print-object (method).
print-object (method).
sfmref (macro).
%make-hmm-est (function).
+negative-infinity+ (constant).
compute-a-prime (function).
compute-alpha (function).
compute-b-prime (function).
compute-beta (function).
compute-c (function).
compute-log-likelihood (function).
compute-maxes-at-sym (function).
compute-pi-prime (function).
constrain-hmm (function).
constrain-matrix (function).
constrain-vector (function).
copy-hmm (function).
copy-hmm-est (function).
copy-sfm (function).
fill-sfm (function).
finalize-path (function).
hmm-add (function).
hmm-div (function).
hmm-est-log-a (reader).
(setf hmm-est-log-a) (writer).
hmm-est-log-b (reader).
(setf hmm-est-log-b) (writer).
hmm-est-log-pi (reader).
(setf hmm-est-log-pi) (writer).
hmm-est-m (reader).
(setf hmm-est-m) (writer).
hmm-est-maxes (reader).
(setf hmm-est-maxes) (writer).
hmm-est-n (reader).
(setf hmm-est-n) (writer).
hmm-est-p (function).
hmm-est-probs (reader).
(setf hmm-est-probs) (writer).
hmm-est-resource (reader).
(setf hmm-est-resource) (writer).
hmm-p (function).
hmm-train-step (function).
initialize-path (function).
log-matrix-transposed (function).
log-vector (function).
next-array (function).
normalize-a-prime (function).
normalize-alpha (function).
return-array (function).
sfm-add (function).
sfm-div (function).
sfm-read (function).
sfm-write (function).
tagger/util/skip-list.lisputil (module).
clear-skip-list (function).
do-skip-list (macro).
free-skip-list (function).
make-skip-list (function).
map-skip-list (function).
print-object (method).
skip-list (structure).
skip-list-copy (function).
skip-list-difference (function).
skip-list-empty-p (macro).
(setf skip-list-get) (setf expander).
skip-list-get (function).
skip-list-intersection (function).
skip-list-length (reader).
(setf skip-list-length) (writer).
skip-list-merge (function).
skip-list-pop (function).
skip-list-remove (function).
skip-list-top (function).
skip-list-union (function).
%make-skip-list (function).
%print-skip-list (function).
*free-nodes* (special variable).
*free-skip-lists* (special variable).
+first-level+ (constant).
+max-level+ (constant).
advance-finger (function).
cached-set-finger (function).
coin-toss (macro).
copy-skip-list (function).
do-nodes (macro).
finger-end (function).
finger-next (function).
finger-start (function).
free-node (function).
grow-header (function).
insert-node (function).
make-node (function).
node-key (macro).
node-level (macro).
node-next (macro).
node-value (macro).
pop-node (function).
random-level (function).
remove-node (function).
set-finger (function).
shift-nodes (function).
shrink-header (function).
skip-list-delta (function).
skip-list-destructive-intersection (function).
skip-list-finger (reader).
(setf skip-list-finger) (writer).
skip-list-header (reader).
(setf skip-list-header) (writer).
skip-list-level (reader).
(setf skip-list-level) (writer).
skip-list-order-fn (reader).
(setf skip-list-order-fn) (writer).
skip-list-p (function).
skip-list-put (function).
top-node (macro).
tagger/corpus/corpus-protocol.lispcorpus (module).
close-corpus (generic function).
close-doc (generic function).
corpus (class).
corpus-id-limit (generic function).
display-doc (generic function).
do-docs (macro).
do-titles (macro).
doc-title (generic function).
initialize-corpus (generic function).
map-docs (generic function).
match-doc-titles (generic function).
open-corpus (generic function).
open-doc (generic function).
update-corpus (generic function).
tagger/fsa/fsa-basics.lispfsa (module).
*epsilon* (special variable).
copy-delta (generic function).
delta-get (function).
determinize (generic function).
dfa (class).
fsa (class).
fsa-delta (reader method).
(setf fsa-delta) (writer method).
fsa-final-states (reader method).
(setf fsa-final-states) (writer method).
fsa-start-state (reader method).
(setf fsa-start-state) (writer method).
in-language-p (generic function).
initialize-instance (method).
invert (generic function).
make-dfa (generic function).
make-load-form (method).
make-nfa (generic function).
make-ordered-set (generic function).
make-relation (generic function).
make-state (generic function).
make-state-map (function).
make-state-relation (function).
minimize (generic function).
nfa (class).
ordered-set (class).
relation (class).
relation-empty-p (generic function).
relation-get (generic function).
(setf relation-get) (generic function).
relation-map (generic function).
set-clear (generic function).
set-copy (generic function).
set-empty-p (generic function).
set-insert (generic function).
set-intersect (generic function).
set-length (generic function).
set-map (generic function).
set-member-p (generic function).
set-minus (generic function).
set-order-fn (generic function).
set-union (generic function).
state-order-fn (generic function).
states-get (function).
symbol-order-fn (generic function).
symbols-get (function).
add-arcs (function).
add-dests (function).
copy-states (function).
epsilon-closure (method).
epsilon-closure (method).
extended-delta (method).
extended-delta (method).
fsa-print (method).
make-delta (function).
make-fsa-delta-load-form (method).
make-fsa-final-states-load-form (method).
make-set-set (function).
make-state-set (function).
make-symbol-relation (function).
make-symbol-set (function).
map-state (function).
merge-states (generic function).
tagger/fsa/standard-states.lispfsa (module).
fixnum-states (class).
last-state (reader method).
(setf last-state) (writer method).
make-state (method).
state-order-fn (method).
tagger/fsa/standard-symbols.lispfsa (module).
char-symbols (class).
fixnum-symbols (class).
make-transducer-pair (function).
standard-symbols (class).
symbol-order-fn (method).
symbol-order-fn (method).
symbol-order-fn (method).
symbol-order-fn (method).
symbol-order-fn (method).
symbol-symbols (class).
tp-lower (reader).
(setf tp-lower) (writer).
tp-upper (reader).
(setf tp-upper) (writer).
transducer-pair-p (function).
transducer-symbols (class).
copy-transducer-pair (function).
transducer-pair (structure).
tagger/fsa/list-sets.lispfsa (module).
list-set (class).
list-sets (class).
make-ordered-set (method).
print-object (method).
set-clear (method).
set-copy (method).
set-empty-p (method).
set-insert (method).
set-intersect (method).
set-length (method).
set-map (method).
set-member-p (method).
set-minus (method).
set-order-fn (method).
set-union (method).
list-head (reader method).
(setf list-head) (writer method).
list-order (reader method).
(setf list-order) (writer method).
tagger/fsa/skip-list-relations.lispfsa (module).
make-relation (method).
print-object (method).
relation-empty-p (method).
relation-get (method).
(setf relation-get) (method).
relation-map (method).
shared-initialize (method).
skip-list-relation (class).
skip-list-relations (class).
relation-skip-list (reader method).
(setf relation-skip-list) (writer method).
tagger/fsa/fsa-standard.lispfsa (module).
dfa-standard (class).
fsa-standard (class).
make-dfa (method).
make-nfa (method).
nfa-standard (class).
tagger/fsa/fsa-calculus.lispfsa (module).
fsa-closure (function).
fsa-concat (function).
fsa-minus (function).
fsa-optional (function).
fsa-plus (function).
fsa-symbol (function).
fsa-union (function).
regexp-to-fsa (function).
copy-to-nfa (function).
make-pair-order-fn (function).
tagger/analysis/analysis-protocol.lispanalysis (module).
*analysis-directory* (special variable).
analysis (class).
char-ts (class).
clean-text-string (function).
do-tokens (macro).
get-text-string (generic function).
make-ts (generic function).
next-token (generic function).
paragraph-start-pos (generic reader).
(setf paragraph-start-pos) (generic writer).
print-paragraph (function).
sentence-start-pos (generic reader).
(setf sentence-start-pos) (generic writer).
shared-initialize (method).
token-end-pos (generic function).
(setf token-end-pos) (generic function).
token-filter (class).
token-start-pos (generic function).
ts (class).
ts-char-stream (reader method).
(setf ts-char-stream) (writer method).
ts-doc-id (reader method).
(setf ts-doc-id) (writer method).
ts-types (generic function).
*line-width* (special variable).
tagger/analysis/lexicon-protocol.lispanalysis (module).
*the-keyword-package* (special variable).
*tokenizer-class* (special variable).
class-order (function).
initialize-instance (method).
lexicon (class).
lexicon-classes (generic function).
lexicon-filter (class).
lexicon-lookup (generic function).
lexicon-open-class (generic function).
(setf lexicon-open-class) (writer method).
lexicon-tags (function).
next-token (method).
re-read-lexicon (function).
ts-lexicon (reader method).
(setf ts-lexicon) (writer method).
tagger/analysis/tag-basics.lispanalysis (module).
basic-tag-ts (class).
check-tag-state (method).
class->number (function).
class-count (function).
initialize-instance (method).
number->class (function).
number->tag (function).
tag->number (function).
tag-count (function).
tagger-pathname (reader method).
(setf tagger-pathname) (writer method).
tagger-symbol-biases (reader method).
(setf tagger-symbol-biases) (writer method).
tagger-transition-biases (reader method).
(setf tagger-transition-biases) (writer method).
write-tag-state (method).
ts-class-trie (reader method).
(setf ts-class-trie) (writer method).
ts-class-vector (reader method).
(setf ts-class-vector) (writer method).
ts-tag-trie (reader method).
(setf ts-tag-trie) (writer method).
ts-tag-vector (reader method).
(setf ts-tag-vector) (writer method).
tagger/analysis/tag-analysis.lispanalysis (module).
get-text-string (method).
initialize-instance (method).
make-ts (method).
next-token (method).
next-token (method).
paragraph-start-pos (reader method).
(setf paragraph-start-pos) (writer method).
reinitialize-instance (method).
sentence-start-pos (reader method).
(setf sentence-start-pos) (writer method).
tag-analysis (class).
tag-file (function).
tag-string (function).
tagging-ts (class).
token-class (method).
token-end-pos (method).
token-start-pos (method).
tokenize-file (function).
*free-bt-head* (special variable).
alloc-bt (function).
bt-class (reader).
(setf bt-class) (writer).
bt-end-pos (reader).
(setf bt-end-pos) (writer).
bt-form (reader).
(setf bt-form) (writer).
bt-start-pos (reader).
(setf bt-start-pos) (writer).
bt-tag (reader).
(setf bt-tag) (writer).
buffered-token (structure).
buffered-token-p (function).
copy-buffered-token (function).
count-tags (function).
dict-ts (reader method).
(setf dict-ts) (writer method).
free-bt (function).
make-bt (function).
print-tagging-ts (class).
tag-next-sentence (function).
ts-hmm-est (reader method).
(setf ts-hmm-est) (writer method).
tagger/analysis/class-guesser.lispanalysis (module).
initialize-instance (method).
lexicon-lookup (method).
next-token (method).
read-string-trie (function).
reinitialize-instance (method).
shared-initialize (method).
suffix-lexicon (class).
suffix-pathname (reader method).
(setf suffix-pathname) (writer method).
train-guesser-on-files (function).
write-string-trie (function).
*suffix-limit* (special variable).
closed-class-table (reader method).
(setf closed-class-table) (writer method).
covering-class (function).
dict-ts (reader method).
(setf dict-ts) (writer method).
do-plist (macro).
mask-tag-table (function).
sort-fixnum-plist (function).
suffix-training-ts (class).
suffix-trie (reader method).
suffix-trie (reader method).
(setf suffix-trie) (writer method).
(setf suffix-trie) (writer method).
suffix-ts-count (reader method).
(setf suffix-ts-count) (writer method).
truncate-trie (function).
tagger/analysis/fsa-tokenizer.lispanalysis (module).
def-tokenizer-fsa (macro).
fsa-tokenizer (class).
get-text-string (method).
initialize-instance (method).
make-dfa (method).
make-nfa (method).
make-tokenizer-fsa (function).
next-token (method).
print-token-stream (method).
shared-initialize (method).
token-end-pos (reader method).
(setf token-end-pos) (method).
token-start-pos (reader method).
tokenizer-fsa (reader method).
tokenizer-fsa (class).
ts-types (method).
*english-tokenizer-fsa* (special variable).
*line-length* (special variable).
+char-code-bits+ (constant).
adjust-stream-head (function).
apply-tokenizer (function).
copy-stream-head (function).
copy-tokenizer-tables (function).
delta-ref (macro).
fsa-backups (reader method).
(setf fsa-backups) (writer method).
fsa-types (reader method).
(setf fsa-types) (writer method).
initialize-stream-head (function).
make-stream-head (function).
make-tokenizer-tables (function).
make-tt (method).
sh-end (reader).
(setf sh-end) (writer).
sh-pos (reader).
(setf sh-pos) (writer).
sh-read-char (function).
sh-read-pointer (reader).
(setf sh-read-pointer) (writer).
sh-ssb (reader).
(setf sh-ssb) (writer).
sh-stream (reader).
(setf sh-stream) (writer).
stream-head (structure).
stream-head-p (function).
tokenizer-dfa (class).
tokenizer-nfa (class).
tokenizer-tables (structure).
tokenizer-tables-p (function).
tokenizer-tt (reader method).
tt-delta (reader).
(setf tt-delta) (writer).
tt-finals (reader).
(setf tt-finals) (writer).
tt-start-state (reader).
(setf tt-start-state) (writer).
tagger/analysis/vector-lexicon.lispanalysis (module).
initialize-instance (method).
lexicon-classes (method).
lexicon-lookup (method).
read-vector-lexicon (function).
reinitialize-instance (method).
shared-initialize (method).
vector-lexicon (class).
write-vector-lexicon (method).
all-stems-identical-p (function).
binary-search (function).
get-class-number (function).
invert-class-numbers (function).
make-class-numbers (function).
make-keyword (macro).
read-until-newline (function).
read-until-space (function).
vl-class-tags (reader method).
(setf vl-class-tags) (writer method).
vl-classes (reader method).
(setf vl-classes) (writer method).
vl-length (macro).
vl-pathname (reader method).
(setf vl-pathname) (writer method).
vl-stems (reader method).
(setf vl-stems) (writer method).
vl-surface (reader method).
(setf vl-surface) (writer method).
tagger/analysis/tag-brown.lispanalysis (module).
brown-tokenizer (class).
evaluate-brown (function).
next-token (method).
next-token (method).
*brown-lexicon* (special variable).
*brown-open-class* (special variable).
*brown-tokenizer-fsa* (special variable).
*brown-transition-biases* (special variable).
brown-evaluation-ts (class).
brown-lexicon (class).
brown-truth-ts (reader method).
(setf brown-truth-ts) (writer method).
brown-truth-ts (class).
do-plist (macro).
fast-alpha-char-p (macro).
make-tag (function).
parse-token (function).
ts-ambiguous (reader method).
(setf ts-ambiguous) (writer method).
ts-confusion-table (reader method).
(setf ts-confusion-table) (writer method).
ts-error-trie (reader method).
(setf ts-error-trie) (writer method).
ts-errors (reader method).
(setf ts-errors) (writer method).
ts-output-p (reader method).
(setf ts-output-p) (writer method).
ts-total (reader method).
(setf ts-total) (writer method).
tagger/analysis/tag-english.lispanalysis (module).
*english-tokenizer-fsa* (special variable).
english-tokenizer (class).
tagger/analysis/tag-trainer.lispanalysis (module).
initialize-instance (method).
next-token (method).
reinitialize-instance (method).
train-combination (function).
train-on-docs (function).
train-on-files (function).
write-tag-state (method).
*tag-iterations* (special variable).
*tag-quantum* (special variable).
bias-hmm (function).
compute-epsilon (function).
convert-symbol-biases (function).
convert-transition-biases (function).
dict-ts (reader method).
(setf dict-ts) (writer method).
get-random-id (function).
make-training-hmm (function).
stream-to-tokens (function).
tokens-to-input-seq (function).
train-on-docs-internal (function).
train-on-files-internal (function).
train-on-streams (function).
training-ts (class).
ts-hmm (reader method).
(setf ts-hmm) (writer method).
valid-id-p (function).
Packages are listed by definition order.
tag-brownfinite-state-automataskip-listtag-basicsssbtagger.internalcons-resourcebinary-ioskip-list-relationstag-analysissv-resourcevector-lexicontag-trainertag-englishvector-resourcesvbvariable-storagetriefsa-tokenizertaggerfloat-vectorstring-resourcestandard-symbolslist-setsstandard-statestdbhmmclass-guesserfsa-standardcl-extensionstag-browncl-extensions.
class-guesser.
common-lisp.
fsa-tokenizer.
ssb.
string-resource.
tag-analysis.
tag-basics.
tdb.
trie.
vector-lexicon.
brown-tokenizer (class).
evaluate-brown (function).
*brown-lexicon* (special variable).
*brown-open-class* (special variable).
*brown-tokenizer-fsa* (special variable).
*brown-transition-biases* (special variable).
brown-evaluation-ts (class).
brown-lexicon (class).
brown-truth-ts (generic reader).
(setf brown-truth-ts) (generic writer).
brown-truth-ts (class).
do-plist (macro).
fast-alpha-char-p (macro).
make-tag (function).
parse-token (function).
ts-ambiguous (generic reader).
(setf ts-ambiguous) (generic writer).
ts-confusion-table (generic reader).
(setf ts-confusion-table) (generic writer).
ts-error-trie (generic reader).
(setf ts-error-trie) (generic writer).
ts-errors (generic reader).
(setf ts-errors) (generic writer).
ts-output-p (generic reader).
(setf ts-output-p) (generic writer).
ts-total (generic reader).
(setf ts-total) (generic writer).
finite-state-automatafsa
common-lisp.
*epsilon* (special variable).
copy-delta (generic function).
delta-get (function).
determinize (generic function).
dfa (class).
fsa (class).
fsa-closure (function).
fsa-concat (function).
fsa-delta (generic reader).
(setf fsa-delta) (generic writer).
fsa-final-states (generic reader).
(setf fsa-final-states) (generic writer).
fsa-minus (function).
fsa-optional (function).
fsa-plus (function).
fsa-start-state (generic reader).
(setf fsa-start-state) (generic writer).
fsa-symbol (function).
fsa-union (function).
in-language-p (generic function).
invert (generic function).
make-dfa (generic function).
make-nfa (generic function).
make-ordered-set (generic function).
make-relation (generic function).
make-state (generic function).
make-state-map (function).
make-state-relation (function).
minimize (generic function).
nfa (class).
ordered-set (class).
regexp-to-fsa (function).
relation (class).
relation-empty-p (generic function).
relation-get (generic function).
(setf relation-get) (generic function).
relation-map (generic function).
set-clear (generic function).
set-copy (generic function).
set-empty-p (generic function).
set-insert (generic function).
set-intersect (generic function).
set-length (generic function).
set-map (generic function).
set-member-p (generic function).
set-minus (generic function).
set-order-fn (generic function).
set-union (generic function).
state-order-fn (generic function).
states-get (function).
symbol-order-fn (generic function).
symbols-get (function).
add-arcs (function).
add-dests (function).
copy-states (function).
copy-to-nfa (function).
epsilon-closure (generic function).
extended-delta (generic function).
fsa-print (generic function).
make-delta (function).
make-fsa-delta-load-form (generic function).
make-fsa-final-states-load-form (generic function).
make-pair-order-fn (function).
make-set-set (function).
make-state-set (function).
make-symbol-relation (function).
make-symbol-set (function).
map-state (function).
merge-states (generic function).
skip-listcommon-lisp.
clear-skip-list (function).
do-skip-list (macro).
free-skip-list (function).
make-skip-list (function).
map-skip-list (function).
skip-list (structure).
skip-list (slot).
skip-list-copy (function).
skip-list-difference (function).
skip-list-empty-p (macro).
(setf skip-list-get) (setf expander).
skip-list-get (function).
skip-list-intersection (function).
skip-list-length (reader).
(setf skip-list-length) (writer).
skip-list-merge (function).
skip-list-pop (function).
skip-list-remove (function).
skip-list-top (function).
skip-list-union (function).
%make-skip-list (function).
%print-skip-list (function).
*free-nodes* (special variable).
*free-skip-lists* (special variable).
+first-level+ (constant).
+max-level+ (constant).
advance-finger (function).
cached-set-finger (function).
coin-toss (macro).
copy-skip-list (function).
do-nodes (macro).
finger-end (function).
finger-next (function).
finger-start (function).
free-node (function).
grow-header (function).
insert-node (function).
make-node (function).
node-key (macro).
node-level (macro).
node-next (macro).
node-value (macro).
pop-node (function).
random-level (function).
remove-node (function).
set-finger (function).
shift-nodes (function).
shrink-header (function).
skip-list-delta (function).
skip-list-destructive-intersection (function).
skip-list-finger (reader).
(setf skip-list-finger) (writer).
skip-list-header (reader).
(setf skip-list-header) (writer).
skip-list-level (reader).
(setf skip-list-level) (writer).
skip-list-order-fn (reader).
(setf skip-list-order-fn) (writer).
skip-list-p (function).
skip-list-put (function).
top-node (macro).
tag-basicscl-extensions.
common-lisp.
fsa-tokenizer.
tdb.
trie.
basic-tag-ts (class).
check-tag-state (generic function).
class->number (function).
class-count (function).
number->class (function).
number->tag (function).
tag->number (function).
tag-count (function).
tagger-pathname (generic reader).
(setf tagger-pathname) (generic writer).
tagger-symbol-biases (generic reader).
(setf tagger-symbol-biases) (generic writer).
tagger-transition-biases (generic reader).
(setf tagger-transition-biases) (generic writer).
write-tag-state (generic function).
ts-class-trie (generic reader).
(setf ts-class-trie) (generic writer).
ts-class-vector (generic reader).
(setf ts-class-vector) (generic writer).
ts-tag-trie (generic reader).
(setf ts-tag-trie) (generic writer).
ts-tag-vector (generic reader).
(setf ts-tag-vector) (generic writer).
ssbcl-extensions.
common-lisp.
copy-ssb (function).
make-ssb (function).
reinitialize-ssb (function).
ssb-buffer (reader).
(setf ssb-buffer) (writer).
ssb-pointer (reader).
(setf ssb-pointer) (writer).
ssb-push-extend (macro).
ssb-read-line (function).
ssb-string (function).
ssb-string= (function).
%make-ssb (function).
%print-ssb (function).
*default-ssb-size* (special variable).
extend-ssb (function).
ssb-size (reader).
(setf ssb-size) (writer).
sstring-buffer (structure).
sstring-buffer-p (function).
sstring-replace (function).
tagger.internalcommon-lisp.
cltl1-eval-when (macro).
defun-compile-time (macro).
cons-resourcecl-extensions.
common-lisp.
%cons (function).
%copy-list (function).
%copy-tree (function).
%delete (function).
%list (macro).
%make-list (function).
%pop (macro).
%push (macro).
%with-collection (macro).
free-cell (function).
free-list (function).
free-tree (function).
*cons-cells* (special variable).
binary-iocl-extensions.
common-lisp.
cons-resource.
string-resource.
tagger.internal.
*default-byte8-stream-buffer-size* (special variable).
byte16-order (function).
byte16-read (function).
byte16-write (function).
byte32-read (function).
byte32-write (function).
byte8-read (macro).
byte8-stream-length (macro).
byte8-write (macro).
close-byte8-stream (macro).
debug-io-fns (function).
define-io-fns (macro).
define-io-struct (macro).
find-io-fns (macro).
flush-byte8-stream (macro).
get-byte8-stream-position (macro).
int29-order (function).
int29-read (function).
int29-size (function).
int29-write (function).
integer-order (function).
integer-read (function).
integer-size (function).
integer-write (function).
io-copy-fn (reader).
(setf io-copy-fn) (writer).
io-fns (structure).
io-fns-arg (function).
io-fns-name (reader).
io-fns-p (function).
io-free-fn (reader).
(setf io-free-fn) (writer).
io-order-fn (reader).
(setf io-order-fn) (writer).
io-read-fn (reader).
(setf io-read-fn) (writer).
io-size-fn (reader).
(setf io-size-fn) (writer).
io-write-fn (reader).
(setf io-write-fn) (writer).
make-io-fns (function).
make-ordered-io-fns (function).
open-byte8-stream (macro).
ordered-io-fns (structure).
ordered-io-fns-p (function).
pad-byte8-stream (macro).
read-byte32 (function).
set-byte8-stream-position (macro).
simple-string-order (function).
simple-string-size (function).
simple-stringp-order (function).
single-float-order (function).
single-float-read (function).
single-float-size (function).
single-float-write (function).
string-order (function).
string-read (function).
string-size (function).
string-write (function).
stringp-order (function).
swapped-byte32 (type).
undebug-io-fns (function).
with-open-byte8-stream (macro).
write-byte32 (function).
%print-io-fns (function).
*fns-being-debugged* (special variable).
*io-fns* (special variable).
*lower-case* (special variable).
copy-io-fns (function).
copy-ordered-io-fns (function).
copy-parsed-io-struct (function).
io-copy-fn-name (reader).
(setf io-copy-fn-name) (writer).
io-free-fn-name (reader).
(setf io-free-fn-name) (writer).
io-io-copy-fn (function).
(setf io-io-copy-fn) (function).
io-io-copy-fn-name (function).
(setf io-io-copy-fn-name) (function).
io-io-fns-name (function).
io-io-free-fn (function).
(setf io-io-free-fn) (function).
io-io-free-fn-name (function).
(setf io-io-free-fn-name) (function).
io-io-read-fn (function).
(setf io-io-read-fn) (function).
io-io-read-fn-name (function).
(setf io-io-read-fn-name) (function).
io-io-size-fn (function).
(setf io-io-size-fn) (function).
io-io-size-fn-name (function).
(setf io-io-size-fn-name) (function).
io-io-write-fn (function).
(setf io-io-write-fn) (function).
io-io-write-fn-name (function).
(setf io-io-write-fn-name) (function).
io-order-fn-name (reader).
(setf io-order-fn-name) (writer).
io-read-fn-name (reader).
(setf io-read-fn-name) (writer).
io-size-fn-name (reader).
(setf io-size-fn-name) (writer).
io-write-fn-name (reader).
(setf io-write-fn-name) (writer).
make-pis (function).
pis-accessors (function).
(setf pis-accessors) (function).
pis-slot-names (function).
(setf pis-slot-names) (function).
pis-slot-types (function).
(setf pis-slot-types) (function).
skip-list-relationscommon-lisp.
finite-state-automata.
skip-list.
skip-list-relation (class).
skip-list-relations (class).
relation-skip-list (generic reader).
(setf relation-skip-list) (generic writer).
tag-analysiscl-extensions.
common-lisp.
cons-resource.
fsa-tokenizer.
hmm.
ssb.
string-resource.
sv-resource.
svb.
tag-basics.
tdb.
tag-analysis (class).
tag-file (function).
tag-string (function).
tagging-ts (class).
token-class (generic function).
tokenize-file (function).
*free-bt-head* (special variable).
alloc-bt (function).
bt-class (reader).
(setf bt-class) (writer).
bt-end-pos (reader).
(setf bt-end-pos) (writer).
bt-form (reader).
(setf bt-form) (writer).
bt-start-pos (reader).
(setf bt-start-pos) (writer).
bt-tag (reader).
(setf bt-tag) (writer).
buffered-token (structure).
buffered-token-p (function).
copy-buffered-token (function).
count-tags (function).
dict-ts (generic reader).
(setf dict-ts) (generic writer).
free-bt (function).
make-bt (function).
print-tagging-ts (class).
tag-next-sentence (function).
ts-hmm-est (generic reader).
(setf ts-hmm-est) (generic writer).
sv-resourcecommon-lisp.
*sv-fill-pointers* (special variable).
*sv-table* (special variable).
*sv-table-lengths* (special variable).
+max-sv-length+ (constant).
sv-fill-pointer (macro).
sv-table-length (macro).
vector-lexiconbinary-io.
cl-extensions.
common-lisp.
cons-resource.
skip-list.
ssb.
string-resource.
sv-resource.
svb.
tdb.
trie.
read-vector-lexicon (function).
vector-lexicon (class).
write-vector-lexicon (generic function).
all-stems-identical-p (function).
binary-search (function).
get-class-number (function).
invert-class-numbers (function).
make-class-numbers (function).
make-keyword (macro).
read-until-newline (function).
read-until-space (function).
vl-class-tags (generic reader).
(setf vl-class-tags) (generic writer).
vl-classes (generic reader).
(setf vl-classes) (generic writer).
vl-length (macro).
vl-pathname (generic reader).
(setf vl-pathname) (generic writer).
vl-stems (generic reader).
(setf vl-stems) (generic writer).
vl-surface (generic reader).
(setf vl-surface) (generic writer).
tag-trainercl-extensions.
common-lisp.
cons-resource.
float-vector.
hmm.
string-resource.
sv-resource.
tag-basics.
tdb.
train-combination (function).
train-on-docs (function).
train-on-files (function).
*tag-iterations* (special variable).
*tag-quantum* (special variable).
bias-hmm (function).
compute-epsilon (function).
convert-symbol-biases (function).
convert-transition-biases (function).
dict-ts (generic reader).
(setf dict-ts) (generic writer).
get-random-id (function).
make-training-hmm (function).
stream-to-tokens (function).
tokens-to-input-seq (function).
train-on-docs-internal (function).
train-on-files-internal (function).
train-on-streams (function).
training-ts (class).
ts-hmm (generic reader).
(setf ts-hmm) (generic writer).
valid-id-p (function).
tag-englishcl-extensions.
class-guesser.
common-lisp.
fsa-tokenizer.
tag-analysis.
tag-basics.
tag-brown.
tdb.
vector-lexicon.
*english-tokenizer-fsa* (special variable).
english-tokenizer (class).
vector-resourcecl-extensions.
common-lisp.
tagger.internal.
variable-storage.
adjust-byte32v (function).
adjust-fixv (function).
adjust-lbyte32v (function).
adjust-lfixv (function).
adjust-lsfv (function).
adjust-lsv (function).
adjust-sfv (function).
adjust-sv (function).
alloc-byte32v (function).
alloc-fixv (function).
alloc-lbyte32v (function).
alloc-lfixv (function).
alloc-lsfv (function).
alloc-lsv (function).
alloc-sfv (function).
alloc-sv (function).
byte32-vector (type).
byte32v-length (macro).
(setf byte32v-length) (setf expander).
byte32vref (macro).
clear-byte32v-storage (function).
clear-fixv-storage (function).
clear-sfv-storage (function).
clear-sv-storage (function).
copy-byte32v (function).
copy-fixv (function).
copy-sfv (function).
copy-sv (function).
fill-byte32v (function).
fill-fixv (function).
fill-lbyte32v (function).
fill-lfixv (function).
fill-lsfv (function).
fill-lsv (function).
fill-sfv (function).
fill-sv (function).
fixnum-vector (type).
fixv-length (macro).
(setf fixv-length) (setf expander).
fixvref (macro).
free-byte32v (function).
free-fixv (function).
free-fn (macro).
(setf free-fn) (setf expander).
free-sfv (function).
free-sv (function).
lert (macro).
lert* (macro).
let-byte32v (macro).
let-fixv (macro).
let-sfv (macro).
let-sv (macro).
make-byte32v (function).
make-fixv (function).
make-sfv (function).
make-sv (function).
resource-type (macro).
(setf resource-type) (setf expander).
sfv-add (function).
sfv-div (function).
sfv-length (macro).
(setf sfv-length) (setf expander).
sfv-max (function).
sfvref (macro).
single-float-vector (type).
sv-length (macro).
(setf sv-length) (setf expander).
%alloc-byte32v (function).
%alloc-fixv (function).
%alloc-sfv (function).
%alloc-sv (function).
*byte32v-storage* (special variable).
*fixv-storage* (special variable).
*sfv-storage* (special variable).
*sv-storage* (special variable).
define-vector-resource (macro).
svbcl-extensions.
common-lisp.
string-resource.
copy-string-to-svb (function).
copy-svb (function).
copy-svb-to-string (function).
extend-svb (function).
make-svb (function).
svb (structure).
svb-buffer (reader).
(setf svb-buffer) (writer).
svb-pointer (reader).
(setf svb-pointer) (writer).
svb-push-extend (macro).
svb-size (reader).
(setf svb-size) (writer).
svbref (macro).
%make-svb (function).
%print-svb (function).
*default-svb-size* (special variable).
sv-replace (function).
svb-p (function).
variable-storagecommon-lisp.
cons-resource.
tagger.internal.
alloc-item (function).
clear-variable-storage (function).
free-item (function).
make-variable-storage (function).
print-variable-storage (function).
with-storage-balance (macro).
*all-buckets* (special variable).
*allocated-items* (special variable).
*hash-storage-p* (special variable).
*storage-count* (special variable).
+end-buckets+ (constant).
+largest-bucket+ (constant).
+significant-bit-mask+ (constant).
+significant-bit-shift+ (constant).
+significant-bits+ (constant).
ash-1 (macro).
bucket-size (function).
copy-storage-bucket (function).
default-cons (function).
f+ (macro).
fash (macro).
fast-integer-length (function).
fits-bucket-p (macro).
fixnum-vector (type).
int (macro).
make-storage-bucket (function).
print-storage-bucket (function).
round-bucket (function).
sb-buckets (reader).
(setf sb-buckets) (writer).
sb-cons-fn (reader).
(setf sb-cons-fn) (writer).
sb-name (reader).
(setf sb-name) (writer).
sb-out-count (reader).
(setf sb-out-count) (writer).
sb-out-size (reader).
(setf sb-out-size) (writer).
size-bucket (function).
storage-bucket (structure).
storage-bucket-p (function).
triecl-extensions.
common-lisp.
svb.
define-trie (macro).
make-simple-vector-trie (function).
make-string-trie (function).
map-st (function).
map-svt (function).
sort-trie (function).
st-get (function).
(setf st-get) (function).
svt-get (function).
(setf svt-get) (function).
trie (structure).
trie-node-key (reader).
(setf trie-node-key) (writer).
trie-node-value (reader).
(setf trie-node-value) (writer).
walk-string (function).
%print-trie (function).
copy-trie (function).
copy-trie-node (function).
make-trie (function).
make-trie-node (function).
sort-trie-node (function).
trie-inverse-key-fn (reader).
(setf trie-inverse-key-fn) (writer).
trie-key-fn (reader).
(setf trie-key-fn) (writer).
trie-node (structure).
trie-node-next (reader).
(setf trie-node-next) (writer).
trie-node-p (function).
trie-node-subnode (reader).
(setf trie-node-subnode) (writer).
trie-p (function).
trie-root-subnodes (reader).
(setf trie-root-subnodes) (writer).
trie-root-value (reader).
(setf trie-root-value) (writer).
fsa-tokenizerfsa-t
cl-extensions.
common-lisp.
finite-state-automata.
fsa-standard.
ssb.
standard-states.
string-resource.
tdb.
def-tokenizer-fsa (macro).
fsa-tokenizer (class).
make-tokenizer-fsa (function).
print-token-stream (generic function).
tokenizer-fsa (generic reader).
tokenizer-fsa (class).
*english-tokenizer-fsa* (special variable).
*line-length* (special variable).
+char-code-bits+ (constant).
adjust-stream-head (function).
apply-tokenizer (function).
copy-stream-head (function).
copy-tokenizer-tables (function).
delta-ref (macro).
fsa-backups (generic reader).
(setf fsa-backups) (generic writer).
fsa-types (generic reader).
(setf fsa-types) (generic writer).
initialize-stream-head (function).
make-stream-head (function).
make-tokenizer-tables (function).
make-tt (generic function).
sh-end (reader).
(setf sh-end) (writer).
sh-pos (reader).
(setf sh-pos) (writer).
sh-read-char (function).
sh-read-pointer (reader).
(setf sh-read-pointer) (writer).
sh-ssb (reader).
(setf sh-ssb) (writer).
sh-stream (reader).
(setf sh-stream) (writer).
stream-head (structure).
stream-head-p (function).
tokenizer-dfa (class).
tokenizer-nfa (class).
tokenizer-tables (structure).
tokenizer-tables-p (function).
tokenizer-tt (generic reader).
tt-delta (reader).
(setf tt-delta) (writer).
tt-finals (reader).
(setf tt-finals) (writer).
tt-start-state (reader).
(setf tt-start-state) (writer).
float-vectorbinary-io.
common-lisp.
cons-resource.
variable-storage.
vector-resource.
string-resourcecl-extensions.
common-lisp.
+max-string-length+ (constant).
alloc-string (function).
free-string (function).
simple-string-copy (function).
string-copy (function).
*string-fill-pointers* (special variable).
*string-table* (special variable).
*string-table-lengths* (special variable).
string-fill-pointer (macro).
string-table-length (macro).
standard-symbolscommon-lisp.
finite-state-automata.
char-symbols (class).
fixnum-symbols (class).
make-transducer-pair (function).
standard-symbols (class).
symbol-symbols (class).
tp-lower (reader).
(setf tp-lower) (writer).
tp-upper (reader).
(setf tp-upper) (writer).
transducer-pair-p (function).
transducer-symbols (class).
copy-transducer-pair (function).
transducer-pair (structure).
list-setscommon-lisp.
finite-state-automata.
list-head (generic reader).
(setf list-head) (generic writer).
list-order (generic reader).
(setf list-order) (generic writer).
standard-statescommon-lisp.
finite-state-automata.
fixnum-states (class).
last-state (generic reader).
(setf last-state) (generic writer).
tdbcl-extensions.
common-lisp.
finite-state-automata.
ssb.
string-resource.
sv-resource.
tagger.internal.
*analysis-directory* (special variable).
*highly-optimized* (special variable).
*normally-optimized* (special variable).
*the-keyword-package* (special variable).
*tokenizer-class* (special variable).
analysis (class).
char-ts (class).
class-order (function).
clean-text-string (function).
close-corpus (generic function).
close-doc (generic function).
corpus (class).
corpus-id-limit (generic function).
def-tdb-system (macro).
display-doc (generic function).
do-docs (macro).
do-titles (macro).
do-tokens (macro).
doc-title (generic function).
get-text-string (generic function).
initialize-corpus (generic function).
lexicon (class).
lexicon-classes (generic function).
lexicon-filter (class).
lexicon-lookup (generic function).
lexicon-open-class (generic function).
(setf lexicon-open-class) (generic writer).
lexicon-tags (function).
make-ts (generic function).
map-docs (generic function).
match-doc-titles (generic function).
next-token (generic function).
open-corpus (generic function).
open-doc (generic function).
paragraph-start-pos (slot).
paragraph-start-pos (generic reader).
(setf paragraph-start-pos) (generic writer).
print-paragraph (function).
re-read-lexicon (function).
sentence-start-pos (slot).
sentence-start-pos (generic reader).
(setf sentence-start-pos) (generic writer).
tdb-compile (function).
tdb-dirpath (function).
tdb-pathname (function).
token-end-pos (slot).
token-end-pos (generic function).
(setf token-end-pos) (generic function).
token-filter (class).
token-start-pos (slot).
token-start-pos (generic function).
ts (class).
ts-char-stream (generic reader).
(setf ts-char-stream) (generic writer).
ts-doc-id (generic reader).
(setf ts-doc-id) (generic writer).
ts-lexicon (generic reader).
(setf ts-lexicon) (generic writer).
ts-types (generic function).
update-corpus (generic function).
*line-width* (special variable).
*tdb-binary-subdirectory* (special variable).
*tdb-systems* (special variable).
hmmbinary-io.
cl-extensions.
common-lisp.
cons-resource.
float-vector.
hmm (structure).
hmm-a (reader).
(setf hmm-a) (writer).
hmm-b (reader).
(setf hmm-b) (writer).
hmm-est (structure).
hmm-m (reader).
(setf hmm-m) (writer).
hmm-maximal-path (function).
hmm-n (reader).
(setf hmm-n) (writer).
hmm-pi (reader).
(setf hmm-pi) (writer).
hmm-read (function).
hmm-read-file (function).
hmm-train (function).
hmm-train-multiple (function).
hmm-write (function).
hmm-write-file (function).
make-hmm (function).
make-hmm-est (function).
make-sfm (function).
sfmref (macro).
%make-hmm-est (function).
+negative-infinity+ (constant).
compute-a-prime (function).
compute-alpha (function).
compute-b-prime (function).
compute-beta (function).
compute-c (function).
compute-log-likelihood (function).
compute-maxes-at-sym (function).
compute-pi-prime (function).
constrain-hmm (function).
constrain-matrix (function).
constrain-vector (function).
copy-hmm (function).
copy-hmm-est (function).
copy-sfm (function).
fill-sfm (function).
finalize-path (function).
hmm-add (function).
hmm-div (function).
hmm-est-log-a (reader).
(setf hmm-est-log-a) (writer).
hmm-est-log-b (reader).
(setf hmm-est-log-b) (writer).
hmm-est-log-pi (reader).
(setf hmm-est-log-pi) (writer).
hmm-est-m (reader).
(setf hmm-est-m) (writer).
hmm-est-maxes (reader).
(setf hmm-est-maxes) (writer).
hmm-est-n (reader).
(setf hmm-est-n) (writer).
hmm-est-p (function).
hmm-est-probs (reader).
(setf hmm-est-probs) (writer).
hmm-est-resource (reader).
(setf hmm-est-resource) (writer).
hmm-p (function).
hmm-train-step (function).
initialize-path (function).
log-matrix-transposed (function).
log-vector (function).
next-array (function).
normalize-a-prime (function).
normalize-alpha (function).
return-array (function).
sfm-add (function).
sfm-div (function).
sfm-read (function).
sfm-write (function).
class-guessercl-extensions.
common-lisp.
cons-resource.
string-resource.
sv-resource.
tag-basics.
tdb.
trie.
read-string-trie (function).
suffix-lexicon (class).
suffix-pathname (generic reader).
(setf suffix-pathname) (generic writer).
train-guesser-on-files (function).
write-string-trie (function).
*suffix-limit* (special variable).
closed-class-table (generic reader).
(setf closed-class-table) (generic writer).
covering-class (function).
dict-ts (generic reader).
(setf dict-ts) (generic writer).
do-plist (macro).
mask-tag-table (function).
sort-fixnum-plist (function).
suffix-training-ts (class).
suffix-trie (generic reader).
(setf suffix-trie) (generic writer).
suffix-ts-count (generic reader).
(setf suffix-ts-count) (generic writer).
truncate-trie (function).
fsa-standardcommon-lisp.
finite-state-automata.
list-sets.
skip-list-relations.
standard-states.
standard-symbols.
dfa-standard (class).
fsa-standard (class).
nfa-standard (class).
cl-extensionscommon-lisp.
tagger.internal.
add-process (macro).
byte16 (type).
byte28 (type).
byte32 (type).
byte7 (type).
byte8 (type).
define-list-sorter (macro).
effective-function (function).
fast-read-char (macro).
fast-read-file-char (macro).
format-name (function).
get-qua (macro).
int29 (type).
kill-process (macro).
make-lock (macro).
once-only (macro).
process-block (macro).
this-process (macro).
with-collection (macro).
with-effective-function (macro).
with-lock (macro).
with-locks (macro).
without-interrupts (macro).
*the-class-t* (special variable).
file-length (generic function).
get-qua-internal (function).
string-input-stream-limit (function).
Definitions are sorted by export status, category, package, and then by lexicographic order.
basic-tag-ts)) ¶tdb.
fsa-tokenizer)) ¶tagging-ts)) ¶fixnum-states)) ¶automatically generated reader method
fixnum-states)) ¶automatically generated writer method
tdb.
vector-lexicon)) ¶lexicon-filter)) ¶tdb.
vector-lexicon)) ¶suffix-lexicon)) ¶lexicon-filter)) ¶tdb.
lexicon-filter)) ¶tokenizer-fsa)) ¶fsa-standard)) ¶tokenizer-fsa)) ¶fsa-standard)) ¶skip-list-relations)) ¶fixnum-states)) ¶tdb.
tag-analysis) &key start end) ¶tdb.
training-ts)) ¶brown-evaluation-ts)) ¶brown-truth-ts)) ¶fsa-tokenizer)) ¶suffix-training-ts)) ¶print-tagging-ts)) ¶tagging-ts)) ¶lexicon-filter)) ¶tdb.
tagging-ts)) ¶automatically generated reader method
tdb.
tagging-ts)) ¶automatically generated writer method
skip-list-relation)) ¶skip-list-relation)) ¶skip-list-relation)) ¶skip-list-relation)) ¶tdb.
tagging-ts)) ¶automatically generated reader method
tdb.
tagging-ts)) ¶automatically generated writer method
fixnum-states)) ¶suffix-lexicon)) ¶automatically generated reader method
suffix-lexicon)) ¶automatically generated writer method
transducer-symbols)) ¶standard-symbols)) ¶fixnum-symbols)) ¶symbol-symbols)) ¶char-symbols)) ¶basic-tag-ts)) ¶automatically generated reader method
basic-tag-ts)) ¶automatically generated writer method
basic-tag-ts)) ¶automatically generated reader method
basic-tag-ts)) ¶automatically generated writer method
basic-tag-ts)) ¶automatically generated reader method
basic-tag-ts)) ¶automatically generated writer method
tagging-ts)) ¶tdb.
fsa-tokenizer)) ¶automatically generated reader method
tagging-ts)) ¶tdb.
fsa-tokenizer)) ¶tdb.
fsa-tokenizer)) ¶automatically generated reader method
tagging-ts)) ¶fsa-tokenizer)) ¶automatically generated reader method
tdb.
lexicon-filter)) ¶automatically generated reader method
tdb.
lexicon-filter)) ¶automatically generated writer method
tdb.
fsa-tokenizer)) ¶training-ts)) ¶basic-tag-ts)) ¶vector-lexicon) pathname) ¶basic-tag-ts) &key &allow-other-keys) ¶tagging-ts) &key char-stream start end &allow-other-keys) ¶vector-lexicon) &rest rest &key lexicon-size &allow-other-keys) ¶training-ts) &key char-stream start end &allow-other-keys) ¶fsa-tokenizer) &key &allow-other-keys) ¶lexicon) &key lexicon-open-class &allow-other-keys) ¶suffix-training-ts) &key char-stream start end &allow-other-keys) ¶sstring-buffer) stream) ¶ordered-io-fns) stream) ¶skip-list-relation) stream) ¶storage-bucket) stream) ¶tagging-ts) &key char-stream start end &allow-other-keys) ¶vector-lexicon) &key &allow-other-keys) ¶training-ts) &key char-stream start end &allow-other-keys) ¶suffix-training-ts) &key char-stream start end &allow-other-keys) ¶hmm.
structure-object.
fixnum
0
fixnum
0
vector-resource:single-float-vector
(vector-resource:make-sfv 0)
simple-vector
(quote #())
simple-vector
(quote #())
hmm.
structure-object.
fixnum
0
fixnum
0
vector-resource:single-float-vector
(vector-resource:make-sfv 0)
simple-vector
(quote #())
simple-vector
(quote #())
vector-resource:single-float-vector
(vector-resource:make-sfv 0)
vector-resource:single-float-vector
(vector-resource:make-sfv 0)
structure-object.
This slot is read-only.
(or symbol list)
function
(function (lambda (binary-io::obj) (declare (ignore binary-io::obj)) 0))
(or symbol list)
function
(function (lambda (stream) (declare (ignore stream)) nil))
(or symbol list)
function
(function (lambda (binary-io::obj stream) (declare (ignore binary-io::obj stream)) nil))
(or symbol list)
(or null function)
(or symbol list)
(or null function)
structure-object.
common-lisp.
fixnum
0
(make-array (1+ skip-list::+max-level+) :initial-element nil)
(make-array (1+ skip-list::+max-level+))
fixnum
(1- skip-list::+first-level+)
function
(function (lambda (skip-list::x skip-list::y) (declare (ignore skip-list::x skip-list::y)) :equal))
trie.
structure-object.
svb:svb
(svb:make-svb 0)
(or null function)
(or null function)
check-tag-state.
initialize-instance.
(setf tagger-pathname).
tagger-pathname.
(setf tagger-symbol-biases).
tagger-symbol-biases.
(setf tagger-transition-biases).
tagger-transition-biases.
(setf ts-class-trie).
ts-class-trie.
(setf ts-class-vector).
ts-class-vector.
(setf ts-tag-trie).
ts-tag-trie.
(setf ts-tag-vector).
ts-tag-vector.
write-tag-state.
:tags
:classes
:tagger-pathname
(quote nil)
:symbol-biases
(quote nil)
:transition-biases
| Initarg | Value |
|---|---|
:lexicon | (or *brown-lexicon* (setq *brown-lexicon* (make-instance (quote brown-lexicon)))) |
:tagger-pathname | (tdb-pathname data brown brown) |
:tokenizer-fsa | *brown-tokenizer-fsa* |
:transition-biases | *brown-transition-biases* |
:symbol-biases | (quasiquote ((valid (nn np) nn) (valid (jj np) jj) (valid (ap ql rb) ap ql) (valid (cs in) in) (valid #s(comma :expr *brown-open-class* :kind 0) nn nns np nps))) |
| Initarg | Value |
|---|---|
:tokenizer-fsa | *english-tokenizer-fsa* |
-1
tdb.
fixnum
:start
This slot is read-only.
fsa-tokenizer::*english-tokenizer-fsa*
:tokenizer-fsa
This slot is read-only.
This slot is read-only.
(fsa-tokenizer::make-stream-head)
:skip-list
ts.
:hmm-est
(svb:make-svb)
(svb:make-svb)
fixnum
0
:dict-ts
:lexicon-pathname
svb:svb
:surface
svb:svb
:classes
svb:svb
:stems
simple-vector
#()
Free list of CONS cells linked by CDR
Return a copy of SEQUENCE which is EQUAL to SEQUENCE but not EQ.
copy-seq.
string-input-stream-limit.
trie.
trie.
trie.
brown-evaluation-ts)) ¶automatically generated reader method
brown-evaluation-ts)) ¶automatically generated writer method
suffix-training-ts)) ¶automatically generated reader method
suffix-training-ts)) ¶automatically generated writer method
tagging-ts)) ¶automatically generated reader method
tagging-ts)) ¶automatically generated writer method
training-ts)) ¶automatically generated reader method
training-ts)) ¶automatically generated writer method
suffix-training-ts)) ¶automatically generated reader method
suffix-training-ts)) ¶automatically generated writer method
ordered-set) (fsa nfa)) ¶ordered-set) (fsa nfa)) ¶tokenizer-fsa)) ¶automatically generated reader method
tokenizer-fsa)) ¶automatically generated writer method
tokenizer-fsa)) ¶automatically generated reader method
tokenizer-fsa)) ¶automatically generated writer method
fixnum-states)) ¶skip-list-relation)) ¶automatically generated reader method
skip-list-relation)) ¶automatically generated writer method
suffix-training-ts)) ¶automatically generated reader method
suffix-lexicon)) ¶automatically generated reader method
suffix-training-ts)) ¶automatically generated writer method
suffix-lexicon)) ¶automatically generated writer method
suffix-training-ts)) ¶automatically generated reader method
suffix-training-ts)) ¶automatically generated writer method
fsa-tokenizer)) ¶automatically generated reader method
brown-evaluation-ts)) ¶automatically generated reader method
brown-evaluation-ts)) ¶automatically generated writer method
basic-tag-ts)) ¶automatically generated reader method
basic-tag-ts)) ¶automatically generated writer method
basic-tag-ts)) ¶automatically generated reader method
basic-tag-ts)) ¶automatically generated writer method
brown-evaluation-ts)) ¶automatically generated reader method
brown-evaluation-ts)) ¶automatically generated writer method
brown-evaluation-ts)) ¶automatically generated reader method
brown-evaluation-ts)) ¶automatically generated writer method
brown-evaluation-ts)) ¶automatically generated reader method
brown-evaluation-ts)) ¶automatically generated writer method
training-ts)) ¶automatically generated reader method
training-ts)) ¶automatically generated writer method
tagging-ts)) ¶automatically generated reader method
tagging-ts)) ¶automatically generated writer method
brown-evaluation-ts)) ¶automatically generated reader method
brown-evaluation-ts)) ¶automatically generated writer method
basic-tag-ts)) ¶automatically generated reader method
basic-tag-ts)) ¶automatically generated writer method
basic-tag-ts)) ¶automatically generated reader method
basic-tag-ts)) ¶automatically generated writer method
brown-evaluation-ts)) ¶automatically generated reader method
brown-evaluation-ts)) ¶automatically generated writer method
vector-lexicon)) ¶automatically generated reader method
vector-lexicon)) ¶automatically generated writer method
vector-lexicon)) ¶automatically generated reader method
vector-lexicon)) ¶automatically generated writer method
vector-lexicon)) ¶automatically generated reader method
vector-lexicon)) ¶automatically generated writer method
vector-lexicon)) ¶automatically generated reader method
vector-lexicon)) ¶automatically generated writer method
vector-lexicon)) ¶automatically generated reader method
vector-lexicon)) ¶automatically generated writer method
structure-object.
cl-extensions:byte28
0
cl-extensions:byte28
0
common-lisp.
structure-object.
(simple-array t *)
(make-array variable-storage::+end-buckets+)
fixnum
0
fixnum
0
(function (fixnum &optional t) t)
(function variable-storage::default-cons)
structure-object.
(ssb:make-ssb)
fixnum
0
cl-extensions:byte28
0
cl-extensions:byte28
0
common-lisp.
structure-object.
fixnum
0
(simple-array fixnum (*))
(make-array 0 :element-type (quote fixnum))
simple-vector
#()
:truth-ts
:output-p
fixnum
0
fixnum
0
fixnum
0
:confusion-table
:error-trie
| Initarg | Value |
|---|---|
:lexicon-open-class | *brown-open-class* |
:lexicon-pathname | (tdb-pathname data brown lexicon.txt) |
:lexicon-size | 150000 |
:suffix-pathname | (tdb-pathname data brown suffix.trie) |
| Jump to: | %
(
A B C D E F G H I K L M N O P R S T U V W |
|---|
| Jump to: | %
(
A B C D E F G H I K L M N O P R S T U V W |
|---|
| Jump to: | *
+
A B C D E F H I K L M N O P R S T U V |
|---|
| Jump to: | *
+
A B C D E F H I K L M N O P R S T U V |
|---|
| Jump to: | A B C D E F H I L M N O P R S T U V |
|---|
| Jump to: | A B C D E F H I L M N O P R S T U V |
|---|