The cl-conllu Reference Manual

Table of Contents

Next: , Previous: , Up: (dir)   [Contents][Index]

The cl-conllu Reference Manual

This is the cl-conllu Reference Manual, version 0.5, generated automatically by Declt version 3.0 "Montgomery Scott" on Mon Dec 02 09:21:07 2019 GMT+0.


Next: , Previous: , Up: Top   [Contents][Index]

1 Introduction

#+title: Library for working with CoNLL-U files with CL

The =cl-conllu= is a Common Lisp library to work with [[http://universaldependencies.org/format.html][CoNLL-U]],
licensed under the [[http://www.apache.org/licenses/LICENSE-2.0][Apache license]].

It is developed and tested with SBCL but should probably run with any
other implementation.

* Install

The =cl-conllu= library is now available from quicklisp distribution,
if you are not planning to change the code, just use:

#+BEGIN_SRC lisp
(ql:quickload :cl-conllu)
#+END_SRC

If you don't have quicklisp installed already, follow [[https://www.quicklisp.org/beta/#installation][these steps]].

If you plan on contributing, clone this project to your
=local-projects= quicklisp directory (usually at
=~/quicklisp/local-projects/=) and use the same command as above to
load the code.

* Documentation

See the https://github.com/own-pt/cl-conllu/wiki

* How to cite

http://arademaker.github.io/bibliography/tilic-stil-2017.html

#+BEGIN_EXAMPLE
@inproceedings{tilic-stil-2017,
  author = {Muniz, Henrique and Chalub, Fabricio and Rademaker, Alexandre},
  title = {CL-CONLLU: dependências universais em Common Lisp},
  booktitle = {V Workshop de Iniciação Científica em Tecnologia da
                    Informação e da Linguagem Humana (TILic)},
  year = {2017},
  address = {Uberlândia, MG, Brazil},
  note = {https://sites.google.com/view/tilic2017/}
}
#+END_EXAMPLE


Next: , Previous: , Up: Top   [Contents][Index]

2 Systems

The main system appears first, followed by any subsystem dependency.


Previous: , Up: Systems   [Contents][Index]

2.1 cl-conllu

Author

Alexandre Rademaker <alexrad@br.ibm.com>

License

Apache 2.0

Description

Common Lisp library for dealing with CoNLL-U files

Long Description

This library provides a set of functions to work with CoNLL-U files. See https://universaldependencies.org/format.html for details about the CoNLL-U format adopted by the Universal Dependencies community. The library has functions for read/write files, apply rules for sentences transformation in batch mode, tree visualization, compare and evaluation trees etc. Documentation available in https://github.com/own-pt/cl-conllu/wiki.

Version

0.5

Dependencies
Source

cl-conllu.asd (file)

Components

Next: , Previous: , Up: Top   [Contents][Index]

3 Files

Files are sorted by type and then listed depth-first from the systems components trees.


Previous: , Up: Files   [Contents][Index]

3.1 Lisp


Next: , Previous: , Up: Lisp files   [Contents][Index]

3.1.1 cl-conllu.asd

Location

cl-conllu.asd

Systems

cl-conllu (system)


Next: , Previous: , Up: Lisp files   [Contents][Index]

3.1.2 cl-conllu/packages.lisp

Parent

cl-conllu (system)

Location

packages.lisp

Packages

Next: , Previous: , Up: Lisp files   [Contents][Index]

3.1.3 cl-conllu/data.lisp

Dependencies
Parent

cl-conllu (system)

Location

data.lisp

Exported Definitions
Internal Definitions

Next: , Previous: , Up: Lisp files   [Contents][Index]

3.1.4 cl-conllu/read-write.lisp

Dependencies
Parent

cl-conllu (system)

Location

read-write.lisp

Exported Definitions
Internal Definitions

Next: , Previous: , Up: Lisp files   [Contents][Index]

3.1.5 cl-conllu/evaluate.lisp

Dependencies
Parent

cl-conllu (system)

Location

evaluate.lisp

Exported Definitions
Internal Definitions

Next: , Previous: , Up: Lisp files   [Contents][Index]

3.1.6 cl-conllu/confusion-matrix.lisp

Dependencies
Parent

cl-conllu (system)

Location

confusion-matrix.lisp

Exported Definitions
Internal Definitions

Next: , Previous: , Up: Lisp files   [Contents][Index]

3.1.7 cl-conllu/html.lisp

Dependencies
Parent

cl-conllu (system)

Location

html.lisp

Exported Definitions
Internal Definitions

Next: , Previous: , Up: Lisp files   [Contents][Index]

3.1.8 cl-conllu/query.lisp

Dependencies
Parent

cl-conllu (system)

Location

query.lisp

Exported Definitions
Internal Definitions

Next: , Previous: , Up: Lisp files   [Contents][Index]

3.1.9 cl-conllu/utils.lisp

Dependencies
Parent

cl-conllu (system)

Location

utils.lisp

Exported Definitions
Internal Definitions

Next: , Previous: , Up: Lisp files   [Contents][Index]

3.1.10 cl-conllu/rdf.lisp

Dependencies
Parent

cl-conllu (system)

Location

rdf.lisp

Exported Definitions
Internal Definitions

Next: , Previous: , Up: Lisp files   [Contents][Index]

3.1.11 cl-conllu/rdf-wilbur.lisp

Dependencies
Parent

cl-conllu (system)

Location

rdf-wilbur.lisp

Exported Definitions

convert-to-rdf (function)

Internal Definitions

Next: , Previous: , Up: Lisp files   [Contents][Index]

3.1.12 cl-conllu/command-line.lisp

Dependencies
Parent

cl-conllu (system)

Location

command-line.lisp

Internal Definitions

Next: , Previous: , Up: Lisp files   [Contents][Index]

3.1.13 cl-conllu/rules.lisp

Dependencies
Parent

cl-conllu (system)

Location

rules.lisp

Exported Definitions
Internal Definitions

Next: , Previous: , Up: Lisp files   [Contents][Index]

3.1.14 cl-conllu/editor.lisp

Dependencies
Parent

cl-conllu (system)

Location

editor.lisp

Exported Definitions

conlluedit (function)

Internal Definitions

Next: , Previous: , Up: Lisp files   [Contents][Index]

3.1.15 cl-conllu/conllu-prolog.lisp

Dependencies
Parent

cl-conllu (system)

Location

conllu-prolog.lisp

Exported Definitions

convert-filename (function)

Internal Definitions

Next: , Previous: , Up: Lisp files   [Contents][Index]

3.1.16 cl-conllu/niceline.lisp

Dependencies
Parent

cl-conllu (system)

Location

niceline.lisp

Internal Definitions

Next: , Previous: , Up: Lisp files   [Contents][Index]

3.1.17 cl-conllu/tag-converter.lisp

Dependencies
Parent

cl-conllu (system)

Location

tag-converter.lisp

Exported Definitions
Internal Definitions

write-token-tag-suffix (function)


Previous: , Up: Lisp files   [Contents][Index]

3.1.18 cl-conllu/draw.lisp

Dependencies
Parent

cl-conllu (system)

Location

draw.lisp

Exported Definitions

tree-sentence (function)

Internal Definitions

Next: , Previous: , Up: Top   [Contents][Index]

4 Packages

Packages are listed by definition order.


Next: , Previous: , Up: Packages   [Contents][Index]

4.1 conllu.html

Functions for producing html formatting of objects in the library.

Source

packages.lisp (file)

Use List
Exported Definitions
Internal Definitions

Next: , Previous: , Up: Packages   [Contents][Index]

4.2 cl-conllu

Source

packages.lisp (file)

Use List
Used By List
Exported Definitions
Internal Definitions

Next: , Previous: , Up: Packages   [Contents][Index]

4.3 conllu.rules

Source

packages.lisp (file)

Use List
Exported Definitions
Internal Definitions

Next: , Previous: , Up: Packages   [Contents][Index]

4.4 conllu.converters.tags

Source

packages.lisp (file)

Use List
Exported Definitions
Internal Definitions

write-token-tag-suffix (function)


Next: , Previous: , Up: Packages   [Contents][Index]

4.5 conllu.rdf

Source

packages.lisp (file)

Use List
Internal Definitions

Next: , Previous: , Up: Packages   [Contents][Index]

4.6 conllu.evaluate

Functions for evaluating datasets and parser outputs in the CoNLL-U format.

Source

packages.lisp (file)

Use List
Exported Definitions
Internal Definitions

Next: , Previous: , Up: Packages   [Contents][Index]

4.7 conllu.editor

ruled based transformations

Source

packages.lisp (file)

Use List
Exported Definitions

conlluedit (function)

Internal Definitions

Next: , Previous: , Up: Packages   [Contents][Index]

4.8 conllu.converters.niceline

Source

packages.lisp (file)

Use List
Internal Definitions

Next: , Previous: , Up: Packages   [Contents][Index]

4.9 conllu.draw

Source

packages.lisp (file)

Use List
Exported Definitions

tree-sentence (function)

Internal Definitions

Previous: , Up: Packages   [Contents][Index]

4.10 conllu.prolog

Source

packages.lisp (file)

Use List
Exported Definitions

convert-filename (function)

Internal Definitions

Next: , Previous: , Up: Top   [Contents][Index]

5 Definitions

Definitions are sorted by export status, category, package, and then by lexicographic order.


Next: , Previous: , Up: Definitions   [Contents][Index]

5.1 Exported definitions


Next: , Previous: , Up: Exported definitions   [Contents][Index]

5.1.1 Special variables

Special Variable: *confusion-matrix-style*

HTML for styling the confusion matrix.

Package

conllu.html

Source

html.lisp (file)


Next: , Previous: , Up: Exported definitions   [Contents][Index]

5.1.2 Functions

Function: adjust-sentence SENTENCE

Receives a sentence and reenumerate IDs and HEAD values of each token so that their order (as in sentence-tokens) is respected.

Package

cl-conllu

Source

data.lisp (file)

Function: apply-rules SENTENCES RULES RECURSIVE
Package

conllu.rules

Source

rules.lisp (file)

Function: apply-rules-from-files CONLLU-FILE RULES-FILE NEW-CONLLU-FILE LOG-FILE &key RECURSIVE
Package

conllu.rules

Source

rules.lisp (file)

Function: attachment-score-by-sentence LIST-SENT1 LIST-SENT2 &key LABELED IGNORE-PUNCT SIMPLE-DEP

Attachment score by sentence (macro-average).

The attachment score is the percentage of words that have correct arcs to their heads. The unlabeled attachment score (UAS) considers only who is the head of the token, while the labeled attachment score (LAS) considers both the head and the arc label (dependency label / syntactic class).

In order to choose between labeled or unlabeled,
set the key argument LABELED.

References:
- Dependency Parsing. Kubler, Mcdonald and Nivre (pp.79-80)

Package

conllu.evaluate

Source

evaluate.lisp (file)

Function: attachment-score-by-word LIST-SENT1 LIST-SENT2 &key LABELED IGNORE-PUNCT SIMPLE-DEP

Attachment score by word (micro-average).

The attachment score is the percentage of words that have correct arcs to their heads. The unlabeled attachment score (UAS) considers only who is the head of the token, while the labeled attachment score (LAS) considers both the head and the arc label (dependency label / syntactic class).

In order to choose between labeled or unlabeled,
set the key argument LABELED.

References:
- Dependency Parsing. Kubler, Mcdonald and Nivre (pp.79-80)

Package

conllu.evaluate

Source

evaluate.lisp (file)

Function: confusion-matrix-cell-count LABEL1 LABEL2 CM &key DEFAULT-IF-UNDEFINED

Returns the number of tokens that are contained in the cell defined by LABEL1 LABEL2 in the confusion matrix CM.

If DEFAULT-IF-UNDEFINED, returns 0. Otherwise, raises an error in case there is no such cell.

Package

conllu.evaluate

Source

confusion-matrix.lisp (file)

Function: confusion-matrix-cell-tokens LABEL1 LABEL2 CM &key DEFAULT-IF-UNDEFINED

Returns the list of (SENT-ID . TOKEN-ID) of tokens in the cell LABEL1 LABEL2.

If DEFAULT-IF-UNDEFINED, returns the empty list. Otherwise, raises an error in case there is no such cell.

Package

conllu.evaluate

Source

confusion-matrix.lisp (file)

Function: confusion-matrix-cells-labels CM

Returns a list of ’(LABEL1 LABEL2) for each cell in the confusion matrix CM.

Package

conllu.evaluate

Source

confusion-matrix.lisp (file)

Function: confusion-matrix-columns-labels CM
Package

conllu.evaluate

Source

confusion-matrix.lisp (file)

Function: confusion-matrix-labels CM

Returns the list of all labels in the confusion matrix CM.

Package

conllu.evaluate

Source

confusion-matrix.lisp (file)

Function: confusion-matrix-normalize CM

Returns a new CONFUSION-MATRIX with new empty cells for each pair (LABEL1 LABEL2) of labels in (confusion-matrix-labels CM) that are undefined in CM.

Package

conllu.evaluate

Source

confusion-matrix.lisp (file)

Function: confusion-matrix-rows-labels CM

Returns the list of labels occuring in the rows of the confusion matix CM.

Package

conllu.evaluate

Source

confusion-matrix.lisp (file)

Function: confusion-matrix-update LIST-SENT1 LIST-SENT2 CM

Updates an existing confusion matrix by a list of sentences LIST-SENT1 and LIST-SENT2.

Package

conllu.evaluate

Source

confusion-matrix.lisp (file)

Function: conlluedit SENTENCES RULES
Package

conllu.editor

Source

editor.lisp (file)

Function: convert-filename CONTEXT FILENAME-IN FILENAME-OUT
Package

conllu.prolog

Source

conllu-prolog.lisp (file)

Function: convert-rdf CORPUSNAME STREAM CONLLS TEXT-FN ID-FN

Converts the collection of sentences (as generated by READ-CONLLU) in CONLL, using the function TEXT-FN to extract the text of each sentence and ID-FN to extract the id of each sentence (we need this as there is no standardized way of knowing this.) Also the generated Turtle file contains a lot of duplication so when you import it into your triple-store, make sure you remove all duplicate triples afterwards.

Package

cl-conllu

Source

rdf.lisp (file)

Function: convert-rdf-file FILE-IN FILE-OUT
Package

cl-conllu

Source

rdf.lisp (file)

Function: convert-to-rdf SENTENCES &key TEXT-FN ID-FN CORPUSNAME NAMESPACE-STRING STREAM RDF-FORMAT CONLL-NAMESPACE

Converts a list of sentences (e.g. as generated by READ-CONLLU)
in SENTENCES, using the function TEXT-FN to extract the text of each sentence and ID-FN to extract the id of each sentence (we need this as there is no standardized way of knowing this.)

Currently only ntriples is supported as RDF-FORMAT.

Package

cl-conllu

Source

rdf-wilbur.lisp (file)

Function: diff SENTENCES-A SENTENCES-B &key TEST KEY
Package

cl-conllu

Source

utils.lisp (file)

Function: exact-match LIST-SENT1 LIST-SENT2 &key COMPARED-FIELDS IDENTITY-FIELDS TEST SIMPLE-DEP IGNORE-PUNCT

Returns the list of sentences of LIST-SENT1 that are an exact match to the corresponding sentence of LIST-SENT2 (same position in list).

LIST-SENT1 and LIST-SENT2 must have the same size with corresponding sentences in order.

Package

conllu.evaluate

Source

evaluate.lisp (file)

Function: exact-match-score LIST-SENT1 LIST-SENT2 &key COMPARED-FIELDS IDENTITY-FIELDS TEST SIMPLE-DEP IGNORE-PUNCT

Returns the percentage of sentences of LIST-SENT1 that are an exact match to LIST-SENT2.

LIST-SENT1 and LIST-SENT2 must have the same size with corresponding sentences in order.

The typical use case is comparing the result of a tagger (or parser) against a test set, where an exact match is a completely correct tagging (or parse) for the sentence.

References:
- Dependency Parsing. Kubler, Mcdonald and Nivre (p.79)

Package

conllu.evaluate

Source

evaluate.lisp (file)

Function: lazy-stream-reader STREAM &key FN-META START-LINENO

Return a function that returns one CoNLL-U sentence per call.

Package

cl-conllu

Source

read-write.lisp (file)

Function: levenshtein S1 S2 &key TEST
Package

cl-conllu

Source

utils.lisp (file)

Function: make-confusion-matrix LIST-SENT1 LIST-SENT2 &key CORPUS-ID KEY-FN TEST-FN SORT-FN

Creates a new confusion matrix from the lists of sentences LIST-SENT1 and LIST-SENT2.

Package

conllu.evaluate

Source

confusion-matrix.lisp (file)

Function: make-sentence LINENO LINES FN-META
Package

cl-conllu

Source

read-write.lisp (file)

Function: non-projective? SENTENCE

Verifies if a sentence tree is projective. Intuitively, this means that, keeping word order, there’s no two dependency arcs that cross.
More formally, let i -> j mean that j’s head is node i. Let ’->*’ be the transitive closure of ’->’.

A tree if projective when, for each node i, j: if i -> j, then for each node k between i and j (i < k < j or j < k < i), i ->* k.

References:
- Nivre, Joakim; Inductive Dependency Parsing, 2006
- https://en.wikipedia.org/wiki/Discontinuity_(linguistics)

Package

cl-conllu

Source

utils.lisp (file)

Function: non-projectivity-accuracy LIST-SENT1 LIST-SENT2
Package

conllu.evaluate

Source

evaluate.lisp (file)

Function: non-projectivity-precision LIST-SENT1 LIST-SENT2
Package

conllu.evaluate

Source

evaluate.lisp (file)

Function: non-projectivity-recall LIST-SENT1 LIST-SENT2
Package

conllu.evaluate

Source

evaluate.lisp (file)

Function: precision LIST-SENT1 LIST-SENT2 DEPREL &key ERROR-TYPE SIMPLE-DEP

Restricted to words which are classified as of syntactical class (dependency type to head) DEPREL, returns the precision:
the number of true positives divided by the number of words predicted positive (that is, predicted as of class DEPREL).

We assume that LIST-SENT1 is the classified (predicted) result and LIST-SENT2 is the list of golden (correct) sentences.

ERROR-TYPE defines what is considered an error (a false negative). Some usual values are:
- ’(deprel) :: for the deprel tagging task only
- ’(head) :: for considering errors for each syntactic class - ’(deprel head) :: for considering correct only when both deprel and head are correct.

Package

conllu.evaluate

Source

evaluate.lisp (file)

Function: query QUERY SENTENCES
Package

cl-conllu

Source

query.lisp (file)

Function: query-as-json A-QUERY SENTENCES
Package

cl-conllu

Source

query.lisp (file)

Function: read-conllu INPUT &key FN-META
Package

cl-conllu

Source

read-write.lisp (file)

Function: read-directory PATH &key FN-META
Package

cl-conllu

Source

read-write.lisp (file)

Function: read-file PATH &key FN-META
Package

cl-conllu

Source

read-write.lisp (file)

Function: read-file-tag-suffix FILENAME &key TAG SEPARATOR
Package

conllu.converters.tags

Source

tag-converter.lisp (file)

Function: read-sentence-tag-suffix STREAM FIELD SEPARATOR

Writes as sentence object input from STREAM as FORM.SEPARATOR.TAGVALUE (without dots), followed by a whitespace character.

Example:

;; Consider the file example.txt, with contents:
;; Pudim_NOUN é_VERB bom_ADJ ._PUNCT
;; E_CONJ torta_NOUN também_ADV ._PUNCT

(with-open-file (s "./example.txt")
(write-conllu-to-stream (read-sentence-tag-suffix s ’upostag "_"))) 1 Pudim _ NOUN _ _ _ _ _ _
2 é _ VERB _ _ _ _ _ _
3 bom _ ADJ _ _ _ _ _ _
4 . _ PUNCT _ _ _ _ _ _

1 E _ CONJ _ _ _ _ _ _
2 torta _ NOUN _ _ _ _ _ _
3 também _ ADV _ _ _ _ _ _
4 . _ PUNCT _ _ _ _ _ _

Package

conllu.converters.tags

Source

tag-converter.lisp (file)

Function: read-stream STREAM &key FN-META STOP? START-LINENO
Package

cl-conllu

Source

read-write.lisp (file)

Function: recall LIST-SENT1 LIST-SENT2 DEPREL &key ERROR-TYPE SIMPLE-DEP

Restricted to words which are originally of syntactic class (dependency type to head) DEPREL, returns the recall:
the number of true positives divided by the number of words originally positive (that is, originally of class DEPREL).

We assume that LIST-SENT1 is the classified result
and LIST-SENT2 is the list of golden (correct) sentences.

ERROR-TYPE defines what is considered an error (a false negative). Some usual values are:
- ’(deprel) :: for the deprel tagging task only
- ’(head) :: for considering errors for each syntactic class - ’(deprel head) :: for considering correct only when both deprel and head are correct.

Package

conllu.evaluate

Source

evaluate.lisp (file)

Function: sentence->text SENTENCE &key IGNORE-MTOKENS SPECIAL-FORMAT-TEST SPECIAL-FORMAT-FUNCTION

Receives SENTENCE, a sentence object, and returns a string reconstructed from its tokens and mtokens.

If IGNORE-MTOKENS, then tokens’ forms are used. Else, tokens with id contained in a mtoken are not used, with mtoken’s form being used instead.

It is possible to special format some tokens. In order to do so, both SPECIAL-FORMAT-TEST and SPECIAL-FORMAT-FUNCTION should be passed. Then for each object (token or mtoken) for which SPECIAL-FORMAT-TEST returns a non-nil result, its form is modified by SPECIAL-FORMAT-FUNCTION in the final string.

Example:
(sentence-tokens *sentence*)
=> (#<TOKEN The/DET #1-det-3> #<TOKEN US/PROPN #2-compound-3> #<TOKEN troops/NOUN #3-nsubj-4> #<TOKEN fired/VERB #4-root-0> #<TOKEN into/ADP #5-case-8> #<TOKEN the/DET #6-det-8>
#<TOKEN hostile/ADJ #7-amod-8> #<TOKEN crowd/NOUN #8-obl-4> #<TOKEN ,/PUNCT #9-punct-4> #<TOKEN killing/VERB #10-advcl-4> #<TOKEN 4/NUM #11-obj-10> #<TOKEN ./PUNCT #12-punct-4>)

(sentence->text
sentence)
=> "The US troops fired into the hostile crowd, killing 4."

(sentence->text
sentence
:special-format-test #’(lambda (token)
(eq (token-upostag token)
"VERB"))
:special-format-function (lambda (string)
(format nil "*~a*" (string-upcase string))))
=> "The US troops *FIRED* into the hostile crowd, *KILLING* 4."

Package

cl-conllu

Source

data.lisp (file)

Function: sentence-binary-tree SENTENCE

Based on the idea from [1], it produces a tree view of the sentence, still need to improve the priorities of children.

Code at https://github.com/sivareddyg/UDepLambda in file src/deplambda/parser/TreeTransformer.java method ’binarizeTree’

[1] Siva Reddy, O. Tackstrom, M. Collins, T. Kwiatkowski, D. Das, M. Steedman, and M. Lapataw, Transforming Dependency Structures to Logical Forms for Semantic Parsing, Transactions of the Association for Computational Linguistics, pp. 127–140, Apr. 2016.

Package

cl-conllu

Source

data.lisp (file)

Function: sentence-equal SENT-1 SENT-2

Tests if, for each slot, sent-1 has the same values as sent-2. For tokens and multiword tokens, it uses token-equal and mtoken-equal, respectively.

Package

cl-conllu

Source

data.lisp (file)

Function: sentence-hash-table SENTENCE
Package

cl-conllu

Source

data.lisp (file)

Function: sentence-id SENTENCE
Package

cl-conllu

Source

data.lisp (file)

Function: sentence-meta-value SENTENCE META-FIELD
Package

cl-conllu

Source

data.lisp (file)

Function: sentence-size SENTENCE
Package

cl-conllu

Source

data.lisp (file)

Function: sentence-text SENTENCE
Package

cl-conllu

Source

data.lisp (file)

Function: sentence-valid? SENTENCE
Package

cl-conllu

Source

data.lisp (file)

Function: simple-deprel DEPREL
Package

cl-conllu

Source

data.lisp (file)

Function: tree-sentence SENTENCE &key FIELDS STREAM SHOW-META
Package

conllu.draw

Source

draw.lisp (file)

Function: write-conllu SENTENCES FILENAME &key IF-EXISTS
Package

cl-conllu

Source

read-write.lisp (file)

Function: write-conllu-to-stream SENTENCES &optional OUT
Package

cl-conllu

Source

read-write.lisp (file)

Function: write-sentence-tag-suffix-to-stream SENTENCE &key STREAM TAG SEPARATOR

Writes sentence as CoNLL-U file in STREAM as FORM.SEPARATOR.TAGVALUE (without
dots), followed by a whitespace character.

If TAG is NIL, then writes only FORMs, followed by a whitespace character.

Example:
;; supposing sentence already defined
(write-sentence-tag-suffix-to-stream (sentence :tag ’xpostag :separator "_")) Pierre_NNP Vinken_NNP ,_, 61_CD years_NNS old_JJ ,_, will_MD join_VB the_DT board_NN as_IN a_DT nonexecutive_JJ director_NN Nov._NNP 29_CD ._.
=> NIL

Package

conllu.converters.tags

Source

tag-converter.lisp (file)

Function: write-sentences-tag-suffix SENTENCES FILENAME &key TAG SEPARATOR IF-EXISTS

See documentation for write-sentence-tag-suffix-to-stream

Package

conllu.converters.tags

Source

tag-converter.lisp (file)

Function: write-sentences-tag-suffix-to-stream SENTENCES &key STREAM TAG SEPARATOR

See documentation for write-sentence-tag-suffix-to-stream

Package

conllu.converters.tags

Source

tag-converter.lisp (file)


Next: , Previous: , Up: Exported definitions   [Contents][Index]

5.1.3 Generic functions

Generic Function: confusion-matrix-corpus-id OBJECT
Generic Function: (setf confusion-matrix-corpus-id) NEW-VALUE OBJECT
Package

conllu.evaluate

Methods
Method: confusion-matrix-corpus-id (CONFUSION-MATRIX confusion-matrix)
Method: (setf confusion-matrix-corpus-id) NEW-VALUE (CONFUSION-MATRIX confusion-matrix)

Identifier of the corpus or experiment.

Source

confusion-matrix.lisp (file)

Generic Function: format-html OBJECT

Outputs a HTML string for the object.

Package

conllu.html

Source

html.lisp (file)

Methods
Method: format-html (CM confusion-matrix)
Generic Function: mtoken-end OBJECT
Generic Function: (setf mtoken-end) NEW-VALUE OBJECT
Package

cl-conllu

Methods
Method: mtoken-end (MTOKEN mtoken)

automatically generated reader method

Source

data.lisp (file)

Method: (setf mtoken-end) NEW-VALUE (MTOKEN mtoken)

automatically generated writer method

Source

data.lisp (file)

Generic Function: mtoken-form OBJECT
Generic Function: (setf mtoken-form) NEW-VALUE OBJECT
Package

cl-conllu

Methods
Method: mtoken-form (MTOKEN mtoken)

automatically generated reader method

Source

data.lisp (file)

Method: (setf mtoken-form) NEW-VALUE (MTOKEN mtoken)

automatically generated writer method

Source

data.lisp (file)

Generic Function: mtoken-start OBJECT
Generic Function: (setf mtoken-start) NEW-VALUE OBJECT
Package

cl-conllu

Methods
Method: mtoken-start (MTOKEN mtoken)

automatically generated reader method

Source

data.lisp (file)

Method: (setf mtoken-start) NEW-VALUE (MTOKEN mtoken)

automatically generated writer method

Source

data.lisp (file)

Generic Function: sentence-meta OBJECT
Generic Function: (setf sentence-meta) NEW-VALUE OBJECT
Package

cl-conllu

Methods
Method: sentence-meta (SENTENCE sentence)

automatically generated reader method

Source

data.lisp (file)

Method: (setf sentence-meta) NEW-VALUE (SENTENCE sentence)

automatically generated writer method

Source

data.lisp (file)

Generic Function: sentence-mtokens OBJECT
Generic Function: (setf sentence-mtokens) NEW-VALUE OBJECT
Package

cl-conllu

Methods
Method: sentence-mtokens (SENTENCE sentence)

automatically generated reader method

Source

data.lisp (file)

Method: (setf sentence-mtokens) NEW-VALUE (SENTENCE sentence)

automatically generated writer method

Source

data.lisp (file)

Generic Function: sentence-start OBJECT
Generic Function: (setf sentence-start) NEW-VALUE OBJECT
Package

cl-conllu

Methods
Method: sentence-start (SENTENCE sentence)

automatically generated reader method

Source

data.lisp (file)

Method: (setf sentence-start) NEW-VALUE (SENTENCE sentence)

automatically generated writer method

Source

data.lisp (file)

Generic Function: sentence-tokens OBJECT
Generic Function: (setf sentence-tokens) NEW-VALUE OBJECT
Package

cl-conllu

Methods
Method: sentence-tokens (SENTENCE sentence)

automatically generated reader method

Source

data.lisp (file)

Method: (setf sentence-tokens) NEW-VALUE (SENTENCE sentence)

automatically generated writer method

Source

data.lisp (file)

Generic Function: token-deprel OBJECT
Generic Function: (setf token-deprel) NEW-VALUE OBJECT
Package

cl-conllu

Methods
Method: token-deprel (TOKEN token)

automatically generated reader method

Source

data.lisp (file)

Method: (setf token-deprel) NEW-VALUE (TOKEN token)

automatically generated writer method

Source

data.lisp (file)

Generic Function: token-deps OBJECT
Generic Function: (setf token-deps) NEW-VALUE OBJECT
Package

cl-conllu

Methods
Method: token-deps (TOKEN token)

automatically generated reader method

Source

data.lisp (file)

Method: (setf token-deps) NEW-VALUE (TOKEN token)

automatically generated writer method

Source

data.lisp (file)

Generic Function: token-feats OBJECT
Generic Function: (setf token-feats) NEW-VALUE OBJECT
Package

cl-conllu

Methods
Method: token-feats (TOKEN token)

automatically generated reader method

Source

data.lisp (file)

Method: (setf token-feats) NEW-VALUE (TOKEN token)

automatically generated writer method

Source

data.lisp (file)

Generic Function: token-form OBJECT
Generic Function: (setf token-form) NEW-VALUE OBJECT
Package

cl-conllu

Methods
Method: token-form (TOKEN token)

automatically generated reader method

Source

data.lisp (file)

Method: (setf token-form) NEW-VALUE (TOKEN token)

automatically generated writer method

Source

data.lisp (file)

Generic Function: token-head OBJECT
Generic Function: (setf token-head) NEW-VALUE OBJECT
Package

cl-conllu

Methods
Method: token-head (TOKEN token)

automatically generated reader method

Source

data.lisp (file)

Method: (setf token-head) NEW-VALUE (TOKEN token)

automatically generated writer method

Source

data.lisp (file)

Generic Function: token-id OBJECT
Generic Function: (setf token-id) NEW-VALUE OBJECT
Package

cl-conllu

Methods
Method: token-id (TOKEN token)

automatically generated reader method

Source

data.lisp (file)

Method: (setf token-id) NEW-VALUE (TOKEN token)

automatically generated writer method

Source

data.lisp (file)

Generic Function: token-lemma OBJECT
Generic Function: (setf token-lemma) NEW-VALUE OBJECT
Package

cl-conllu

Methods
Method: token-lemma (TOKEN token)

automatically generated reader method

Source

data.lisp (file)

Method: (setf token-lemma) NEW-VALUE (TOKEN token)

automatically generated writer method

Source

data.lisp (file)

Generic Function: token-misc OBJECT
Generic Function: (setf token-misc) NEW-VALUE OBJECT
Package

cl-conllu

Methods
Method: token-misc (TOKEN token)

automatically generated reader method

Source

data.lisp (file)

Method: (setf token-misc) NEW-VALUE (TOKEN token)

automatically generated writer method

Source

data.lisp (file)

Generic Function: token-sentence OBJECT
Generic Function: (setf token-sentence) NEW-VALUE OBJECT
Package

cl-conllu

Methods
Method: token-sentence (TOKEN token)

automatically generated reader method

Source

data.lisp (file)

Method: (setf token-sentence) NEW-VALUE (TOKEN token)

automatically generated writer method

Source

data.lisp (file)

Generic Function: token-upostag OBJECT
Generic Function: (setf token-upostag) NEW-VALUE OBJECT
Package

cl-conllu

Methods
Method: token-upostag (TOKEN token)

automatically generated reader method

Source

data.lisp (file)

Method: (setf token-upostag) NEW-VALUE (TOKEN token)

automatically generated writer method

Source

data.lisp (file)

Generic Function: token-xpostag OBJECT
Generic Function: (setf token-xpostag) NEW-VALUE OBJECT
Package

cl-conllu

Methods
Method: token-xpostag (TOKEN token)

automatically generated reader method

Source

data.lisp (file)

Method: (setf token-xpostag) NEW-VALUE (TOKEN token)

automatically generated writer method

Source

data.lisp (file)


Previous: , Up: Exported definitions   [Contents][Index]

5.1.4 Classes

Class: confusion-matrix ()
Package

conllu.evaluate

Source

confusion-matrix.lisp (file)

Direct superclasses

standard-object (class)

Direct methods
Direct slots
Slot: corpus-id

Identifier of the corpus or experiment.

Initargs

:corpus-id

Readers

confusion-matrix-corpus-id (generic function)

Writers

(setf confusion-matrix-corpus-id) (generic function)

Slot: key-fn

Function used to label each token.

Initargs

:key-fn

Initform

(function cl-conllu:token-upostag)

Readers

confusion-matrix-key-fn (generic function)

Writers

(setf confusion-matrix-key-fn) (generic function)

Slot: test-fn

Function which compares two labels. Typically a form of equality.

Initargs

:test-fn

Initform

(function equal)

Readers

confusion-matrix-test-fn (generic function)

Writers

(setf confusion-matrix-test-fn) (generic function)

Slot: sort-fn

Function which sorts labels. By default,
converts labels to string and uses lexicographical order

Initargs

:sort-fn

Initform

(function (lambda (conllu.evaluate::x conllu.evaluate::y) (string<= (format nil "~a" conllu.evaluate::x) (format nil "~a" conllu.evaluate::y))))

Readers

confusion-matrix-sort-fn (generic function)

Writers

(setf confusion-matrix-sort-fn) (generic function)

Slot: rows

Parameter which contains the contents of the confusion matrix.

Readers

confusion-matrix-rows (generic function)

Writers

(setf confusion-matrix-rows) (generic function)

Class: mtoken ()
Package

cl-conllu

Source

data.lisp (file)

Direct superclasses

standard-object (class)

Direct methods
Direct slots
Slot: start
Initargs

:start

Readers

mtoken-start (generic function)

Writers

(setf mtoken-start) (generic function)

Slot: end
Initargs

:end

Readers

mtoken-end (generic function)

Writers

(setf mtoken-end) (generic function)

Slot: form
Initargs

:form

Readers

mtoken-form (generic function)

Writers

(setf mtoken-form) (generic function)

Slot: misc
Initargs

:misc

Initform

"_"

Readers

mtoken-misc (generic function)

Writers

(setf mtoken-misc) (generic function)

Class: sentence ()
Package

cl-conllu

Source

data.lisp (file)

Direct superclasses

standard-object (class)

Direct methods
Direct slots
Slot: start
Initargs

:start

Initform

0

Readers

sentence-start (generic function)

Writers

(setf sentence-start) (generic function)

Slot: meta
Initargs

:meta

Readers

sentence-meta (generic function)

Writers

(setf sentence-meta) (generic function)

Slot: tokens
Initargs

:tokens

Readers

sentence-tokens (generic function)

Writers

(setf sentence-tokens) (generic function)

Slot: mtokens
Initargs

:mtokens

Readers

sentence-mtokens (generic function)

Writers

(setf sentence-mtokens) (generic function)

Class: token ()
Package

cl-conllu

Source

data.lisp (file)

Direct superclasses

standard-object (class)

Direct methods
Direct slots
Slot: id
Initargs

:id

Readers

token-id (generic function)

Writers

(setf token-id) (generic function)

Slot: form
Initargs

:form

Readers

token-form (generic function)

Writers

(setf token-form) (generic function)

Slot: lemma
Initargs

:lemma

Readers

token-lemma (generic function)

Writers

(setf token-lemma) (generic function)

Slot: upostag
Initargs

:upostag

Initform

"_"

Readers

token-upostag (generic function)

Writers

(setf token-upostag) (generic function)

Slot: xpostag
Initargs

:xpostag

Initform

"_"

Readers

token-xpostag (generic function)

Writers

(setf token-xpostag) (generic function)

Slot: feats
Initargs

:feats

Initform

"_"

Readers

token-feats (generic function)

Writers

(setf token-feats) (generic function)

Slot: head
Initargs

:head

Initform

"_"

Readers

token-head (generic function)

Writers

(setf token-head) (generic function)

Slot: deprel
Initargs

:deprel

Initform

"_"

Readers

token-deprel (generic function)

Writers

(setf token-deprel) (generic function)

Slot: deps
Initargs

:deps

Initform

"_"

Readers

token-deps (generic function)

Writers

(setf token-deps) (generic function)

Slot: misc
Initargs

:misc

Initform

"_"

Readers

token-misc (generic function)

Writers

(setf token-misc) (generic function)

Slot: sentence
Readers

token-sentence (generic function)

Writers

(setf token-sentence) (generic function)


Previous: , Up: Definitions   [Contents][Index]

5.2 Internal definitions


Next: , Previous: , Up: Internal definitions   [Contents][Index]

5.2.1 Special variables

Special Variable: *clauses*
Package

conllu.prolog

Source

conllu-prolog.lisp (file)

Special Variable: *dependencies*
Package

conllu.prolog

Source

conllu-prolog.lisp (file)

Special Variable: *deprel-value-list*

List of the 37 universal syntactic relations in UD.

Package

conllu.evaluate

Source

evaluate.lisp (file)

Special Variable: *deprels*
Package

cl-conllu

Source

query.lisp (file)

Special Variable: *token-fields*
Package

cl-conllu

Source

data.lisp (file)

Special Variable: *token-fields*
Package

conllu.evaluate

Source

evaluate.lisp (file)

Special Variable: niceline-matcher
Package

conllu.converters.niceline

Source

niceline.lisp (file)


Next: , Previous: , Up: Internal definitions   [Contents][Index]

5.2.2 Macros

Macro: error-test EXPRESSION
Package

conllu.editor

Source

editor.lisp (file)


Next: , Previous: , Up: Internal definitions   [Contents][Index]

5.2.3 Functions

Function: action EXPRESSION
Package

conllu.editor

Source

editor.lisp (file)

Function: actions ACTIONS
Package

conllu.editor

Source

editor.lisp (file)

Function: add-field-value TOKEN FIELD VALUE
Package

conllu.converters.niceline

Source

niceline.lisp (file)

Function: add-or-subt OP FIELD TOKEN VALUE
Package

conllu.editor

Source

editor.lisp (file)

Function: add-value FIELD NEW-VALUE TOKEN REST-CONDITIONS
Package

conllu.rules

Source

rules.lisp (file)

Function: adjust-conllu INPUT-FILENAME OUTPUT
Package

cl-conllu

Source

command-line.lisp (file)

Function: adopted-unfinished? LINES IDS
Package

conllu.draw

Source

draw.lisp (file)

Function: and% QUERY1 QUERY2 &key TKS
Package

cl-conllu

Source

query.lisp (file)

Function: apply-act RESULT-ACT
Package

conllu.editor

Source

editor.lisp (file)

Function: apply-changes TOKENS RULE
Package

conllu.rules

Source

rules.lisp (file)

Function: apply-conditions-in-token CONDITIONS TOKEN
Package

conllu.rules

Source

rules.lisp (file)

Function: apply-rhs BINDINGS RHS
Package

conllu.rules

Source

rules.lisp (file)

Function: apply-rule TOKENS SENT-ID RULE RULE-INDEX
Package

conllu.editor

Source

editor.lisp (file)

Function: apply-rule-in-sentence A-SENTENCE RULE SENT-ID
Package

conllu.rules

Source

rules.lisp (file)

Function: apply-rule-in-tokens TOKENS RULE SENT-ID &optional MATCHS
Package

conllu.rules

Source

rules.lisp (file)

Function: apply-rules TOKENS SENT-ID RULES ERRORS &optional INDEX ACUM-RECORDS
Package

conllu.editor

Source

editor.lisp (file)

Function: apply-rules-in-sentence A-SENTENCE RULES SENT-ID RECURSIVE &optional OLD-RULES-APPLIED
Package

conllu.rules

Source

rules.lisp (file)

Function: apply-rules-in-sentence-aux A-SENTENCE RULES SENT-ID &optional APPLIED?
Package

conllu.rules

Source

rules.lisp (file)

Function: assocs VALUE SETS FIELD TOKENS &optional IDS RESULT-TOKENS OLD-FIELDS
Package

conllu.editor

Source

editor.lisp (file)

Function: blank-line? LINE
Package

cl-conllu

Source

utils.lisp (file)

Function: children TKS ID
Package

cl-conllu

Source

query.lisp (file)

Function: clean-dep-rel STR
Package

conllu.prolog

Source

conllu-prolog.lisp (file)

Function: clean-whitespace LINE
Package

conllu.prolog

Source

conllu-prolog.lisp (file)

Function: clear STRING
Package

conllu.editor

Source

editor.lisp (file)

Function: collect-meta LINES
Package

cl-conllu

Source

read-write.lisp (file)

Function: components->string COMPONENTS
Package

conllu.rdf

Source

rdf.lisp (file)

Function: confusion-matrix-copy CM

Returns a new CONFUSION-MATRIX with the same cells values as CM.

Package

conllu.evaluate

Source

confusion-matrix.lisp (file)

Function: confusion-matrix-update-sentences SENT1 SENT2 CM

Updates an existing confusion matrix by a pair of matching sentences SENT1 and SENT2. That is, SENT1 and SENT2 should be alternative analyses of the same natural language sentence.

Package

conllu.evaluate

Source

confusion-matrix.lisp (file)

Function: confusion-matrix-update-tokens TOKEN1 TOKEN2 CM
Package

conllu.evaluate

Source

confusion-matrix.lisp (file)

Function: consume-tags TAGS TK
Package

conllu.converters.niceline

Source

niceline.lisp (file)

Function: convert-directory PATH
Package

conllu.converters.niceline

Source

niceline.lisp (file)

Function: convert-features-to-rdf FEATURES-STRING

Input: string
Output: list of feature nodes

Returns a list of nodes to be used as objects in triples with the predicate "conll:feats".

Examples:
(let ((wilbur:*nodes* (make-instance ’wilbur:dictionary))
(wilbur:*db* (make-instance ’wilbur:db)))
(wilbur:add-namespace "olia-sys" "http://purl.org/olia/system.owl#") (wilbur:add-namespace "conll" "http://br.ibm.com/conll/LEMMA") (convert-features-to-rdf "Mood=Ind|Tense=Past|VerbForm=Fin" (node "sentence1"))) =>
(!"http://br.ibm.com/conll/LEMMA#verbFormFin" !"http://br.ibm.com/conll/LEMMA#tensePast" !"http://br.ibm.com/conll/LEMMA#moodInd")

Package

conllu.rdf

Source

rdf-wilbur.lisp (file)

Function: convert-sentence-metadata METADATA SENTENCE-NODE

Input: list of pairs (name value), node
Output: List of triples

Example:
(let ((wilbur:*db* (make-instance ’wilbur:db))
(metadata ’(("sent_id" . "test")
("text" . "The US troops fired into the hostile crowd, killing 4.")))
(sentence-node (node "sentence")))
(convert-sentence-metadata metadata sentence-node))
=>
((#<WILBUR:TRIPLE !"sentence" !conll:metadata/sent_id #"test" {10048AA2E3}>)
(#<WILBUR:TRIPLE !"sentence" !conll:metadata/text #"The US troops fired into the hostile crowd, killing 4." {10048AA753}>))

Package

conllu.rdf

Source

rdf-wilbur.lisp (file)

Function: convert-sentence-to-rdf SENTENCE TEXT SENTENCE-ID CORPUS-ID-NODE
Package

conllu.rdf

Source

rdf-wilbur.lisp (file)

Function: convert-sentence-to-turtle STREAM CONLL TEXT ID
Package

conllu.rdf

Source

rdf.lisp (file)

Function: convert-token-to-rdf TOKEN SENTENCE-ID SENTENCE-NODE
Package

conllu.rdf

Source

rdf-wilbur.lisp (file)

Function: create-cell LABEL1 LABEL2 CM

Creates the cell for row LABEL1 and column LABEL2 in confusion matrix CM.

Package

conllu.evaluate

Source

confusion-matrix.lisp (file)

Function: def-match DEF
Package

conllu.editor

Source

editor.lisp (file)

Function: definitions DEFINITIONS &optional INDEX RESULT-DEFS
Package

conllu.editor

Source

editor.lisp (file)

Function: defs-tests TOKEN DEFS
Package

conllu.editor

Source

editor.lisp (file)

Function: emit-prolog CLAUSE TEXT
Package

conllu.prolog

Source

conllu-prolog.lisp (file)

Function: equal-op FIELD REGEX REST-PATTERN TOKEN
Package

conllu.rules

Source

rules.lisp (file)

Function: escape-string STRING CHAR-ESCAPE-FUNCTION
Package

conllu.rdf

Source

rdf.lisp (file)

Function: escape-turtle-char CHAR
Package

conllu.rdf

Source

rdf.lisp (file)

Function: eval-query EXPRESSION &key TKS
Package

cl-conllu

Source

query.lisp (file)

Function: exact-match-sentence SENT1 SENT2 &key COMPARED-FIELDS IDENTITY-FIELDS TEST SIMPLE-DEP IGNORE-PUNCT

Compares if two sentences are an exact match.

The typical use case is comparing the result of a tagger (or parser) against a test sentence.

Returns SENT1 if SENT1 and SENT2 agree for all tokens with respect to the COMPARED-FIELDS. Otherwise returns NIL.

If they do not have the same number of tokens or if the tokens do not agree on each IDENTITY-FIELD, then the sentences are not ’the same’ and thus an error is returned.

Package

conllu.evaluate

Source

evaluate.lisp (file)

Function: examine-acts FINAL-ACTS &optional NOT-FST
Package

conllu.editor

Source

editor.lisp (file)

Function: existing-cell-p LABEL1 LABEL2 CM

Predicate for verifying whether the cell for row LABEL1 and column LABEL2 already exist in the confusion matrix CM.

Package

conllu.evaluate

Source

confusion-matrix.lisp (file)

Function: find-min LIST &key MIN
Package

cl-conllu

Source

utils.lisp (file)

Function: get-data FIELDS TOKENS ID
Package

conllu.draw

Source

draw.lisp (file)

Function: get-field-value FIELD TOKEN
Package

conllu.editor

Source

editor.lisp (file)

Function: get-kids DAD TOKENS &optional STOCK? CHILD ADOPTED INFANT
Package

conllu.draw

Source

draw.lisp (file)

Function: get-stroke-size ADOPTED LINES
Package

conllu.draw

Source

draw.lisp (file)

Function: insert-at LST INDEX NEWELT
Package

cl-conllu

Source

utils.lisp (file)

Function: insert-entry-confusion-matrix LABEL1 LABEL2 TOKEN CM

Inserts TOKEN as an occurence in the cell LABEL1 LABEL2 of the confusion matrix CM.

Package

conllu.evaluate

Source

confusion-matrix.lisp (file)

Function: insert-token SENTENCE NEW-TOKEN

Inserts TOKEN in a SENTENCE object. It will not be inserted exactly as given: its ID will be the same (place where it’ll be inserted) but its head should point to id value prior to the insertion. Therefore, it will be modified. Its TOKEN-SENTENCE slot will be modified as well in order to point to SENTENCE. It changes the SENTENCE object passed.

Package

cl-conllu

Source

data.lisp (file)

Function: intern-pattern PATTERN
Package

conllu.rules

Source

rules.lisp (file)

Function: intern-rule RULE
Package

conllu.rules

Source

rules.lisp (file)

Function: intern-sides SIDES
Package

conllu.rules

Source

rules.lisp (file)

Function: is-descendant? ID-1 ID-2 SENTENCE &optional ALIST
Package

cl-conllu

Source

data.lisp (file)

Function: is-root STR
Package

conllu.prolog

Source

conllu-prolog.lisp (file)

Function: join-matchs DEFS-COUNT RELS-COUNT SETS
Package

conllu.editor

Source

editor.lisp (file)

Function: line->mtoken LINE
Package

cl-conllu

Source

read-write.lisp (file)

Function: line->token LINE
Package

cl-conllu

Source

read-write.lisp (file)

Function: list-to-tsv ALIST STREAM
Package

cl-conllu

Source

read-write.lisp (file)

Function: make-dep DEP
Package

conllu.rdf

Source

rdf.lisp (file)

Function: make-featurename FEAT
Package

conllu.rdf

Source

rdf.lisp (file)

Function: make-features FEATURES &optional VALUE-AS-LITERAL
Package

conllu.rdf

Source

rdf.lisp (file)

Function: make-features-bnode FEATURES &optional VALUE-AS-LITERAL
Package

conllu.rdf

Source

rdf.lisp (file)

Function: make-id CONTEXT PREFIX ID
Package

conllu.prolog

Source

conllu-prolog.lisp (file)

Function: make-literal STRING
Package

conllu.rdf

Source

rdf.lisp (file)

Function: make-metadata METADATA
Package

conllu.rdf

Source

rdf.lisp (file)

Function: make-metadata-bnode METADATA
Package

conllu.rdf

Source

rdf.lisp (file)

Function: make-token-id SENTENCE-ID TOKEN-ID
Package

conllu.rdf

Source

rdf.lisp (file)

Function: make-tree FIELDS TOKENS LINES BRANCHES
Package

conllu.draw

Source

draw.lisp (file)

Function: make-twigs DATA DAD CHILD ADOPTED LINES
Package

conllu.draw

Source

draw.lisp (file)

Function: make-upos UPOS
Package

conllu.rdf

Source

rdf.lisp (file)

Function: mappend FUNCTION LIST

Receives a function and a list of lists and returns the appended result of the aplication of the function to each list.

Package

cl-conllu

Source

utils.lisp (file)

Function: match-test VALUE CRITERION NEGATIVE? OP
Package

conllu.editor

Source

editor.lisp (file)

Function: match-token TOKEN PATTERN
Package

conllu.rules

Source

rules.lisp (file)

Function: match? TOKENS RLS &optional BINDINGS
Package

conllu.rules

Source

rules.lisp (file)

Function: member-op FIELD ELEMENT REST-PATTERN TOKEN
Package

conllu.rules

Source

rules.lisp (file)

Function: merge-matchs DEFS-COUNT RELS-COUNT BIN-1 BIN-2
Package

conllu.editor

Source

editor.lisp (file)

Function: merge-sets DEFS-COUNT RELS-COUNT SETS
Package

conllu.editor

Source

editor.lisp (file)

Function: modify-conllu ORIGINAL-FILE CHANGES-FILE OUTPUT &optional ADD-NEWS

The original file contains a set of sentences. The modified file contains some sentences from original modified, this function replaces in original the sentences presented in modified file, matching them using the sentence ids. If the modified file contains sentence not in original, the flag ’add-new’ , if true, says that these sentence must be added in the end of the original file.

Package

cl-conllu

Source

command-line.lisp (file)

Function: modify-value FIELD NEW-VALUE TOKEN REST-CONDITIONS
Package

conllu.rules

Source

rules.lisp (file)

Function: mtoken->tokens SENTENCE MTOKEN
Package

cl-conllu

Source

data.lisp (file)

Function: mtoken-equal MTOKEN-1 MTOKEN-2

Tests if, for each slot, mtoken-1 has the same values as mtoken-2.

Package

cl-conllu

Source

data.lisp (file)

Function: multiple-merges DEFS-COUNT RELS-COUNT BIN-1 BINS
Package

conllu.editor

Source

editor.lisp (file)

Function: niceline G4 &key START END END-TOKEN END-VALUE &aux G5 G0 G1 G2 G3
Package

conllu.converters.niceline

Source

niceline.lisp (file)

Function: node-matchs TOKENS DEFS &optional RESULT-NODES
Package

conllu.editor

Source

editor.lisp (file)

Function: normalize-shortcut EXPRESSION OP
Package

conllu.editor

Source

editor.lisp (file)

Function: or% QUERY1 QUERY2 &key TKS
Package

cl-conllu

Source

query.lisp (file)

Function: print-diff MATRIZ
Package

cl-conllu

Source

utils.lisp (file)

Function: process-features SENTENCE-ID WORD-INDEX-ID FEATS-STR
Package

conllu.prolog

Source

conllu-prolog.lisp (file)

Function: process-tokens CONTEXT SENTENCE-ID TOKEN
Package

conllu.prolog

Source

conllu-prolog.lisp (file)

Function: prolog-string STR &optional DOWNCASE
Package

conllu.prolog

Source

conllu-prolog.lisp (file)

Function: read-niceline LINE
Package

conllu.converters.niceline

Source

niceline.lisp (file)

Function: read-niceline-file FILENAME
Package

conllu.converters.niceline

Source

niceline.lisp (file)

Function: read-niceline-stream STREAM
Package

conllu.converters.niceline

Source

niceline.lisp (file)

Function: read-rules FILENAME
Package

conllu.rules

Source

rules.lisp (file)

Function: regex-op FIELD REGEX REST-PATTERN TOKEN
Package

conllu.rules

Source

rules.lisp (file)

Function: rel-match NODES REL REL-INDEX
Package

conllu.editor

Source

editor.lisp (file)

Function: relation RELATION
Package

conllu.editor

Source

editor.lisp (file)

Function: relation-test NEGATIVE? OP FIELD-1 FIELD-2
Package

conllu.editor

Source

editor.lisp (file)

Function: relations RELATIONS
Package

conllu.editor

Source

editor.lisp (file)

Function: remove-token SENTENCE ID

Remove the token with the given ID if it is not part of a multi-word token and it does not contain childs. It returns two values, the sentence (changed or not) and a boolean (nil if the sentence was not changed and true if changed. If the removed token is the root of the sentence, a new root must be provided.

Package

cl-conllu

Source

data.lisp (file)

Function: result-act SETS TOKENS ACT
Package

conllu.editor

Source

editor.lisp (file)

Function: result-acts SETS TOKENS ACTS &optional RESULT-ACTS
Package

conllu.editor

Source

editor.lisp (file)

Function: result-set TOKEN-1 TOKEN-2 DEF-1 DEF-2 REL-TEST REL-INDEX
Package

conllu.editor

Source

editor.lisp (file)

Function: result-sets REL-TEST REL-INDEX DEF-1 DEF-2 NODES-1 NODES-2
Package

conllu.editor

Source

editor.lisp (file)

Function: rhs RULE
Package

conllu.rules

Source

rules.lisp (file)

Function: rhs-vars RLS-VARS RHS
Package

conllu.rules

Source

rules.lisp (file)

Function: rls RULE
Package

conllu.rules

Source

rules.lisp (file)

Function: rls-vars RLS &optional VAR-LIST
Package

conllu.rules

Source

rules.lisp (file)

Function: r~ RELATION QUERY1 QUERY2 &key TKS
Package

cl-conllu

Source

query.lisp (file)

Function: select-sentence ID SENTENCES
Package

cl-conllu

Source

command-line.lisp (file)

Function: sentence-average-score LIST-SENT1 LIST-SENT2 &key FIELDS IGNORE-PUNCT SIMPLE-DEP

Score by sentence (macro-average).

This is the mean of the percentage of words in each sentence that are correct with respect to the fields in FIELDS.

We assume that LIST-SENT1 is the classified result
and LIST-SENT2 is the list of golden (correct) sentences.

If IGNORE-PUNCT, tokens which have ’PUNCT’ as upostag
in the golden sentences are ignored.

Package

conllu.evaluate

Source

evaluate.lisp (file)

Function: sentence-by-id ID FILENAME
Package

cl-conllu

Source

data.lisp (file)

Function: sentence-diff SENT1 SENT2 &key FIELDS TEST SIMPLE-DEP IGNORE-PUNCT

Returns a list of differences in SENT1 and SENT2.

They must have the same size.

If IGNORE-PUNCT, tokens which have ’PUNCT’ as upostag in sent2 are ignored.

Package

conllu.evaluate

Source

evaluate.lisp (file)

Function: sentence-matrix SENTENCE
Package

cl-conllu

Source

data.lisp (file)

Function: sentence-root SENTENCE
Package

cl-conllu

Source

data.lisp (file)

Function: set-head SENTENCE ID NEW-HEAD &optional DEPREL
Package

cl-conllu

Source

data.lisp (file)

Function: sets NODES RELS &optional REL-INDEX RESULT-SETS
Package

conllu.editor

Source

editor.lisp (file)

Function: test-feats&misc STRING-1 STRING-2
Package

conllu.editor

Source

editor.lisp (file)

Function: token-children TOKEN SENTENCE &key FN-FILTER
Package

cl-conllu

Source

data.lisp (file)

Function: token-diff TK1 TK2 &key FIELDS TEST SIMPLE-DEP
Package

conllu.evaluate

Source

evaluate.lisp (file)

Function: token-equal TK1 TK2 &key FIELDS TEST SIMPLE-DEP
Package

cl-conllu

Source

data.lisp (file)

Function: token-matchs DEF TOKENS
Package

conllu.editor

Source

editor.lisp (file)

Function: token-misc-value TOKEN MISC-KEY

Assume token’s MISC is a list of key-value pairs, return value corresponding to key MISC-KEY.

Package

cl-conllu

Source

data.lisp (file)

Function: token-parent TOKEN SENTENCE
Package

cl-conllu

Source

data.lisp (file)

Function: toprologid STR
Package

conllu.prolog

Source

conllu-prolog.lisp (file)

Function: t~ SLOT STRING &key TKS
Package

cl-conllu

Source

query.lisp (file)

Function: unspecified-field? C
Package

conllu.rdf

Source

rdf.lisp (file)

Function: update-lines ID TEXT LINES &optional SIZE CHAR
Package

conllu.draw

Source

draw.lisp (file)

Function: valid-line LINE
Package

conllu.prolog

Source

conllu-prolog.lisp (file)

Function: valid-vars RULE
Package

conllu.rules

Source

rules.lisp (file)

Function: variable-p X
Package

conllu.rules

Source

rules.lisp (file)

Function: word-average-score LIST-SENT1 LIST-SENT2 &key FIELDS IGNORE-PUNCT SIMPLE-DEP

Score by word (micro-average).

This is the total mean of words in all sentences that are correct with respect to the fields in FIELDS.

We assume that LIST-SENT1 is the classified result and LIST-SENT2 is the list of golden (correct) sentences.

If IGNORE-PUNCT, tokens which have ’PUNCT’ as upostag in the golden sentences are ignored.

Package

conllu.evaluate

Source

evaluate.lisp (file)

Function: write-columns-headers COLUMN-LABELS

Auxiliary function for format-html for confusion-matrix.

Package

conllu.html

Source

html.lisp (file)

Function: write-mtoken MTK STREAM
Package

cl-conllu

Source

read-write.lisp (file)

Function: write-prolog OUT
Package

conllu.prolog

Source

conllu-prolog.lisp (file)

Function: write-rows ROW-LABELS COLUMN-LABELS CM

Auxiliary function for format-html for the confusion-matrix CM.

Package

conllu.html

Source

html.lisp (file)

Function: write-selected-sentence FILENAME ID OUTPUT

Returns a sentence whose ’sent_id’ from the list of sentences in ’filename’.

Package

cl-conllu

Source

command-line.lisp (file)

Function: write-sentence SENTENCE STREAM
Package

cl-conllu

Source

read-write.lisp (file)

Function: write-token TK STREAM
Package

cl-conllu

Source

read-write.lisp (file)

Function: write-token-tag-suffix TOKEN STREAM FIELD-VALUE SEPARATOR
Package

conllu.converters.tags

Source

tag-converter.lisp (file)


Next: , Previous: , Up: Internal definitions   [Contents][Index]

5.2.4 Generic functions

Generic Function: confusion-matrix-key-fn OBJECT
Generic Function: (setf confusion-matrix-key-fn) NEW-VALUE OBJECT
Package

conllu.evaluate

Methods
Method: confusion-matrix-key-fn (CONFUSION-MATRIX confusion-matrix)
Method: (setf confusion-matrix-key-fn) NEW-VALUE (CONFUSION-MATRIX confusion-matrix)

Function used to label each token.

Source

confusion-matrix.lisp (file)

Generic Function: confusion-matrix-rows OBJECT
Generic Function: (setf confusion-matrix-rows) NEW-VALUE OBJECT
Package

conllu.evaluate

Methods
Method: confusion-matrix-rows (CONFUSION-MATRIX confusion-matrix)
Method: (setf confusion-matrix-rows) NEW-VALUE (CONFUSION-MATRIX confusion-matrix)

Parameter which contains the contents of the confusion matrix.

Source

confusion-matrix.lisp (file)

Generic Function: confusion-matrix-sort-fn OBJECT
Generic Function: (setf confusion-matrix-sort-fn) NEW-VALUE OBJECT
Package

conllu.evaluate

Methods
Method: confusion-matrix-sort-fn (CONFUSION-MATRIX confusion-matrix)
Method: (setf confusion-matrix-sort-fn) NEW-VALUE (CONFUSION-MATRIX confusion-matrix)

Function which sorts labels. By default,
converts labels to string and uses lexicographical order

Source

confusion-matrix.lisp (file)

Generic Function: confusion-matrix-test-fn OBJECT
Generic Function: (setf confusion-matrix-test-fn) NEW-VALUE OBJECT
Package

conllu.evaluate

Methods
Method: confusion-matrix-test-fn (CONFUSION-MATRIX confusion-matrix)
Method: (setf confusion-matrix-test-fn) NEW-VALUE (CONFUSION-MATRIX confusion-matrix)

Function which compares two labels. Typically a form of equality.

Source

confusion-matrix.lisp (file)

Generic Function: index CONDITION
Package

conllu.editor

Methods
Method: index (CONDITION malformed-rule)
Source

editor.lisp (file)

Generic Function: malformed-line CONDITION
Package

conllu.converters.niceline

Methods
Method: malformed-line (CONDITION malformed-line-error)
Source

niceline.lisp (file)

Generic Function: mtoken-misc OBJECT
Generic Function: (setf mtoken-misc) NEW-VALUE OBJECT
Package

cl-conllu

Methods
Method: mtoken-misc (MTOKEN mtoken)

automatically generated reader method

Source

data.lisp (file)

Method: (setf mtoken-misc) NEW-VALUE (MTOKEN mtoken)

automatically generated writer method

Source

data.lisp (file)


Previous: , Up: Internal definitions   [Contents][Index]

5.2.5 Conditions

Condition: malformed-line-error ()
Package

conllu.converters.niceline

Source

niceline.lisp (file)

Direct superclasses

error (condition)

Direct methods

malformed-line (method)

Direct slots
Slot: text
Initargs

:text

Readers

malformed-line (generic function)

Condition: malformed-rule ()
Package

conllu.editor

Source

editor.lisp (file)

Direct superclasses

error (condition)

Direct methods

index (method)

Direct slots
Slot: index
Initargs

:index

Readers

index (generic function)


Previous: , Up: Top   [Contents][Index]

Appendix A Indexes


Next: , Previous: , Up: Indexes   [Contents][Index]

A.1 Concepts

Jump to:   C   F   L  
Index Entry  Section

C
cl-conllu.asd: The cl-conllu․asd file
cl-conllu/command-line.lisp: The cl-conllu/command-line․lisp file
cl-conllu/confusion-matrix.lisp: The cl-conllu/confusion-matrix․lisp file
cl-conllu/conllu-prolog.lisp: The cl-conllu/conllu-prolog․lisp file
cl-conllu/data.lisp: The cl-conllu/data․lisp file
cl-conllu/draw.lisp: The cl-conllu/draw․lisp file
cl-conllu/editor.lisp: The cl-conllu/editor․lisp file
cl-conllu/evaluate.lisp: The cl-conllu/evaluate․lisp file
cl-conllu/html.lisp: The cl-conllu/html․lisp file
cl-conllu/niceline.lisp: The cl-conllu/niceline․lisp file
cl-conllu/packages.lisp: The cl-conllu/packages․lisp file
cl-conllu/query.lisp: The cl-conllu/query․lisp file
cl-conllu/rdf-wilbur.lisp: The cl-conllu/rdf-wilbur․lisp file
cl-conllu/rdf.lisp: The cl-conllu/rdf․lisp file
cl-conllu/read-write.lisp: The cl-conllu/read-write․lisp file
cl-conllu/rules.lisp: The cl-conllu/rules․lisp file
cl-conllu/tag-converter.lisp: The cl-conllu/tag-converter․lisp file
cl-conllu/utils.lisp: The cl-conllu/utils․lisp file

F
File, Lisp, cl-conllu.asd: The cl-conllu․asd file
File, Lisp, cl-conllu/command-line.lisp: The cl-conllu/command-line․lisp file
File, Lisp, cl-conllu/confusion-matrix.lisp: The cl-conllu/confusion-matrix․lisp file
File, Lisp, cl-conllu/conllu-prolog.lisp: The cl-conllu/conllu-prolog․lisp file
File, Lisp, cl-conllu/data.lisp: The cl-conllu/data․lisp file
File, Lisp, cl-conllu/draw.lisp: The cl-conllu/draw․lisp file
File, Lisp, cl-conllu/editor.lisp: The cl-conllu/editor․lisp file
File, Lisp, cl-conllu/evaluate.lisp: The cl-conllu/evaluate․lisp file
File, Lisp, cl-conllu/html.lisp: The cl-conllu/html․lisp file
File, Lisp, cl-conllu/niceline.lisp: The cl-conllu/niceline․lisp file
File, Lisp, cl-conllu/packages.lisp: The cl-conllu/packages․lisp file
File, Lisp, cl-conllu/query.lisp: The cl-conllu/query․lisp file
File, Lisp, cl-conllu/rdf-wilbur.lisp: The cl-conllu/rdf-wilbur․lisp file
File, Lisp, cl-conllu/rdf.lisp: The cl-conllu/rdf․lisp file
File, Lisp, cl-conllu/read-write.lisp: The cl-conllu/read-write․lisp file
File, Lisp, cl-conllu/rules.lisp: The cl-conllu/rules․lisp file
File, Lisp, cl-conllu/tag-converter.lisp: The cl-conllu/tag-converter․lisp file
File, Lisp, cl-conllu/utils.lisp: The cl-conllu/utils․lisp file

L
Lisp File, cl-conllu.asd: The cl-conllu․asd file
Lisp File, cl-conllu/command-line.lisp: The cl-conllu/command-line․lisp file
Lisp File, cl-conllu/confusion-matrix.lisp: The cl-conllu/confusion-matrix․lisp file
Lisp File, cl-conllu/conllu-prolog.lisp: The cl-conllu/conllu-prolog․lisp file
Lisp File, cl-conllu/data.lisp: The cl-conllu/data․lisp file
Lisp File, cl-conllu/draw.lisp: The cl-conllu/draw․lisp file
Lisp File, cl-conllu/editor.lisp: The cl-conllu/editor․lisp file
Lisp File, cl-conllu/evaluate.lisp: The cl-conllu/evaluate․lisp file
Lisp File, cl-conllu/html.lisp: The cl-conllu/html․lisp file
Lisp File, cl-conllu/niceline.lisp: The cl-conllu/niceline․lisp file
Lisp File, cl-conllu/packages.lisp: The cl-conllu/packages․lisp file
Lisp File, cl-conllu/query.lisp: The cl-conllu/query․lisp file
Lisp File, cl-conllu/rdf-wilbur.lisp: The cl-conllu/rdf-wilbur․lisp file
Lisp File, cl-conllu/rdf.lisp: The cl-conllu/rdf․lisp file
Lisp File, cl-conllu/read-write.lisp: The cl-conllu/read-write․lisp file
Lisp File, cl-conllu/rules.lisp: The cl-conllu/rules․lisp file
Lisp File, cl-conllu/tag-converter.lisp: The cl-conllu/tag-converter․lisp file
Lisp File, cl-conllu/utils.lisp: The cl-conllu/utils․lisp file

Jump to:   C   F   L  

Next: , Previous: , Up: Indexes   [Contents][Index]

A.2 Functions

Jump to:   (  
A   B   C   D   E   F   G   I   J   L   M   N   O   P   Q   R   S   T   U   V   W  
Index Entry  Section

(
(setf confusion-matrix-corpus-id): Exported generic functions
(setf confusion-matrix-corpus-id): Exported generic functions
(setf confusion-matrix-key-fn): Internal generic functions
(setf confusion-matrix-key-fn): Internal generic functions
(setf confusion-matrix-rows): Internal generic functions
(setf confusion-matrix-rows): Internal generic functions
(setf confusion-matrix-sort-fn): Internal generic functions
(setf confusion-matrix-sort-fn): Internal generic functions
(setf confusion-matrix-test-fn): Internal generic functions
(setf confusion-matrix-test-fn): Internal generic functions
(setf mtoken-end): Exported generic functions
(setf mtoken-end): Exported generic functions
(setf mtoken-form): Exported generic functions
(setf mtoken-form): Exported generic functions
(setf mtoken-misc): Internal generic functions
(setf mtoken-misc): Internal generic functions
(setf mtoken-start): Exported generic functions
(setf mtoken-start): Exported generic functions
(setf sentence-meta): Exported generic functions
(setf sentence-meta): Exported generic functions
(setf sentence-mtokens): Exported generic functions
(setf sentence-mtokens): Exported generic functions
(setf sentence-start): Exported generic functions
(setf sentence-start): Exported generic functions
(setf sentence-tokens): Exported generic functions
(setf sentence-tokens): Exported generic functions
(setf token-deprel): Exported generic functions
(setf token-deprel): Exported generic functions
(setf token-deps): Exported generic functions
(setf token-deps): Exported generic functions
(setf token-feats): Exported generic functions
(setf token-feats): Exported generic functions
(setf token-form): Exported generic functions
(setf token-form): Exported generic functions
(setf token-head): Exported generic functions
(setf token-head): Exported generic functions
(setf token-id): Exported generic functions
(setf token-id): Exported generic functions
(setf token-lemma): Exported generic functions
(setf token-lemma): Exported generic functions
(setf token-misc): Exported generic functions
(setf token-misc): Exported generic functions
(setf token-sentence): Exported generic functions
(setf token-sentence): Exported generic functions
(setf token-upostag): Exported generic functions
(setf token-upostag): Exported generic functions
(setf token-xpostag): Exported generic functions
(setf token-xpostag): Exported generic functions

A
action: Internal functions
actions: Internal functions
add-field-value: Internal functions
add-or-subt: Internal functions
add-value: Internal functions
adjust-conllu: Internal functions
adjust-sentence: Exported functions
adopted-unfinished?: Internal functions
and%: Internal functions
apply-act: Internal functions
apply-changes: Internal functions
apply-conditions-in-token: Internal functions
apply-rhs: Internal functions
apply-rule: Internal functions
apply-rule-in-sentence: Internal functions
apply-rule-in-tokens: Internal functions
apply-rules: Exported functions
apply-rules: Internal functions
apply-rules-from-files: Exported functions
apply-rules-in-sentence: Internal functions
apply-rules-in-sentence-aux: Internal functions
assocs: Internal functions
attachment-score-by-sentence: Exported functions
attachment-score-by-word: Exported functions

B
blank-line?: Internal functions

C
children: Internal functions
clean-dep-rel: Internal functions
clean-whitespace: Internal functions
clear: Internal functions
collect-meta: Internal functions
components->string: Internal functions
confusion-matrix-cell-count: Exported functions
confusion-matrix-cell-tokens: Exported functions
confusion-matrix-cells-labels: Exported functions
confusion-matrix-columns-labels: Exported functions
confusion-matrix-copy: Internal functions
confusion-matrix-corpus-id: Exported generic functions
confusion-matrix-corpus-id: Exported generic functions
confusion-matrix-key-fn: Internal generic functions
confusion-matrix-key-fn: Internal generic functions
confusion-matrix-labels: Exported functions
confusion-matrix-normalize: Exported functions
confusion-matrix-rows: Internal generic functions
confusion-matrix-rows: Internal generic functions
confusion-matrix-rows-labels: Exported functions
confusion-matrix-sort-fn: Internal generic functions
confusion-matrix-sort-fn: Internal generic functions
confusion-matrix-test-fn: Internal generic functions
confusion-matrix-test-fn: Internal generic functions
confusion-matrix-update: Exported functions
confusion-matrix-update-sentences: Internal functions
confusion-matrix-update-tokens: Internal functions
conlluedit: Exported functions
consume-tags: Internal functions
convert-directory: Internal functions
convert-features-to-rdf: Internal functions
convert-filename: Exported functions
convert-rdf: Exported functions
convert-rdf-file: Exported functions
convert-sentence-metadata: Internal functions
convert-sentence-to-rdf: Internal functions
convert-sentence-to-turtle: Internal functions
convert-to-rdf: Exported functions
convert-token-to-rdf: Internal functions
create-cell: Internal functions

D
def-match: Internal functions
definitions: Internal functions
defs-tests: Internal functions
diff: Exported functions

E
emit-prolog: Internal functions
equal-op: Internal functions
error-test: Internal macros
escape-string: Internal functions
escape-turtle-char: Internal functions
eval-query: Internal functions
exact-match: Exported functions
exact-match-score: Exported functions
exact-match-sentence: Internal functions
examine-acts: Internal functions
existing-cell-p: Internal functions

F
find-min: Internal functions
format-html: Exported generic functions
format-html: Exported generic functions
Function, action: Internal functions
Function, actions: Internal functions
Function, add-field-value: Internal functions
Function, add-or-subt: Internal functions
Function, add-value: Internal functions
Function, adjust-conllu: Internal functions
Function, adjust-sentence: Exported functions
Function, adopted-unfinished?: Internal functions
Function, and%: Internal functions
Function, apply-act: Internal functions
Function, apply-changes: Internal functions
Function, apply-conditions-in-token: Internal functions
Function, apply-rhs: Internal functions
Function, apply-rule: Internal functions
Function, apply-rule-in-sentence: Internal functions
Function, apply-rule-in-tokens: Internal functions
Function, apply-rules: Exported functions
Function, apply-rules: Internal functions
Function, apply-rules-from-files: Exported functions
Function, apply-rules-in-sentence: Internal functions
Function, apply-rules-in-sentence-aux: Internal functions
Function, assocs: Internal functions
Function, attachment-score-by-sentence: Exported functions
Function, attachment-score-by-word: Exported functions
Function, blank-line?: Internal functions
Function, children: Internal functions
Function, clean-dep-rel: Internal functions
Function, clean-whitespace: Internal functions
Function, clear: Internal functions
Function, collect-meta: Internal functions
Function, components->string: Internal functions
Function, confusion-matrix-cell-count: Exported functions
Function, confusion-matrix-cell-tokens: Exported functions
Function, confusion-matrix-cells-labels: Exported functions
Function, confusion-matrix-columns-labels: Exported functions
Function, confusion-matrix-copy: Internal functions
Function, confusion-matrix-labels: Exported functions
Function, confusion-matrix-normalize: Exported functions
Function, confusion-matrix-rows-labels: Exported functions
Function, confusion-matrix-update: Exported functions
Function, confusion-matrix-update-sentences: Internal functions
Function, confusion-matrix-update-tokens: Internal functions
Function, conlluedit: Exported functions
Function, consume-tags: Internal functions
Function, convert-directory: Internal functions
Function, convert-features-to-rdf: Internal functions
Function, convert-filename: Exported functions
Function, convert-rdf: Exported functions
Function, convert-rdf-file: Exported functions
Function, convert-sentence-metadata: Internal functions
Function, convert-sentence-to-rdf: Internal functions
Function, convert-sentence-to-turtle: Internal functions
Function, convert-to-rdf: Exported functions
Function, convert-token-to-rdf: Internal functions
Function, create-cell: Internal functions
Function, def-match: Internal functions
Function, definitions: Internal functions
Function, defs-tests: Internal functions
Function, diff: Exported functions
Function, emit-prolog: Internal functions
Function, equal-op: Internal functions
Function, escape-string: Internal functions
Function, escape-turtle-char: Internal functions
Function, eval-query: Internal functions
Function, exact-match: Exported functions
Function, exact-match-score: Exported functions
Function, exact-match-sentence: Internal functions
Function, examine-acts: Internal functions
Function, existing-cell-p: Internal functions
Function, find-min: Internal functions
Function, get-data: Internal functions
Function, get-field-value: Internal functions
Function, get-kids: Internal functions
Function, get-stroke-size: Internal functions
Function, insert-at: Internal functions
Function, insert-entry-confusion-matrix: Internal functions
Function, insert-token: Internal functions
Function, intern-pattern: Internal functions
Function, intern-rule: Internal functions
Function, intern-sides: Internal functions
Function, is-descendant?: Internal functions
Function, is-root: Internal functions
Function, join-matchs: Internal functions
Function, lazy-stream-reader: Exported functions
Function, levenshtein: Exported functions
Function, line->mtoken: Internal functions
Function, line->token: Internal functions
Function, list-to-tsv: Internal functions
Function, make-confusion-matrix: Exported functions
Function, make-dep: Internal functions
Function, make-featurename: Internal functions
Function, make-features: Internal functions
Function, make-features-bnode: Internal functions
Function, make-id: Internal functions
Function, make-literal: Internal functions
Function, make-metadata: Internal functions
Function, make-metadata-bnode: Internal functions
Function, make-sentence: Exported functions
Function, make-token-id: Internal functions
Function, make-tree: Internal functions
Function, make-twigs: Internal functions
Function, make-upos: Internal functions
Function, mappend: Internal functions
Function, match-test: Internal functions
Function, match-token: Internal functions
Function, match?: Internal functions
Function, member-op: Internal functions
Function, merge-matchs: Internal functions
Function, merge-sets: Internal functions
Function, modify-conllu: Internal functions
Function, modify-value: Internal functions
Function, mtoken->tokens: Internal functions
Function, mtoken-equal: Internal functions
Function, multiple-merges: Internal functions
Function, niceline: Internal functions
Function, node-matchs: Internal functions
Function, non-projective?: Exported functions
Function, non-projectivity-accuracy: Exported functions
Function, non-projectivity-precision: Exported functions
Function, non-projectivity-recall: Exported functions
Function, normalize-shortcut: Internal functions
Function, or%: Internal functions
Function, precision: Exported functions
Function, print-diff: Internal functions
Function, process-features: Internal functions
Function, process-tokens: Internal functions
Function, prolog-string: Internal functions
Function, query: Exported functions
Function, query-as-json: Exported functions
Function, read-conllu: Exported functions
Function, read-directory: Exported functions
Function, read-file: Exported functions
Function, read-file-tag-suffix: Exported functions
Function, read-niceline: Internal functions
Function, read-niceline-file: Internal functions
Function, read-niceline-stream: Internal functions
Function, read-rules: Internal functions
Function, read-sentence-tag-suffix: Exported functions
Function, read-stream: Exported functions
Function, recall: Exported functions
Function, regex-op: Internal functions
Function, rel-match: Internal functions
Function, relation: Internal functions
Function, relation-test: Internal functions
Function, relations: Internal functions
Function, remove-token: Internal functions
Function, result-act: Internal functions
Function, result-acts: Internal functions
Function, result-set: Internal functions
Function, result-sets: Internal functions
Function, rhs: Internal functions
Function, rhs-vars: Internal functions
Function, rls: Internal functions
Function, rls-vars: Internal functions
Function, r~: Internal functions
Function, select-sentence: Internal functions
Function, sentence->text: Exported functions
Function, sentence-average-score: Internal functions
Function, sentence-binary-tree: Exported functions
Function, sentence-by-id: Internal functions
Function, sentence-diff: Internal functions
Function, sentence-equal: Exported functions
Function, sentence-hash-table: Exported functions
Function, sentence-id: Exported functions
Function, sentence-matrix: Internal functions
Function, sentence-meta-value: Exported functions
Function, sentence-root: Internal functions
Function, sentence-size: Exported functions
Function, sentence-text: Exported functions
Function, sentence-valid?: Exported functions
Function, set-head: Internal functions
Function, sets: Internal functions
Function, simple-deprel: Exported functions
Function, test-feats&misc: Internal functions
Function, token-children: Internal functions
Function, token-diff: Internal functions
Function, token-equal: Internal functions
Function, token-matchs: Internal functions
Function, token-misc-value: Internal functions
Function, token-parent: Internal functions
Function, toprologid: Internal functions
Function, tree-sentence: Exported functions
Function, t~: Internal functions
Function, unspecified-field?: Internal functions
Function, update-lines: Internal functions
Function, valid-line: Internal functions
Function, valid-vars: Internal functions
Function, variable-p: Internal functions
Function, word-average-score: Internal functions
Function, write-columns-headers: Internal functions
Function, write-conllu: Exported functions
Function, write-conllu-to-stream: Exported functions
Function, write-mtoken: Internal functions
Function, write-prolog: Internal functions
Function, write-rows: Internal functions
Function, write-selected-sentence: Internal functions
Function, write-sentence: Internal functions
Function, write-sentence-tag-suffix-to-stream: Exported functions
Function, write-sentences-tag-suffix: Exported functions
Function, write-sentences-tag-suffix-to-stream: Exported functions
Function, write-token: Internal functions
Function, write-token-tag-suffix: Internal functions

G
Generic Function, (setf confusion-matrix-corpus-id): Exported generic functions
Generic Function, (setf confusion-matrix-key-fn): Internal generic functions
Generic Function, (setf confusion-matrix-rows): Internal generic functions
Generic Function, (setf confusion-matrix-sort-fn): Internal generic functions
Generic Function, (setf confusion-matrix-test-fn): Internal generic functions
Generic Function, (setf mtoken-end): Exported generic functions
Generic Function, (setf mtoken-form): Exported generic functions
Generic Function, (setf mtoken-misc): Internal generic functions
Generic Function, (setf mtoken-start): Exported generic functions
Generic Function, (setf sentence-meta): Exported generic functions
Generic Function, (setf sentence-mtokens): Exported generic functions
Generic Function, (setf sentence-start): Exported generic functions
Generic Function, (setf sentence-tokens): Exported generic functions
Generic Function, (setf token-deprel): Exported generic functions
Generic Function, (setf token-deps): Exported generic functions
Generic Function, (setf token-feats): Exported generic functions
Generic Function, (setf token-form): Exported generic functions
Generic Function, (setf token-head): Exported generic functions
Generic Function, (setf token-id): Exported generic functions
Generic Function, (setf token-lemma): Exported generic functions
Generic Function, (setf token-misc): Exported generic functions
Generic Function, (setf token-sentence): Exported generic functions
Generic Function, (setf token-upostag): Exported generic functions
Generic Function, (setf token-xpostag): Exported generic functions
Generic Function, confusion-matrix-corpus-id: Exported generic functions
Generic Function, confusion-matrix-key-fn: Internal generic functions
Generic Function, confusion-matrix-rows: Internal generic functions
Generic Function, confusion-matrix-sort-fn: Internal generic functions
Generic Function, confusion-matrix-test-fn: Internal generic functions
Generic Function, format-html: Exported generic functions
Generic Function, index: Internal generic functions
Generic Function, malformed-line: Internal generic functions
Generic Function, mtoken-end: Exported generic functions
Generic Function, mtoken-form: Exported generic functions
Generic Function, mtoken-misc: Internal generic functions
Generic Function, mtoken-start: Exported generic functions
Generic Function, sentence-meta: Exported generic functions
Generic Function, sentence-mtokens: Exported generic functions
Generic Function, sentence-start: Exported generic functions
Generic Function, sentence-tokens: Exported generic functions
Generic Function, token-deprel: Exported generic functions
Generic Function, token-deps: Exported generic functions
Generic Function, token-feats: Exported generic functions
Generic Function, token-form: Exported generic functions
Generic Function, token-head: Exported generic functions
Generic Function, token-id: Exported generic functions
Generic Function, token-lemma: Exported generic functions
Generic Function, token-misc: Exported generic functions
Generic Function, token-sentence: Exported generic functions
Generic Function, token-upostag: Exported generic functions
Generic Function, token-xpostag: Exported generic functions
get-data: Internal functions
get-field-value: Internal functions
get-kids: Internal functions
get-stroke-size: Internal functions

I
index: Internal generic functions
index: Internal generic functions
insert-at: Internal functions
insert-entry-confusion-matrix: Internal functions
insert-token: Internal functions
intern-pattern: Internal functions
intern-rule: Internal functions
intern-sides: Internal functions
is-descendant?: Internal functions
is-root: Internal functions

J
join-matchs: Internal functions

L
lazy-stream-reader: Exported functions
levenshtein: Exported functions
line->mtoken: Internal functions
line->token: Internal functions
list-to-tsv: Internal functions

M
Macro, error-test: Internal macros
make-confusion-matrix: Exported functions
make-dep: Internal functions
make-featurename: Internal functions
make-features: Internal functions
make-features-bnode: Internal functions
make-id: Internal functions
make-literal: Internal functions
make-metadata: Internal functions
make-metadata-bnode: Internal functions
make-sentence: Exported functions
make-token-id: Internal functions
make-tree: Internal functions
make-twigs: Internal functions
make-upos: Internal functions
malformed-line: Internal generic functions
malformed-line: Internal generic functions
mappend: Internal functions
match-test: Internal functions
match-token: Internal functions
match?: Internal functions
member-op: Internal functions
merge-matchs: Internal functions
merge-sets: Internal functions
Method, (setf confusion-matrix-corpus-id): Exported generic functions
Method, (setf confusion-matrix-key-fn): Internal generic functions
Method, (setf confusion-matrix-rows): Internal generic functions
Method, (setf confusion-matrix-sort-fn): Internal generic functions
Method, (setf confusion-matrix-test-fn): Internal generic functions
Method, (setf mtoken-end): Exported generic functions
Method, (setf mtoken-form): Exported generic functions
Method, (setf mtoken-misc): Internal generic functions
Method, (setf mtoken-start): Exported generic functions
Method, (setf sentence-meta): Exported generic functions
Method, (setf sentence-mtokens): Exported generic functions
Method, (setf sentence-start): Exported generic functions
Method, (setf sentence-tokens): Exported generic functions
Method, (setf token-deprel): Exported generic functions
Method, (setf token-deps): Exported generic functions
Method, (setf token-feats): Exported generic functions
Method, (setf token-form): Exported generic functions
Method, (setf token-head): Exported generic functions
Method, (setf token-id): Exported generic functions
Method, (setf token-lemma): Exported generic functions
Method, (setf token-misc): Exported generic functions
Method, (setf token-sentence): Exported generic functions
Method, (setf token-upostag): Exported generic functions
Method, (setf token-xpostag): Exported generic functions
Method, confusion-matrix-corpus-id: Exported generic functions
Method, confusion-matrix-key-fn: Internal generic functions
Method, confusion-matrix-rows: Internal generic functions
Method, confusion-matrix-sort-fn: Internal generic functions
Method, confusion-matrix-test-fn: Internal generic functions
Method, format-html: Exported generic functions
Method, index: Internal generic functions
Method, malformed-line: Internal generic functions
Method, mtoken-end: Exported generic functions
Method, mtoken-form: Exported generic functions
Method, mtoken-misc: Internal generic functions
Method, mtoken-start: Exported generic functions
Method, sentence-meta: Exported generic functions
Method, sentence-mtokens: Exported generic functions
Method, sentence-start: Exported generic functions
Method, sentence-tokens: Exported generic functions
Method, token-deprel: Exported generic functions
Method, token-deps: Exported generic functions
Method, token-feats: Exported generic functions
Method, token-form: Exported generic functions
Method, token-head: Exported generic functions
Method, token-id: Exported generic functions
Method, token-lemma: Exported generic functions
Method, token-misc: Exported generic functions
Method, token-sentence: Exported generic functions
Method, token-upostag: Exported generic functions
Method, token-xpostag: Exported generic functions
modify-conllu: Internal functions
modify-value: Internal functions
mtoken->tokens: Internal functions
mtoken-end: Exported generic functions
mtoken-end: Exported generic functions
mtoken-equal: Internal functions
mtoken-form: Exported generic functions
mtoken-form: Exported generic functions
mtoken-misc: Internal generic functions
mtoken-misc: Internal generic functions
mtoken-start: Exported generic functions
mtoken-start: Exported generic functions
multiple-merges: Internal functions

N
niceline: Internal functions
node-matchs: Internal functions
non-projective?: Exported functions
non-projectivity-accuracy: Exported functions
non-projectivity-precision: Exported functions
non-projectivity-recall: Exported functions
normalize-shortcut: Internal functions

O
or%: Internal functions

P
precision: Exported functions
print-diff: Internal functions
process-features: Internal functions
process-tokens: Internal functions
prolog-string: Internal functions

Q
query: Exported functions
query-as-json: Exported functions

R
read-conllu: Exported functions
read-directory: Exported functions
read-file: Exported functions
read-file-tag-suffix: Exported functions
read-niceline: Internal functions
read-niceline-file: Internal functions
read-niceline-stream: Internal functions
read-rules: Internal functions
read-sentence-tag-suffix: Exported functions
read-stream: Exported functions
recall: Exported functions
regex-op: Internal functions
rel-match: Internal functions
relation: Internal functions
relation-test: Internal functions
relations: Internal functions
remove-token: Internal functions
result-act: Internal functions
result-acts: Internal functions
result-set: Internal functions
result-sets: Internal functions
rhs: Internal functions
rhs-vars: Internal functions
rls: Internal functions
rls-vars: Internal functions
r~: Internal functions

S
select-sentence: Internal functions
sentence->text: Exported functions
sentence-average-score: Internal functions
sentence-binary-tree: Exported functions
sentence-by-id: Internal functions
sentence-diff: Internal functions
sentence-equal: Exported functions
sentence-hash-table: Exported functions
sentence-id: Exported functions
sentence-matrix: Internal functions
sentence-meta: Exported generic functions
sentence-meta: Exported generic functions
sentence-meta-value: Exported functions
sentence-mtokens: Exported generic functions
sentence-mtokens: Exported generic functions
sentence-root: Internal functions
sentence-size: Exported functions
sentence-start: Exported generic functions
sentence-start: Exported generic functions
sentence-text: Exported functions
sentence-tokens: Exported generic functions
sentence-tokens: Exported generic functions
sentence-valid?: Exported functions
set-head: Internal functions
sets: Internal functions
simple-deprel: Exported functions

T
test-feats&misc: Internal functions
token-children: Internal functions
token-deprel: Exported generic functions
token-deprel: Exported generic functions
token-deps: Exported generic functions
token-deps: Exported generic functions
token-diff: Internal functions
token-equal: Internal functions
token-feats: Exported generic functions
token-feats: Exported generic functions
token-form: Exported generic functions
token-form: Exported generic functions
token-head: Exported generic functions
token-head: Exported generic functions
token-id: Exported generic functions
token-id: Exported generic functions
token-lemma: Exported generic functions
token-lemma: Exported generic functions
token-matchs: Internal functions
token-misc: Exported generic functions
token-misc: Exported generic functions
token-misc-value: Internal functions
token-parent: Internal functions
token-sentence: Exported generic functions
token-sentence: Exported generic functions
token-upostag: Exported generic functions
token-upostag: Exported generic functions
token-xpostag: Exported generic functions
token-xpostag: Exported generic functions
toprologid: Internal functions
tree-sentence: Exported functions
t~: Internal functions

U
unspecified-field?: Internal functions
update-lines: Internal functions

V
valid-line: Internal functions
valid-vars: Internal functions
variable-p: Internal functions

W
word-average-score: Internal functions
write-columns-headers: Internal functions
write-conllu: Exported functions
write-conllu-to-stream: Exported functions
write-mtoken: Internal functions
write-prolog: Internal functions
write-rows: Internal functions
write-selected-sentence: Internal functions
write-sentence: Internal functions
write-sentence-tag-suffix-to-stream: Exported functions
write-sentences-tag-suffix: Exported functions
write-sentences-tag-suffix-to-stream: Exported functions
write-token: Internal functions
write-token-tag-suffix: Internal functions

Jump to:   (  
A   B   C   D   E   F   G   I   J   L   M   N   O   P   Q   R   S   T   U   V   W  

Next: , Previous: , Up: Indexes   [Contents][Index]

A.3 Variables

Jump to:   *  
C   D   E   F   H   I   K   L   M   N   R   S   T   U   X  
Index Entry  Section

*
*clauses*: Internal special variables
*confusion-matrix-style*: Exported special variables
*dependencies*: Internal special variables
*deprel-value-list*: Internal special variables
*deprels*: Internal special variables
*token-fields*: Internal special variables
*token-fields*: Internal special variables

C
corpus-id: Exported classes

D
deprel: Exported classes
deps: Exported classes

E
end: Exported classes

F
feats: Exported classes
form: Exported classes
form: Exported classes

H
head: Exported classes

I
id: Exported classes
index: Internal conditions

K
key-fn: Exported classes

L
lemma: Exported classes

M
meta: Exported classes
misc: Exported classes
misc: Exported classes
mtokens: Exported classes

N
niceline-matcher: Internal special variables

R
rows: Exported classes

S
sentence: Exported classes
Slot, corpus-id: Exported classes
Slot, deprel: Exported classes
Slot, deps: Exported classes
Slot, end: Exported classes
Slot, feats: Exported classes
Slot, form: Exported classes
Slot, form: Exported classes
Slot, head: Exported classes
Slot, id: Exported classes
Slot, index: Internal conditions
Slot, key-fn: Exported classes
Slot, lemma: Exported classes
Slot, meta: Exported classes
Slot, misc: Exported classes
Slot, misc: Exported classes
Slot, mtokens: Exported classes
Slot, rows: Exported classes
Slot, sentence: Exported classes
Slot, sort-fn: Exported classes
Slot, start: Exported classes
Slot, start: Exported classes
Slot, test-fn: Exported classes
Slot, text: Internal conditions
Slot, tokens: Exported classes
Slot, upostag: Exported classes
Slot, xpostag: Exported classes
sort-fn: Exported classes
Special Variable, *clauses*: Internal special variables
Special Variable, *confusion-matrix-style*: Exported special variables
Special Variable, *dependencies*: Internal special variables
Special Variable, *deprel-value-list*: Internal special variables
Special Variable, *deprels*: Internal special variables
Special Variable, *token-fields*: Internal special variables
Special Variable, *token-fields*: Internal special variables
Special Variable, niceline-matcher: Internal special variables
start: Exported classes
start: Exported classes

T
test-fn: Exported classes
text: Internal conditions
tokens: Exported classes

U
upostag: Exported classes

X
xpostag: Exported classes

Jump to:   *  
C   D   E   F   H   I   K   L   M   N   R   S   T   U   X  

Previous: , Up: Indexes   [Contents][Index]

A.4 Data types

Jump to:   C   M   P   S   T  
Index Entry  Section

C
cl-conllu: The cl-conllu system
cl-conllu: The cl-conllu package
Class, confusion-matrix: Exported classes
Class, mtoken: Exported classes
Class, sentence: Exported classes
Class, token: Exported classes
Condition, malformed-line-error: Internal conditions
Condition, malformed-rule: Internal conditions
confusion-matrix: Exported classes
conllu.converters.niceline: The conllu․converters․niceline package
conllu.converters.tags: The conllu․converters․tags package
conllu.draw: The conllu․draw package
conllu.editor: The conllu․editor package
conllu.evaluate: The conllu․evaluate package
conllu.html: The conllu․html package
conllu.prolog: The conllu․prolog package
conllu.rdf: The conllu․rdf package
conllu.rules: The conllu․rules package

M
malformed-line-error: Internal conditions
malformed-rule: Internal conditions
mtoken: Exported classes

P
Package, cl-conllu: The cl-conllu package
Package, conllu.converters.niceline: The conllu․converters․niceline package
Package, conllu.converters.tags: The conllu․converters․tags package
Package, conllu.draw: The conllu․draw package
Package, conllu.editor: The conllu․editor package
Package, conllu.evaluate: The conllu․evaluate package
Package, conllu.html: The conllu․html package
Package, conllu.prolog: The conllu․prolog package
Package, conllu.rdf: The conllu․rdf package
Package, conllu.rules: The conllu․rules package

S
sentence: Exported classes
System, cl-conllu: The cl-conllu system

T
token: Exported classes

Jump to:   C   M   P   S   T