The cl-conllu Reference Manual

Table of Contents

Next: , Previous: , Up: (dir)   [Contents][Index]

The cl-conllu Reference Manual

This is the cl-conllu Reference Manual, version 0.3, generated automatically by Declt version 2.4 "Will Decker" on Wed Jun 20 11:02:10 2018 GMT+0.


Next: , Previous: , Up: Top   [Contents][Index]

1 Introduction

#+title: Library for working with CoNLL-U files with CL

The =cl-conllu= is a Common Lisp library to work with [[http://universaldependencies.org/format.html][CoNLL-U]],
licensed under the [[http://www.apache.org/licenses/LICENSE-2.0][Apache license]].

It is developed and tested with SBCL but should probably run with any
other implementation.

* Quicklisp

If don't have quicklisp installed already, follow [[https://www.quicklisp.org/beta/#installation][these steps]].

The =cl-conllu= library is now available from quicklisp distribution,
if you are not planning to change the code, just use:

#+BEGIN_SRC lisp
(ql:quickload :cl-conllu)
#+END_SRC

If you plan on contributing, clone this project to your
=local-projects= quicklisp directory (usually at
=~/quicklisp/local-projects/=) and use the same command as above.

* Reading CoNLL-U files

First you need some CoNLL-U files to start with. If you have none in
mind, you may get some from [[https://github.com/own-pt/bosque-UD/tree/master/documents][here]].

The simplest way to read a file or a directory of =conllu= files is:

#+BEGIN_SRC lisp
CL-USER> (defparameter *sents* (cl-conllu:read-conllu #P"/path/to/my/file/CF1.conllu"))
(# #
 # #
 # #
 #)
#+END_SRC

Each object returned is an instance of a =sentence= class, made up of
=token= objects, which we will describe in the next section.

All read functions accept a =fn-meta= function as argument. This
function collects the metadata from each CoNLL-U sentence, which
usually includes the raw sentence (see [[http://universaldependencies.org/format.html][format]]). The default metadata
collector function is =collect-meta=.

* The Classes

=cl-conllu= has a few central classes: =sentence=, =token=, and
=mtoken=. They are all defined in =data.lisp= file.  When a CoNLL-U
file is read, its contents are turned into instances of these classes.

** Sentences

Every CoNLL-U sentence is turned in an instance of the =sentence=
class by =cl-conllu=. Each instance is characterized by four
properties: =start=, =meta=, =tokens=, and =mtokens=. The =start=
field contains the line number of the file where the sentence block
started.

The =meta= field includes the metainformation regarding the
sentence. This information may vary, as we have discussed in the
previous section, but usually includes the full (raw) sentence and the
sentence ID, as required by the CoNLL-U format specification.

#+BEGIN_EXAMPLE
CL-USER> (cl-conllu:sentence-meta (first *sents*))
(("text" . "PT no governo")
 ("source" . "CETENFolha n=1 cad=Opinião sec=opi sem=94a")
 ("sent_id" . "CF1-1") ("id" . "1"))
#+END_EXAMPLE

The =tokens= are the list of tokens that together form the sentence,
and they are themselves instances of the =token= class.

The =mtokens= (meta-tokens) are also instances of their own =mtoken=
class, and they are used for multiword tokens (vámonos = vamos + nos).

** Tokens

Instances of the =token= class have one property for each field/column
in the CoNLL-U format's sentences, that is:

- ID :: Word index, integer starting at 1 for each new sentence; may
        be a range for multiword tokens; may be a decimal number for
        empty nodes.
- FORM :: Word form or punctuation symbol.
- LEMMA :: Lemma of word form.
- UPOSTAG :: Universal part-of-speech tag.
- XPOSTAG :: Language-specific part-of-speech tag; underscore if not
             available.
- FEATS :: List of morphological features from the universal feature
           inventory or from a defined language-specific extension;
           underscore if not available.
- HEAD :: Head of the current word, which is either a value of ID or
          zero if the token is the root (0).
- DEPREL :: Universal dependency relation to the HEAD (=root= iff HEAD
            is 0) or a defined language-specific subtype of one.
- DEPS :: Enhanced dependency graph in the form of a list of
          head-deprel pairs.
- MISC :: Any other annotation.

* Visualizing CoNLL-U sentences

To visualize CoNLL-U sentences, we use the =conllu-visualize=
subpackage. The function =tree-sentence= receives an instance of a
sentence object and (optionally) an output stream, and outputs to the
stream the sentence's metadata and its tree structure:

#+BEGIN_EXAMPLE
(conllu.draw:tree-sentence (nth 5 *frases*))
text = Eles se dizem oposição, mas ainda não informaram o que vão combater.
source = CETENFolha n=1 cad=Opinião sec=opi sem=94a
sent_id = CF1-7
id = 6
─┮ 
 │ ╭─╼ Eles nsubj 
 │ ├─╼ se expl 
 ╰─┾ dizem root 
   ├─╼ oposição xcomp 
   │ ╭─╼ , punct 
   │ ├─╼ mas cc 
   │ │ ╭─╼ ainda advmod 
   │ ├─┶ não advmod 
   ├─┾ informaram conj 
   │ │   ╭─╼ o det 
   │ │ ╭─┶ que obj 
   │ │ ├─╼ vão aux 
   │ ╰─┶ combater ccomp 
   ╰─╼ . punct 
#+END_EXAMPLE

* Querying CoNLL-U files

Queries can be executed with 

#+BEGIN_SRC lisp
  (query '(nsubj (advcl (and (upostag "VERB") (lemma "correr"))
			(upostag "VERB" )) 
		 (upostag "PROP"))
	  *sents*)
#+END_SRC

* How to cite

http://arademaker.github.io/bibliography/tilic-stil-2017.html

#+BEGIN_EXAMPLE
@inproceedings{tilic-stil-2017,
  author = {Muniz, Henrique and Chalub, Fabricio and Rademaker, Alexandre},
  title = {CL-CONLLU: dependências universais em Common Lisp},
  booktitle = {V Workshop de Iniciação Científica em Tecnologia da
                    Informação e da Linguagem Humana (TILic)},
  year = {2017},
  address = {Uberlândia, MG, Brazil},
  note = {https://sites.google.com/view/tilic2017/}
}
#+END_EXAMPLE


Next: , Previous: , Up: Top   [Contents][Index]

2 Systems

The main system appears first, followed by any subsystem dependency.


Previous: , Up: Systems   [Contents][Index]

2.1 cl-conllu

Author

Fabricio Chalub <fchalub@br.ibm.com>

License

Apache 2.0

Description

Common Lisp corpus conllu utilities

Version

0.3

Dependencies
Source

cl-conllu.asd (file)

Components

Next: , Previous: , Up: Top   [Contents][Index]

3 Files

Files are sorted by type and then listed depth-first from the systems components trees.


Previous: , Up: Files   [Contents][Index]

3.1 Lisp


Next: , Previous: , Up: Lisp files   [Contents][Index]

3.1.1 cl-conllu.asd

Location

cl-conllu.asd

Systems

cl-conllu (system)


Next: , Previous: , Up: Lisp files   [Contents][Index]

3.1.2 cl-conllu/packages.lisp

Parent

cl-conllu (system)

Location

packages.lisp

Packages

Next: , Previous: , Up: Lisp files   [Contents][Index]

3.1.3 cl-conllu/data.lisp

Dependencies
Parent

cl-conllu (system)

Location

data.lisp

Exported Definitions
Internal Definitions

Next: , Previous: , Up: Lisp files   [Contents][Index]

3.1.4 cl-conllu/read-write.lisp

Dependencies
Parent

cl-conllu (system)

Location

read-write.lisp

Exported Definitions
Internal Definitions

Next: , Previous: , Up: Lisp files   [Contents][Index]

3.1.5 cl-conllu/evaluate.lisp

Dependencies
Parent

cl-conllu (system)

Location

evaluate.lisp

Internal Definitions

Next: , Previous: , Up: Lisp files   [Contents][Index]

3.1.6 cl-conllu/evaluate-template.lisp

Dependencies
Parent

cl-conllu (system)

Location

evaluate-template.lisp

Internal Definitions

Next: , Previous: , Up: Lisp files   [Contents][Index]

3.1.7 cl-conllu/query.lisp

Dependencies
Parent

cl-conllu (system)

Location

query.lisp

Exported Definitions
Internal Definitions

Next: , Previous: , Up: Lisp files   [Contents][Index]

3.1.8 cl-conllu/utils.lisp

Dependencies
Parent

cl-conllu (system)

Location

utils.lisp

Exported Definitions
Internal Definitions

Next: , Previous: , Up: Lisp files   [Contents][Index]

3.1.9 cl-conllu/rdf.lisp

Dependencies
Parent

cl-conllu (system)

Location

rdf.lisp

Exported Definitions
Internal Definitions

Next: , Previous: , Up: Lisp files   [Contents][Index]

3.1.10 cl-conllu/rdf-wilbur.lisp

Dependencies
Parent

cl-conllu (system)

Location

rdf-wilbur.lisp

Exported Definitions

convert-to-rdf (function)

Internal Definitions

Next: , Previous: , Up: Lisp files   [Contents][Index]

3.1.11 cl-conllu/command-line.lisp

Dependencies
Parent

cl-conllu (system)

Location

command-line.lisp

Internal Definitions

Next: , Previous: , Up: Lisp files   [Contents][Index]

3.1.12 cl-conllu/rules.lisp

Dependencies
Parent

cl-conllu (system)

Location

rules.lisp

Exported Definitions
Internal Definitions

Next: , Previous: , Up: Lisp files   [Contents][Index]

3.1.13 cl-conllu/conllu-prolog.lisp

Dependencies
Parent

cl-conllu (system)

Location

conllu-prolog.lisp

Exported Definitions

convert-filename (function)

Internal Definitions

Next: , Previous: , Up: Lisp files   [Contents][Index]

3.1.14 cl-conllu/niceline.lisp

Dependencies
Parent

cl-conllu (system)

Location

niceline.lisp

Internal Definitions

Next: , Previous: , Up: Lisp files   [Contents][Index]

3.1.15 cl-conllu/tag-converter.lisp

Dependencies
Parent

cl-conllu (system)

Location

tag-converter.lisp

Exported Definitions
Internal Definitions

write-token-tag-suffix (function)


Previous: , Up: Lisp files   [Contents][Index]

3.1.16 cl-conllu/draw.lisp

Dependencies
Parent

cl-conllu (system)

Location

draw.lisp

Exported Definitions

tree-sentence (function)

Internal Definitions

Next: , Previous: , Up: Top   [Contents][Index]

4 Packages

Packages are listed by definition order.


Next: , Previous: , Up: Packages   [Contents][Index]

4.1 conllu.draw

Source

packages.lisp (file)

Use List
Exported Definitions

tree-sentence (function)

Internal Definitions

Next: , Previous: , Up: Packages   [Contents][Index]

4.2 conllu.converters.tags

Source

packages.lisp (file)

Use List
Exported Definitions
Internal Definitions

write-token-tag-suffix (function)


Next: , Previous: , Up: Packages   [Contents][Index]

4.3 conllu.converters.niceline

Source

packages.lisp (file)

Use List
Internal Definitions

Next: , Previous: , Up: Packages   [Contents][Index]

4.4 conllu.rdf

Source

packages.lisp (file)

Use List
Internal Definitions

Next: , Previous: , Up: Packages   [Contents][Index]

4.5 conllu.prolog

Source

packages.lisp (file)

Use List
Exported Definitions

convert-filename (function)

Internal Definitions

Previous: , Up: Packages   [Contents][Index]

4.6 cl-conllu

Source

packages.lisp (file)

Use List
Used By List
Exported Definitions
Internal Definitions

Next: , Previous: , Up: Top   [Contents][Index]

5 Definitions

Definitions are sorted by export status, category, package, and then by lexicographic order.


Next: , Previous: , Up: Definitions   [Contents][Index]

5.1 Exported definitions


Next: , Previous: , Up: Exported definitions   [Contents][Index]

5.1.1 Functions

Function: adjust-sentence SENTENCE

Receives a sentence and reenumerate IDs and HEAD values of each token so that their order (as in sentence-tokens) is respected.

Package

cl-conllu

Source

data.lisp (file)

Function: apply-rules SENTENCES RULES RECURSIVE
Package

cl-conllu

Source

rules.lisp (file)

Function: apply-rules-from-files CONLLU-FILE RULES-FILE NEW-CONLLU-FILE LOG-FILE &key RECURSIVE
Package

cl-conllu

Source

rules.lisp (file)

Function: convert-filename CONTEXT FILENAME-IN FILENAME-OUT
Package

conllu.prolog

Source

conllu-prolog.lisp (file)

Function: convert-rdf CORPUSNAME STREAM CONLLS TEXT-FN ID-FN

Converts the collection of sentences (as generated by READ-CONLLU) in CONLL, using the function TEXT-FN to extract the text of each sentence and ID-FN to extract the id of each sentence (we need this as there is no standardized way of knowing this.) Also the generated Turtle file contains a lot of duplication so when you import it into your triple-store, make sure you remove all duplicate triples afterwards.

Package

cl-conllu

Source

rdf.lisp (file)

Function: convert-rdf-file FILE-IN FILE-OUT
Package

cl-conllu

Source

rdf.lisp (file)

Function: convert-to-rdf SENTENCES &key TEXT-FN ID-FN CORPUSNAME NAMESPACE-STRING STREAM RDF-FORMAT CONLL-NAMESPACE

Converts a list of sentences (e.g. as generated by READ-CONLLU)
in SENTENCES, using the function TEXT-FN to extract the text of each sentence and ID-FN to extract the id of each sentence (we need this as there is no standardized way of knowing this.)

Currently only ntriples is supported as RDF-FORMAT.

Package

cl-conllu

Source

rdf-wilbur.lisp (file)

Function: diff SENTENCES-A SENTENCES-B &key TEST KEY
Package

cl-conllu

Source

utils.lisp (file)

Function: levenshtein S1 S2 &key TEST
Package

cl-conllu

Source

utils.lisp (file)

Function: make-sentence LINENO LINES FN-META
Package

cl-conllu

Source

read-write.lisp (file)

Function: non-projective? SENTENCE

Verifies if a sentence tree is projective. Intuitively, this means that, keeping word order, there’s no two dependency arcs that cross.
More formally, let i -> j mean that j’s head is node i. Let ’->*’ be the transitive closure of ’->’.

A tree if projective when, for each node i, j: if i -> j, then for each node k between i and j (i < k < j or j < k < i), i ->* k.

References:
- Nivre, Joakim; Inductive Dependency Parsing, 2006
- https://en.wikipedia.org/wiki/Discontinuity_(linguistics)

Package

cl-conllu

Source

utils.lisp (file)

Function: query QUERY SENTENCES
Package

cl-conllu

Source

query.lisp (file)

Function: query-as-json A-QUERY SENTENCES
Package

cl-conllu

Source

query.lisp (file)

Function: read-conllu INPUT &key FN-META
Package

cl-conllu

Source

read-write.lisp (file)

Function: read-directory PATH &key FN-META
Package

cl-conllu

Source

read-write.lisp (file)

Function: read-file PATH &key FN-META
Package

cl-conllu

Source

read-write.lisp (file)

Function: read-file-tag-suffix FILENAME &key TAG SEPARATOR
Package

conllu.converters.tags

Source

tag-converter.lisp (file)

Function: read-sentence-tag-suffix STREAM FIELD SEPARATOR

Writes as sentence object input from STREAM as FORM.SEPARATOR.TAGVALUE (without dots), followed by a whitespace character.

Example:

;; Consider the file example.txt, with contents:
;; Pudim_NOUN é_VERB bom_ADJ ._PUNCT
;; E_CONJ torta_NOUN também_ADV ._PUNCT

(with-open-file (s "./example.txt")
(write-conllu-to-stream (read-sentence-tag-suffix s ’upostag "_"))) 1 Pudim _ NOUN _ _ _ _ _ _
2 é _ VERB _ _ _ _ _ _
3 bom _ ADJ _ _ _ _ _ _
4 . _ PUNCT _ _ _ _ _ _

1 E _ CONJ _ _ _ _ _ _
2 torta _ NOUN _ _ _ _ _ _
3 também _ ADV _ _ _ _ _ _
4 . _ PUNCT _ _ _ _ _ _

Package

conllu.converters.tags

Source

tag-converter.lisp (file)

Function: read-stream STREAM &key FN-META
Package

cl-conllu

Source

read-write.lisp (file)

Function: sentence->text SENTENCE &key IGNORE-MTOKENS SPECIAL-FORMAT-TEST SPECIAL-FORMAT-FUNCTION

Receives SENTENCE, a sentence object, and returns a string reconstructed from its tokens and mtokens.

If IGNORE-MTOKENS, then tokens’ forms are used. Else, tokens with id contained in a mtoken are not used, with mtoken’s form being used instead.

It is possible to special format some tokens. In order to do so, both SPECIAL-FORMAT-TEST and SPECIAL-FORMAT-FUNCTION should be passed. Then for each object (token or mtoken) for which SPECIAL-FORMAT-TEST returns a non-nil result, its form is modified by SPECIAL-FORMAT-FUNCTION in the final string.

Example:
(sentence-tokens *sentence*)
=> (#<TOKEN The/DET #1-det-3> #<TOKEN US/PROPN #2-compound-3> #<TOKEN troops/NOUN #3-nsubj-4> #<TOKEN fired/VERB #4-root-0> #<TOKEN into/ADP #5-case-8> #<TOKEN the/DET #6-det-8>
#<TOKEN hostile/ADJ #7-amod-8> #<TOKEN crowd/NOUN #8-obl-4> #<TOKEN ,/PUNCT #9-punct-4> #<TOKEN killing/VERB #10-advcl-4> #<TOKEN 4/NUM #11-obj-10> #<TOKEN ./PUNCT #12-punct-4>)

(sentence->text
sentence)
=> "The US troops fired into the hostile crowd, killing 4."

(sentence->text
sentence
:special-format-test #’(lambda (token)
(eq (token-upostag token)
"VERB"))
:special-format-function (lambda (string)
(format nil "*~a*" (string-upcase string))))
=> "The US troops *FIRED* into the hostile crowd, *KILLING* 4."

Package

cl-conllu

Source

data.lisp (file)

Function: sentence-binary-tree SENTENCE

Based on the idea from [1], it produces a tree view of the sentence, still need to improve the priorities of children.

Code at https://github.com/sivareddyg/UDepLambda in file src/deplambda/parser/TreeTransformer.java method ’binarizeTree’

[1] Siva Reddy, O. Tackstrom, M. Collins, T. Kwiatkowski, D. Das, M. Steedman, and M. Lapataw, Transforming Dependency Structures to Logical Forms for Semantic Parsing, Transactions of the Association for Computational Linguistics, pp. 127–140, Apr. 2016.

Package

cl-conllu

Source

data.lisp (file)

Function: sentence-equal SENT-1 SENT-2

Tests if, for each slot, sent-1 has the same values as sent-2. For tokens and multiword tokens, it uses token-equal and mtoken-equal, respectively.

Package

cl-conllu

Source

data.lisp (file)

Function: sentence-hash-table SENTENCE
Package

cl-conllu

Source

data.lisp (file)

Function: sentence-id SENTENCE
Package

cl-conllu

Source

data.lisp (file)

Function: sentence-meta-value SENTENCE META-FIELD
Package

cl-conllu

Source

data.lisp (file)

Function: sentence-text SENTENCE
Package

cl-conllu

Source

data.lisp (file)

Function: sentence-valid? SENTENCE
Package

cl-conllu

Source

data.lisp (file)

Function: tree-sentence SENTENCE &key STREAM SHOW-META
Package

conllu.draw

Source

draw.lisp (file)

Function: write-conllu SENTENCES FILENAME &key IF-EXISTS
Package

cl-conllu

Source

read-write.lisp (file)

Function: write-conllu-to-stream SENTENCES &optional OUT
Package

cl-conllu

Source

read-write.lisp (file)

Function: write-sentence-tag-suffix-to-stream SENTENCE &key STREAM TAG SEPARATOR

Writes sentence as CoNLL-U file in STREAM as FORM.SEPARATOR.TAGVALUE (without
dots), followed by a whitespace character.

If TAG is NIL, then writes only FORMs, followed by a whitepsace character.

Example:
;; supposing sentence already defined
(write-sentence-tag-suffix-to-stream (sentence :tag ’xpostag :separator "_")) Pierre_NNP Vinken_NNP ,_, 61_CD years_NNS old_JJ ,_, will_MD join_VB the_DT board_NN as_IN a_DT nonexecutive_JJ director_NN Nov._NNP 29_CD ._.
=> NIL

Package

conllu.converters.tags

Source

tag-converter.lisp (file)

Function: write-sentences-tag-suffix SENTENCES FILENAME &key TAG SEPARATOR IF-EXISTS

See documentation for write-sentence-tag-suffix-to-stream

Package

conllu.converters.tags

Source

tag-converter.lisp (file)

Function: write-sentences-tag-suffix-to-stream SENTENCES &key STREAM TAG SEPARATOR

See documentation for write-sentence-tag-suffix-to-stream

Package

conllu.converters.tags

Source

tag-converter.lisp (file)


Next: , Previous: , Up: Exported definitions   [Contents][Index]

5.1.2 Generic functions

Generic Function: mtoken-end OBJECT
Generic Function: (setf mtoken-end) NEW-VALUE OBJECT
Package

cl-conllu

Methods
Method: mtoken-end (MTOKEN mtoken)

automatically generated reader method

Source

data.lisp (file)

Method: (setf mtoken-end) NEW-VALUE (MTOKEN mtoken)

automatically generated writer method

Source

data.lisp (file)

Generic Function: mtoken-form OBJECT
Generic Function: (setf mtoken-form) NEW-VALUE OBJECT
Package

cl-conllu

Methods
Method: mtoken-form (MTOKEN mtoken)

automatically generated reader method

Source

data.lisp (file)

Method: (setf mtoken-form) NEW-VALUE (MTOKEN mtoken)

automatically generated writer method

Source

data.lisp (file)

Generic Function: mtoken-start OBJECT
Generic Function: (setf mtoken-start) NEW-VALUE OBJECT
Package

cl-conllu

Methods
Method: mtoken-start (MTOKEN mtoken)

automatically generated reader method

Source

data.lisp (file)

Method: (setf mtoken-start) NEW-VALUE (MTOKEN mtoken)

automatically generated writer method

Source

data.lisp (file)

Generic Function: sentence-meta OBJECT
Generic Function: (setf sentence-meta) NEW-VALUE OBJECT
Package

cl-conllu

Methods
Method: sentence-meta (SENTENCE sentence)

automatically generated reader method

Source

data.lisp (file)

Method: (setf sentence-meta) NEW-VALUE (SENTENCE sentence)

automatically generated writer method

Source

data.lisp (file)

Generic Function: sentence-mtokens OBJECT
Generic Function: (setf sentence-mtokens) NEW-VALUE OBJECT
Package

cl-conllu

Methods
Method: sentence-mtokens (SENTENCE sentence)

automatically generated reader method

Source

data.lisp (file)

Method: (setf sentence-mtokens) NEW-VALUE (SENTENCE sentence)

automatically generated writer method

Source

data.lisp (file)

Generic Function: sentence-start OBJECT
Generic Function: (setf sentence-start) NEW-VALUE OBJECT
Package

cl-conllu

Methods
Method: sentence-start (SENTENCE sentence)

automatically generated reader method

Source

data.lisp (file)

Method: (setf sentence-start) NEW-VALUE (SENTENCE sentence)

automatically generated writer method

Source

data.lisp (file)

Generic Function: sentence-tokens OBJECT
Generic Function: (setf sentence-tokens) NEW-VALUE OBJECT
Package

cl-conllu

Methods
Method: sentence-tokens (SENTENCE sentence)

automatically generated reader method

Source

data.lisp (file)

Method: (setf sentence-tokens) NEW-VALUE (SENTENCE sentence)

automatically generated writer method

Source

data.lisp (file)

Generic Function: token-deprel OBJECT
Generic Function: (setf token-deprel) NEW-VALUE OBJECT
Package

cl-conllu

Methods
Method: token-deprel (TOKEN token)

automatically generated reader method

Source

data.lisp (file)

Method: (setf token-deprel) NEW-VALUE (TOKEN token)

automatically generated writer method

Source

data.lisp (file)

Generic Function: token-deps OBJECT
Generic Function: (setf token-deps) NEW-VALUE OBJECT
Package

cl-conllu

Methods
Method: token-deps (TOKEN token)

automatically generated reader method

Source

data.lisp (file)

Method: (setf token-deps) NEW-VALUE (TOKEN token)

automatically generated writer method

Source

data.lisp (file)

Generic Function: token-feats OBJECT
Generic Function: (setf token-feats) NEW-VALUE OBJECT
Package

cl-conllu

Methods
Method: token-feats (TOKEN token)

automatically generated reader method

Source

data.lisp (file)

Method: (setf token-feats) NEW-VALUE (TOKEN token)

automatically generated writer method

Source

data.lisp (file)

Generic Function: token-form OBJECT
Generic Function: (setf token-form) NEW-VALUE OBJECT
Package

cl-conllu

Methods
Method: token-form (TOKEN token)

automatically generated reader method

Source

data.lisp (file)

Method: (setf token-form) NEW-VALUE (TOKEN token)

automatically generated writer method

Source

data.lisp (file)

Generic Function: token-head OBJECT
Generic Function: (setf token-head) NEW-VALUE OBJECT
Package

cl-conllu

Methods
Method: token-head (TOKEN token)

automatically generated reader method

Source

data.lisp (file)

Method: (setf token-head) NEW-VALUE (TOKEN token)

automatically generated writer method

Source

data.lisp (file)

Generic Function: token-id OBJECT
Generic Function: (setf token-id) NEW-VALUE OBJECT
Package

cl-conllu

Methods
Method: token-id (TOKEN token)

automatically generated reader method

Source

data.lisp (file)

Method: (setf token-id) NEW-VALUE (TOKEN token)

automatically generated writer method

Source

data.lisp (file)

Generic Function: token-lemma OBJECT
Generic Function: (setf token-lemma) NEW-VALUE OBJECT
Package

cl-conllu

Methods
Method: token-lemma (TOKEN token)

automatically generated reader method

Source

data.lisp (file)

Method: (setf token-lemma) NEW-VALUE (TOKEN token)

automatically generated writer method

Source

data.lisp (file)

Generic Function: token-misc OBJECT
Generic Function: (setf token-misc) NEW-VALUE OBJECT
Package

cl-conllu

Methods
Method: token-misc (TOKEN token)

automatically generated reader method

Source

data.lisp (file)

Method: (setf token-misc) NEW-VALUE (TOKEN token)

automatically generated writer method

Source

data.lisp (file)

Generic Function: token-upostag OBJECT
Generic Function: (setf token-upostag) NEW-VALUE OBJECT
Package

cl-conllu

Methods
Method: token-upostag (TOKEN token)

automatically generated reader method

Source

data.lisp (file)

Method: (setf token-upostag) NEW-VALUE (TOKEN token)

automatically generated writer method

Source

data.lisp (file)

Generic Function: token-xpostag OBJECT
Generic Function: (setf token-xpostag) NEW-VALUE OBJECT
Package

cl-conllu

Methods
Method: token-xpostag (TOKEN token)

automatically generated reader method

Source

data.lisp (file)

Method: (setf token-xpostag) NEW-VALUE (TOKEN token)

automatically generated writer method

Source

data.lisp (file)


Previous: , Up: Exported definitions   [Contents][Index]

5.1.3 Classes

Class: mtoken ()
Package

cl-conllu

Source

data.lisp (file)

Direct superclasses

standard-object (class)

Direct methods
Direct slots
Slot: start
Initargs

:start

Readers

mtoken-start (generic function)

Writers

(setf mtoken-start) (generic function)

Slot: end
Initargs

:end

Readers

mtoken-end (generic function)

Writers

(setf mtoken-end) (generic function)

Slot: form
Initargs

:form

Readers

mtoken-form (generic function)

Writers

(setf mtoken-form) (generic function)

Slot: misc
Initargs

:misc

Initform

"_"

Readers

mtoken-misc (generic function)

Writers

(setf mtoken-misc) (generic function)

Class: sentence ()
Package

cl-conllu

Source

data.lisp (file)

Direct superclasses

standard-object (class)

Direct methods
Direct slots
Slot: start
Initargs

:start

Initform

0

Readers

sentence-start (generic function)

Writers

(setf sentence-start) (generic function)

Slot: meta
Initargs

:meta

Readers

sentence-meta (generic function)

Writers

(setf sentence-meta) (generic function)

Slot: tokens
Initargs

:tokens

Readers

sentence-tokens (generic function)

Writers

(setf sentence-tokens) (generic function)

Slot: mtokens
Initargs

:mtokens

Readers

sentence-mtokens (generic function)

Writers

(setf sentence-mtokens) (generic function)

Class: token ()
Package

cl-conllu

Source

data.lisp (file)

Direct superclasses

standard-object (class)

Direct methods
Direct slots
Slot: id
Initargs

:id

Readers

token-id (generic function)

Writers

(setf token-id) (generic function)

Slot: form
Initargs

:form

Readers

token-form (generic function)

Writers

(setf token-form) (generic function)

Slot: lemma
Initargs

:lemma

Readers

token-lemma (generic function)

Writers

(setf token-lemma) (generic function)

Slot: upostag
Initargs

:upostag

Initform

"_"

Readers

token-upostag (generic function)

Writers

(setf token-upostag) (generic function)

Slot: xpostag
Initargs

:xpostag

Initform

"_"

Readers

token-xpostag (generic function)

Writers

(setf token-xpostag) (generic function)

Slot: feats
Initargs

:feats

Initform

"_"

Readers

token-feats (generic function)

Writers

(setf token-feats) (generic function)

Slot: head
Initargs

:head

Initform

"_"

Readers

token-head (generic function)

Writers

(setf token-head) (generic function)

Slot: deprel
Initargs

:deprel

Initform

"_"

Readers

token-deprel (generic function)

Writers

(setf token-deprel) (generic function)

Slot: deps
Initargs

:deps

Initform

"_"

Readers

token-deps (generic function)

Writers

(setf token-deps) (generic function)

Slot: misc
Initargs

:misc

Initform

"_"

Readers

token-misc (generic function)

Writers

(setf token-misc) (generic function)


Previous: , Up: Definitions   [Contents][Index]

5.2 Internal definitions


Next: , Previous: , Up: Internal definitions   [Contents][Index]

5.2.1 Special variables

Special Variable: *clauses*
Package

conllu.prolog

Source

conllu-prolog.lisp (file)

Special Variable: *dependencies*
Package

conllu.prolog

Source

conllu-prolog.lisp (file)

Special Variable: *deprel-value-list*

List of the 37 universal syntactic relations in UD.

Package

cl-conllu

Source

evaluate.lisp (file)

Special Variable: *deprels*
Package

cl-conllu

Source

query.lisp (file)

Special Variable: *token-fields*
Package

cl-conllu

Source

data.lisp (file)

Special Variable: niceline-matcher
Package

conllu.converters.niceline

Source

niceline.lisp (file)


Next: , Previous: , Up: Internal definitions   [Contents][Index]

5.2.2 Functions

Function: add LINES SPACES ID TEXT
Package

conllu.draw

Source

draw.lisp (file)

Function: add-diff-log P-VAL G-VAL LOG DIFF-TABLE

Recieves a pair of values g-val and p-val, creates the html section for reporting this diff

Package

cl-conllu

Source

evaluate-template.lisp (file)

Function: add-field-value TOKEN FIELD VALUE
Package

conllu.converters.niceline

Source

niceline.lisp (file)

Function: add-value FIELD NEW-VALUE TOKEN REST-CONDITIONS
Package

cl-conllu

Source

rules.lisp (file)

Function: adjust-conllu INPUT-FILENAME OUTPUT
Package

cl-conllu

Source

command-line.lisp (file)

Function: allowed-value ALLOWED-VALUES VALUE

Checks if the value is in the allowed list. An empty list signals that any value is allowed.

Package

cl-conllu

Source

evaluate-template.lisp (file)

Function: and% QUERY1 QUERY2 &key TKS
Package

cl-conllu

Source

query.lisp (file)

Function: apply-changes TOKENS RULE
Package

cl-conllu

Source

rules.lisp (file)

Function: apply-conditions-in-token CONDITIONS TOKEN
Package

cl-conllu

Source

rules.lisp (file)

Function: apply-rhs BINDINGS RHS
Package

cl-conllu

Source

rules.lisp (file)

Function: apply-rule-in-sentence A-SENTENCE RULE SENT-ID
Package

cl-conllu

Source

rules.lisp (file)

Function: apply-rule-in-tokens TOKENS RULE SENT-ID &optional MATCHS
Package

cl-conllu

Source

rules.lisp (file)

Function: apply-rules-in-sentence A-SENTENCE RULES SENT-ID RECURSIVE &optional OLD-RULES-APPLIED
Package

cl-conllu

Source

rules.lisp (file)

Function: apply-rules-in-sentence-aux A-SENTENCE RULES SENT-ID &optional APPLIED?
Package

cl-conllu

Source

rules.lisp (file)

Function: attachment-score-by-sentence LIST-SENT1 LIST-SENT2 &key LABELED IGNORE-PUNCT SIMPLE-DEP

Attachment score by sentence (macro-average).

The attachment score is the percentage of words that have correct arcs to their heads. The unlabeled attachment score (UAS) considers only who is the head of the token, while the labeled attachment score (LAS) considers both the head and the arc label (dependency label / syntactic class).

In order to choose between labeled or unlabeled,
set the key argument LABELED.

References:
- Dependency Parsing. Kubler, Mcdonald and Nivre (pp.79-80)

Package

cl-conllu

Source

evaluate.lisp (file)

Function: attachment-score-by-word LIST-SENT1 LIST-SENT2 &key LABELED IGNORE-PUNCT SIMPLE-DEP

Attachment score by word (micro-average).

The attachment score is the percentage of words that have correct arcs to their heads. The unlabeled attachment score (UAS) considers only who is the head of the token, while the labeled attachment score (LAS) considers both the head and the arc label (dependency label / syntactic class).

In order to choose between labeled or unlabeled,
set the key argument LABELED.

References:
- Dependency Parsing. Kubler, Mcdonald and Nivre (pp.79-80)

Package

cl-conllu

Source

evaluate.lisp (file)

Function: between LIST BOT TOP
Package

conllu.draw

Source

draw.lisp (file)

Function: children FATHER TOKENS
Package

conllu.draw

Source

draw.lisp (file)

Function: children TKS ID
Package

cl-conllu

Source

query.lisp (file)

Function: clean-dep-rel STR
Package

conllu.prolog

Source

conllu-prolog.lisp (file)

Function: clean-whitespace LINE
Package

conllu.prolog

Source

conllu-prolog.lisp (file)

Function: collect-meta LINES
Package

cl-conllu

Source

read-write.lisp (file)

Function: collect-slots TOKEN SLOTS ACUM
Package

conllu.draw

Source

draw.lisp (file)

Function: components->string COMPONENTS
Package

conllu.rdf

Source

rdf.lisp (file)

Function: confusion-matrix LIST-SENT1 LIST-SENT2 &key NORMALIZE

Returns a hash table where keys are lists (deprel1 deprel2) and values are fraction of classifications as deprel1 of a word that originally was deprel2.

We assume that LIST-SENT1 is the classified result
and LIST-SENT2 is the list of golden (correct) sentences.

Package

cl-conllu

Source

evaluate.lisp (file)

Function: confusion-table-access-cell ROW COL TABLE

Returns the value of the confusion table defined by the row and col

Package

cl-conllu

Source

evaluate-template.lisp (file)

Function: confusion-table-add-column CONFUSION-TABLE NEW-COLUMN

Adds a new column and row to the confusion table.

Package

cl-conllu

Source

evaluate-template.lisp (file)

Function: confusion-table-add-pair G-VALUE P-VALUE CONFUSION-TABLE

Increments the respective (row,column) of the confusion-table by 1, If the row or column does not exist, create it.

Package

cl-conllu

Source

evaluate-template.lisp (file)

Function: confusion-table-rows TABLE

Returns the rows of the confusion table

Package

cl-conllu

Source

evaluate-template.lisp (file)

Function: consume-tags TAGS TK
Package

conllu.converters.niceline

Source

niceline.lisp (file)

Function: convert-directory PATH
Package

conllu.converters.niceline

Source

niceline.lisp (file)

Function: convert-features-to-rdf FEATURES-STRING

Input: string
Output: list of feature nodes

Returns a list of nodes to be used as objects in triples with the predicate "conll:feats".

Examples:
(let ((wilbur:*nodes* (make-instance ’wilbur:dictionary))
(wilbur:*db* (make-instance ’wilbur:db)))
(wilbur:add-namespace "olia-sys" "http://purl.org/olia/system.owl#") (wilbur:add-namespace "conll" "http://br.ibm.com/conll/LEMMA") (convert-features-to-rdf "Mood=Ind|Tense=Past|VerbForm=Fin" (node "sentence1"))) =>
(!"http://br.ibm.com/conll/LEMMA#verbFormFin" !"http://br.ibm.com/conll/LEMMA#tensePast" !"http://br.ibm.com/conll/LEMMA#moodInd")

Package

conllu.rdf

Source

rdf-wilbur.lisp (file)

Function: convert-sentence-metadata METADATA SENTENCE-NODE

Input: list of pairs (name value), node
Output: List of triples

Example:
(let ((wilbur:*db* (make-instance ’wilbur:db))
(metadata ’(("sent_id" . "test")
("text" . "The US troops fired into the hostile crowd, killing 4.")))
(sentence-node (node "sentence")))
(convert-sentence-metadata metadata sentence-node))
=>
((#<WILBUR:TRIPLE !"sentence" !conll:metadata/sent_id #"test" {10048AA2E3}>)
(#<WILBUR:TRIPLE !"sentence" !conll:metadata/text #"The US troops fired into the hostile crowd, killing 4." {10048AA753}>))

Package

conllu.rdf

Source

rdf-wilbur.lisp (file)

Function: convert-sentence-to-rdf SENTENCE TEXT SENTENCE-ID CORPUS-ID-NODE
Package

conllu.rdf

Source

rdf-wilbur.lisp (file)

Function: convert-sentence-to-turtle STREAM CONLL TEXT ID
Package

conllu.rdf

Source

rdf.lisp (file)

Function: convert-token-to-rdf TOKEN SENTENCE-ID SENTENCE-NODE
Package

conllu.rdf

Source

rdf-wilbur.lisp (file)

Function: diff-sentences P-SENTENCE G-SENTENCE EVALUATION-FUNCTION CONFUSION-TABLE DIFF-TABLE &optional G-COLUMNS P-COLUMNS

Evaluates the tokens using the recieved evaluation-function.
Optional columns g-columns/p-columns for golden and predicted values.
The differences found are reported in the diff-table and confusion-table recieved

Package

cl-conllu

Source

evaluate-template.lisp (file)

Function: draw-descendent ID LINES SPACES BOT TOP N
Package

conllu.draw

Source

draw.lisp (file)

Function: draw-father ID LINES SPACES BOT TOP NODE N
Package

conllu.draw

Source

draw.lisp (file)

Function: draw-father-lines ID LINES SPACES BOT TOP
Package

conllu.draw

Source

draw.lisp (file)

Function: draw-no-descendets ID LINES SPACES N
Package

conllu.draw

Source

draw.lisp (file)

Function: draw-node ID LINES SPACES NODE
Package

conllu.draw

Source

draw.lisp (file)

Function: draw-node-values ID LINES SPACES NODE
Package

conllu.draw

Source

draw.lisp (file)

Function: emit-prolog CLAUSE TEXT
Package

conllu.prolog

Source

conllu-prolog.lisp (file)

Function: equal-op FIELD REGEX REST-PATTERN TOKEN
Package

cl-conllu

Source

rules.lisp (file)

Function: escape-string STRING CHAR-ESCAPE-FUNCTION
Package

conllu.rdf

Source

rdf.lisp (file)

Function: escape-turtle-char CHAR
Package

conllu.rdf

Source

rdf.lisp (file)

Function: eval-query EXPRESSION &key TKS
Package

cl-conllu

Source

query.lisp (file)

Function: exact-match LIST-SENT1 LIST-SENT2 &key COMPARED-FIELDS IDENTITY-FIELDS TEST SIMPLE-DEP IGNORE-PUNCT

Returns the list of sentences of LIST-SENT1 that are an exact match to the corresponding sentence of LIST-SENT2 (same position in list).

LIST-SENT1 and LIST-SENT2 must have the same size with corresponding sentences in order.

Package

cl-conllu

Source

evaluate.lisp (file)

Function: exact-match-score LIST-SENT1 LIST-SENT2 &key COMPARED-FIELDS IDENTITY-FIELDS TEST SIMPLE-DEP IGNORE-PUNCT

Returns the percentage of sentences of LIST-SENT1 that are an exact match to LIST-SENT2.

LIST-SENT1 and LIST-SENT2 must have the same size with corresponding sentences in order.

The typical use case is comparing the result of a tagger (or parser) against a test set, where an exact match is a completely correct tagging (or parse) for the sentence.

References:
- Dependency Parsing. Kubler, Mcdonald and Nivre (p.79)

Package

cl-conllu

Source

evaluate.lisp (file)

Function: exact-match-sentence SENT1 SENT2 &key COMPARED-FIELDS IDENTITY-FIELDS TEST SIMPLE-DEP IGNORE-PUNCT

Compares if two sentences are an exact match.

The typical use case is comparing the result of a tagger (or parser) against a test sentence.

Returns SENT1 if SENT1 and SENT2 agree for all tokens with respect to the COMPARED-FIELDS. Otherwise returns NIL.

If they do not have the same number of tokens or if the tokens do not agree on each IDENTITY-FIELD, then the sentences are not ’the same’ and thus an error is returned.

Package

cl-conllu

Source

evaluate.lisp (file)

Function: find-min LIST &key MIN
Package

cl-conllu

Source

utils.lisp (file)

Function: format-cell-html VAL &optional COLOR
Package

cl-conllu

Source

evaluate-template.lisp (file)

Function: format-dependency TOKEN SENT
Package

cl-conllu

Source

evaluate-template.lisp (file)

Function: format-file-name P-VALUE G-VALUE
Package

cl-conllu

Source

evaluate-template.lisp (file)

Function: format-link-html VAL HREF
Package

cl-conllu

Source

evaluate-template.lisp (file)

Function: format-matrix MATRIX
Package

cl-conllu

Source

evaluate.lisp (file)

Function: format-row-html VAL
Package

cl-conllu

Source

evaluate-template.lisp (file)

Function: format-sentence-text SENTENCE &optional HIGHLIGHTED-TOKENS
Package

cl-conllu

Source

evaluate-template.lisp (file)

Function: format-table-html VAL
Package

cl-conllu

Source

evaluate-template.lisp (file)

Function: get-diff-file-path P-VALUE G-VALUE DIFFS-PATH
Package

cl-conllu

Source

evaluate-template.lisp (file)

Function: get-token-parent TOKEN SENT
Package

cl-conllu

Source

evaluate-template.lisp (file)

Function: html-dependency-pair P-TOKEN G-TOKEN P-SENTENCE G-SENTENCE
Package

cl-conllu

Source

evaluate-template.lisp (file)

Function: html-diff-log P-VALUE G-VALUE P-TOKEN G-TOKEN P-SENTENCE G-SENTENCE DIFF-TABLE
Package

cl-conllu

Source

evaluate-template.lisp (file)

Function: html-make-header P-VALUE G-VALUE
Package

cl-conllu

Source

evaluate-template.lisp (file)

Function: html-make-info-line TOPIC LINE
Package

cl-conllu

Source

evaluate-template.lisp (file)

Function: html-set-bold TEXT
Package

cl-conllu

Source

evaluate-template.lisp (file)

Function: html-set-font-color TEXT COLOR
Package

cl-conllu

Source

evaluate-template.lisp (file)

Function: html-write-charset STREAM
Package

cl-conllu

Source

evaluate-template.lisp (file)

Function: html-write-style-css STREAM
Package

cl-conllu

Source

evaluate-template.lisp (file)

Function: insert-at LST INDEX NEWELT
Package

cl-conllu

Source

utils.lisp (file)

Function: insert-token SENTENCE NEW-TOKEN

Inserts token in a sentence object. It will not be inserted exactly as given: its ID will be the same (place where it’ll be inserted) but its head should point to id value prior to the insertion. It changes the sentence object passed.

Package

cl-conllu

Source

data.lisp (file)

Function: intern-pattern PATTERN
Package

cl-conllu

Source

rules.lisp (file)

Function: intern-rule RULE
Package

cl-conllu

Source

rules.lisp (file)

Function: intern-sides SIDES
Package

cl-conllu

Source

rules.lisp (file)

Function: is-descendant? ID-1 ID-2 SENTENCE &optional ALIST
Package

cl-conllu

Source

data.lisp (file)

Function: is-not-just-a-leaf ID TOKENS
Package

conllu.draw

Source

draw.lisp (file)

Function: is-root STR
Package

conllu.prolog

Source

conllu-prolog.lisp (file)

Function: line->mtoken LINE
Package

cl-conllu

Source

read-write.lisp (file)

Function: line->token LINE
Package

cl-conllu

Source

read-write.lisp (file)

Function: list-to-tsv ALIST STREAM
Package

cl-conllu

Source

read-write.lisp (file)

Function: make-branchs FATHER CHILDREN TOKENS LEN-TOKENS LINES SPACES
Package

conllu.draw

Source

draw.lisp (file)

Function: make-dep DEP
Package

conllu.rdf

Source

rdf.lisp (file)

Function: make-featurename FEAT
Package

conllu.rdf

Source

rdf.lisp (file)

Function: make-features FEATURES &optional VALUE-AS-LITERAL
Package

conllu.rdf

Source

rdf.lisp (file)

Function: make-features-bnode FEATURES &optional VALUE-AS-LITERAL
Package

conllu.rdf

Source

rdf.lisp (file)

Function: make-id CONTEXT PREFIX ID
Package

conllu.prolog

Source

conllu-prolog.lisp (file)

Function: make-literal STRING
Package

conllu.rdf

Source

rdf.lisp (file)

Function: make-metadata METADATA
Package

conllu.rdf

Source

rdf.lisp (file)

Function: make-metadata-bnode METADATA
Package

conllu.rdf

Source

rdf.lisp (file)

Function: make-root-lines TOKENS ROOT LINES SPACES
Package

conllu.draw

Source

draw.lisp (file)

Function: make-token-id SENTENCE-ID TOKEN-ID
Package

conllu.rdf

Source

rdf.lisp (file)

Function: make-tree SENT
Package

conllu.draw

Source

draw.lisp (file)

Function: make-upos UPOS
Package

conllu.rdf

Source

rdf.lisp (file)

Function: mappend FUNCTION LIST

Receives a function and a list of lists and returns the appended result of the aplication of the function to each list.

Package

cl-conllu

Source

utils.lisp (file)

Function: match-token TOKEN PATTERN
Package

cl-conllu

Source

rules.lisp (file)

Function: match? TOKENS RLS &optional BINDINGS
Package

cl-conllu

Source

rules.lisp (file)

Function: maximum-between LIST BOT TOP
Package

conllu.draw

Source

draw.lisp (file)

Function: member-op FIELD ELMENT REST-PATTERN TOKEN
Package

cl-conllu

Source

rules.lisp (file)

Function: modify-conllu ORIGINAL-FILE CHANGES-FILE OUTPUT &optional ADD-NEWS

The original file contains a set of sentences. The modified file contains some sentences from original modified, this function replaces in original the sentences presented in modified file, matching them using the sentence ids. If the modified file contains sentence not in original, the flag ’add-new’ , if true, says that these sentence must be added in the end of the original file.

Package

cl-conllu

Source

command-line.lisp (file)

Function: modify-value FIELD NEW-VALUE TOKEN REST-CONDITIONS
Package

cl-conllu

Source

rules.lisp (file)

Function: mtoken->tokens SENTENCE MTOKEN
Package

cl-conllu

Source

data.lisp (file)

Function: mtoken-equal MTOKEN-1 MTOKEN-2

Tests if, for each slot, mtoken-1 has the same values as mtoken-2.

Package

cl-conllu

Source

data.lisp (file)

Function: niceline G4 &key START END END-TOKEN END-VALUE &aux G5 G0 G1 G2 G3
Package

conllu.converters.niceline

Source

niceline.lisp (file)

Function: non-projectivity-accuracy LIST-SENT1 LIST-SENT2
Package

cl-conllu

Source

evaluate.lisp (file)

Function: non-projectivity-precision LIST-SENT1 LIST-SENT2
Package

cl-conllu

Source

evaluate.lisp (file)

Function: non-projectivity-recall LIST-SENT1 LIST-SENT2
Package

cl-conllu

Source

evaluate.lisp (file)

Function: or% QUERY1 QUERY2 &key TKS
Package

cl-conllu

Source

query.lisp (file)

Function: precision LIST-SENT1 LIST-SENT2 DEPREL &key ERROR-TYPE SIMPLE-DEP

Restricted to words which are classified as of syntactical class (dependency type to head) DEPREL, returns the precision:
the number of true positives divided by the number of words predicted positive (that is, predicted as of class DEPREL).

We assume that LIST-SENT1 is the classified (predicted) result and LIST-SENT2 is the list of golden (correct) sentences.

ERROR-TYPE defines what is considered an error (a false negative). Some usual values are:
- ’(deprel) :: for the deprel tagging task only
- ’(head) :: for considering errors for each syntactic class - ’(deprel head) :: for considering correct only when both deprel and head are correct.

Package

cl-conllu

Source

evaluate.lisp (file)

Function: print-diff MATRIZ
Package

cl-conllu

Source

utils.lisp (file)

Function: process-features SENTENCE-ID WORD-INDEX-ID FEATS-STR
Package

conllu.prolog

Source

conllu-prolog.lisp (file)

Function: process-tokens CONTEXT SENTENCE-ID TOKEN
Package

conllu.prolog

Source

conllu-prolog.lisp (file)

Function: prolog-string STR &optional DOWNCASE
Package

conllu.prolog

Source

conllu-prolog.lisp (file)

Function: read-niceline LINE
Package

conllu.converters.niceline

Source

niceline.lisp (file)

Function: read-niceline-file FILENAME
Package

conllu.converters.niceline

Source

niceline.lisp (file)

Function: read-niceline-stream STREAM
Package

conllu.converters.niceline

Source

niceline.lisp (file)

Function: read-rules FILENAME
Package

cl-conllu

Source

rules.lisp (file)

Function: recall LIST-SENT1 LIST-SENT2 DEPREL &key ERROR-TYPE SIMPLE-DEP

Restricted to words which are originally of syntactic class (dependency type to head) DEPREL, returns the recall:
the number of true positives divided by the number of words originally positive (that is, originally of class DEPREL).

We assume that LIST-SENT1 is the classified result
and LIST-SENT2 is the list of golden (correct) sentences.

ERROR-TYPE defines what is considered an error (a false negative). Some usual values are:
- ’(deprel) :: for the deprel tagging task only
- ’(head) :: for considering errors for each syntactic class - ’(deprel head) :: for considering correct only when both deprel and head are correct.

Package

cl-conllu

Source

evaluate.lisp (file)

Function: regex-op FIELD REGEX REST-PATTERN TOKEN
Package

cl-conllu

Source

rules.lisp (file)

Function: remove-token SENTENCE ID

Remove the token with the given ID if it is not part of a multi-word token and it does not contain childs. It returns two values, the sentence (changed or not) and a boolean (nil if the sentence was not changed and true if changed. If the removed token is the root of the sentence, a new root must be provided.

Package

cl-conllu

Source

data.lisp (file)

Function: report-confusion-table WORK-DIR GOLDEN-FILES PREDICTION-FILES EVALUATION-FUNCTION &optional G-COLUMNS P-COLUMNS COLUMN-SORT-FUNCTION BATCH-WRITE

Recieves two lists of paired collu-files ’golden-files’ and ’prediction-files’. Their names must be the same.
Writes a report in the folder specified by ’work-dir’.
The differences are found by applying the ’evaluation-function’ which must recieve a token and a sentence, and return a string representing the value of the desired difference to be analysed. i.e. parent-head, deprel...
The allowed columns of the confusion matrix can be specified trough ’g-columns’ ’p-columns’ and sorted by a recieved column-sort-function.
The ’batch-write’ .is the rate with which the diffs are written to the html files to avoid memory issues

Package

cl-conllu

Source

evaluate-template.lisp (file)

Function: report-diff P-VALUE G-VALUE P-TOKEN G-TOKEN P-SENTENCE G-SENTENCE DIFF-TABLE

Stores the html diff section if a difference was found

Package

cl-conllu

Source

evaluate-template.lisp (file)

Function: rhs RULE
Package

cl-conllu

Source

rules.lisp (file)

Function: rhs-vars RLS-VARS RHS
Package

cl-conllu

Source

rules.lisp (file)

Function: rls RULE
Package

cl-conllu

Source

rules.lisp (file)

Function: rls-vars RLS &optional VAR-LIST
Package

cl-conllu

Source

rules.lisp (file)

Function: root-leaf TOKENS
Package

conllu.draw

Source

draw.lisp (file)

Function: r~ RELATION QUERY1 QUERY2 &key TKS
Package

cl-conllu

Source

query.lisp (file)

Function: select-sentence ID SENTENCES
Package

cl-conllu

Source

command-line.lisp (file)

Function: sentence-average-score LIST-SENT1 LIST-SENT2 &key FIELDS IGNORE-PUNCT SIMPLE-DEP

Score by sentence (macro-average).

This is the mean of the percentage of words in each sentence that are correct with respect to the fields in FIELDS.

We assume that LIST-SENT1 is the classified result
and LIST-SENT2 is the list of golden (correct) sentences.

If IGNORE-PUNCT, tokens which have ’PUNCT’ as upostag
in the golden sentences are ignored.

Package

cl-conllu

Source

evaluate.lisp (file)

Function: sentence-diff SENT1 SENT2 &key FIELDS TEST SIMPLE-DEP IGNORE-PUNCT

Returns a list of differences in SENT1 and SENT2.

They must have the same size.

If IGNORE-PUNCT, tokens which have ’PUNCT’ as upostag in sent2 are ignored.

Package

cl-conllu

Source

evaluate.lisp (file)

Function: sentence-matrix SENTENCE
Package

cl-conllu

Source

data.lisp (file)

Function: sentence-root SENTENCE
Package

cl-conllu

Source

data.lisp (file)

Function: sentence-size SENTENCE
Package

cl-conllu

Source

data.lisp (file)

Function: set-head SENTENCE ID NEW-HEAD &optional DEPREL
Package

cl-conllu

Source

data.lisp (file)

Function: simple-deprel DEPREL
Package

cl-conllu

Source

data.lisp (file)

Function: token-children TOKEN SENTENCE &key FN-FILTER
Package

cl-conllu

Source

data.lisp (file)

Function: token-diff TK1 TK2 &key FIELDS TEST SIMPLE-DEP
Package

cl-conllu

Source

evaluate.lisp (file)

Function: token-equal TK1 TK2 &key FIELDS TEST SIMPLE-DEP
Package

cl-conllu

Source

data.lisp (file)

Function: token-parent TOKEN SENTENCE
Package

cl-conllu

Source

data.lisp (file)

Function: toprologid STR
Package

conllu.prolog

Source

conllu-prolog.lisp (file)

Function: t~ SLOT STRING &key TKS
Package

cl-conllu

Source

query.lisp (file)

Function: unspecified-field? C
Package

conllu.rdf

Source

rdf.lisp (file)

Function: valid-line LINE
Package

conllu.prolog

Source

conllu-prolog.lisp (file)

Function: valid-vars RULE
Package

cl-conllu

Source

rules.lisp (file)

Function: variable-p X
Package

cl-conllu

Source

rules.lisp (file)

Function: word-average-score LIST-SENT1 LIST-SENT2 &key FIELDS IGNORE-PUNCT SIMPLE-DEP

Score by word (micro-average).

This is the total mean of words in all sentences that are correct with respect to the fields in FIELDS.

We assume that LIST-SENT1 is the classified result and LIST-SENT2 is the list of golden (correct) sentences.

If IGNORE-PUNCT, tokens which have ’PUNCT’ as upostag in the golden sentences are ignored.

Package

cl-conllu

Source

evaluate.lisp (file)

Function: write-confusion-table CONFUSION-TABLE STREAM DIFFS-PATH &optional COLUMN-SORT-FUNCTION
Package

cl-conllu

Source

evaluate-template.lisp (file)

Function: write-diffs-to-files DIFF-TABLE DIFFS-PATH

Writes the diffs htmls to the correspondent files. Erases them from the diff table.

Package

cl-conllu

Source

evaluate-template.lisp (file)

Function: write-mtoken MTK STREAM
Package

cl-conllu

Source

read-write.lisp (file)

Function: write-prolog OUT
Package

conllu.prolog

Source

conllu-prolog.lisp (file)

Function: write-selected-sentence FILENAME ID OUTPUT

Returns a sentence whose ’sent_id’ from the list of sentences in ’filename’.

Package

cl-conllu

Source

command-line.lisp (file)

Function: write-sentence SENTENCE STREAM
Package

cl-conllu

Source

read-write.lisp (file)

Function: write-token TK STREAM
Package

cl-conllu

Source

read-write.lisp (file)

Function: write-token-tag-suffix TOKEN STREAM FIELD-VALUE SEPARATOR
Package

conllu.converters.tags

Source

tag-converter.lisp (file)


Next: , Previous: , Up: Internal definitions   [Contents][Index]

5.2.3 Generic functions

Generic Function: malformed-line CONDITION
Package

conllu.converters.niceline

Methods
Method: malformed-line (CONDITION malformed-line-error)
Source

niceline.lisp (file)

Generic Function: mtoken-misc OBJECT
Generic Function: (setf mtoken-misc) NEW-VALUE OBJECT
Package

cl-conllu

Methods
Method: mtoken-misc (MTOKEN mtoken)

automatically generated reader method

Source

data.lisp (file)

Method: (setf mtoken-misc) NEW-VALUE (MTOKEN mtoken)

automatically generated writer method

Source

data.lisp (file)


Previous: , Up: Internal definitions   [Contents][Index]

5.2.4 Conditions

Condition: malformed-line-error ()
Package

conllu.converters.niceline

Source

niceline.lisp (file)

Direct superclasses

error (condition)

Direct methods

malformed-line (method)

Direct slots
Slot: text
Initargs

:text

Readers

malformed-line (generic function)


Previous: , Up: Top   [Contents][Index]

Appendix A Indexes


Next: , Previous: , Up: Indexes   [Contents][Index]

A.1 Concepts

Jump to:   C   F   L  
Index Entry  Section

C
cl-conllu.asd: The cl-conllu<dot>asd file
cl-conllu/command-line.lisp: The cl-conllu/command-line<dot>lisp file
cl-conllu/conllu-prolog.lisp: The cl-conllu/conllu-prolog<dot>lisp file
cl-conllu/data.lisp: The cl-conllu/data<dot>lisp file
cl-conllu/draw.lisp: The cl-conllu/draw<dot>lisp file
cl-conllu/evaluate-template.lisp: The cl-conllu/evaluate-template<dot>lisp file
cl-conllu/evaluate.lisp: The cl-conllu/evaluate<dot>lisp file
cl-conllu/niceline.lisp: The cl-conllu/niceline<dot>lisp file
cl-conllu/packages.lisp: The cl-conllu/packages<dot>lisp file
cl-conllu/query.lisp: The cl-conllu/query<dot>lisp file
cl-conllu/rdf-wilbur.lisp: The cl-conllu/rdf-wilbur<dot>lisp file
cl-conllu/rdf.lisp: The cl-conllu/rdf<dot>lisp file
cl-conllu/read-write.lisp: The cl-conllu/read-write<dot>lisp file
cl-conllu/rules.lisp: The cl-conllu/rules<dot>lisp file
cl-conllu/tag-converter.lisp: The cl-conllu/tag-converter<dot>lisp file
cl-conllu/utils.lisp: The cl-conllu/utils<dot>lisp file

F
File, Lisp, cl-conllu.asd: The cl-conllu<dot>asd file
File, Lisp, cl-conllu/command-line.lisp: The cl-conllu/command-line<dot>lisp file
File, Lisp, cl-conllu/conllu-prolog.lisp: The cl-conllu/conllu-prolog<dot>lisp file
File, Lisp, cl-conllu/data.lisp: The cl-conllu/data<dot>lisp file
File, Lisp, cl-conllu/draw.lisp: The cl-conllu/draw<dot>lisp file
File, Lisp, cl-conllu/evaluate-template.lisp: The cl-conllu/evaluate-template<dot>lisp file
File, Lisp, cl-conllu/evaluate.lisp: The cl-conllu/evaluate<dot>lisp file
File, Lisp, cl-conllu/niceline.lisp: The cl-conllu/niceline<dot>lisp file
File, Lisp, cl-conllu/packages.lisp: The cl-conllu/packages<dot>lisp file
File, Lisp, cl-conllu/query.lisp: The cl-conllu/query<dot>lisp file
File, Lisp, cl-conllu/rdf-wilbur.lisp: The cl-conllu/rdf-wilbur<dot>lisp file
File, Lisp, cl-conllu/rdf.lisp: The cl-conllu/rdf<dot>lisp file
File, Lisp, cl-conllu/read-write.lisp: The cl-conllu/read-write<dot>lisp file
File, Lisp, cl-conllu/rules.lisp: The cl-conllu/rules<dot>lisp file
File, Lisp, cl-conllu/tag-converter.lisp: The cl-conllu/tag-converter<dot>lisp file
File, Lisp, cl-conllu/utils.lisp: The cl-conllu/utils<dot>lisp file

L
Lisp File, cl-conllu.asd: The cl-conllu<dot>asd file
Lisp File, cl-conllu/command-line.lisp: The cl-conllu/command-line<dot>lisp file
Lisp File, cl-conllu/conllu-prolog.lisp: The cl-conllu/conllu-prolog<dot>lisp file
Lisp File, cl-conllu/data.lisp: The cl-conllu/data<dot>lisp file
Lisp File, cl-conllu/draw.lisp: The cl-conllu/draw<dot>lisp file
Lisp File, cl-conllu/evaluate-template.lisp: The cl-conllu/evaluate-template<dot>lisp file
Lisp File, cl-conllu/evaluate.lisp: The cl-conllu/evaluate<dot>lisp file
Lisp File, cl-conllu/niceline.lisp: The cl-conllu/niceline<dot>lisp file
Lisp File, cl-conllu/packages.lisp: The cl-conllu/packages<dot>lisp file
Lisp File, cl-conllu/query.lisp: The cl-conllu/query<dot>lisp file
Lisp File, cl-conllu/rdf-wilbur.lisp: The cl-conllu/rdf-wilbur<dot>lisp file
Lisp File, cl-conllu/rdf.lisp: The cl-conllu/rdf<dot>lisp file
Lisp File, cl-conllu/read-write.lisp: The cl-conllu/read-write<dot>lisp file
Lisp File, cl-conllu/rules.lisp: The cl-conllu/rules<dot>lisp file
Lisp File, cl-conllu/tag-converter.lisp: The cl-conllu/tag-converter<dot>lisp file
Lisp File, cl-conllu/utils.lisp: The cl-conllu/utils<dot>lisp file

Jump to:   C   F   L  

Next: , Previous: , Up: Indexes   [Contents][Index]

A.2 Functions

Jump to:   (  
A   B   C   D   E   F   G   H   I   L   M   N   O   P   Q   R   S   T   U   V   W  
Index Entry  Section

(
(setf mtoken-end): Exported generic functions
(setf mtoken-end): Exported generic functions
(setf mtoken-form): Exported generic functions
(setf mtoken-form): Exported generic functions
(setf mtoken-misc): Internal generic functions
(setf mtoken-misc): Internal generic functions
(setf mtoken-start): Exported generic functions
(setf mtoken-start): Exported generic functions
(setf sentence-meta): Exported generic functions
(setf sentence-meta): Exported generic functions
(setf sentence-mtokens): Exported generic functions
(setf sentence-mtokens): Exported generic functions
(setf sentence-start): Exported generic functions
(setf sentence-start): Exported generic functions
(setf sentence-tokens): Exported generic functions
(setf sentence-tokens): Exported generic functions
(setf token-deprel): Exported generic functions
(setf token-deprel): Exported generic functions
(setf token-deps): Exported generic functions
(setf token-deps): Exported generic functions
(setf token-feats): Exported generic functions
(setf token-feats): Exported generic functions
(setf token-form): Exported generic functions
(setf token-form): Exported generic functions
(setf token-head): Exported generic functions
(setf token-head): Exported generic functions
(setf token-id): Exported generic functions
(setf token-id): Exported generic functions
(setf token-lemma): Exported generic functions
(setf token-lemma): Exported generic functions
(setf token-misc): Exported generic functions
(setf token-misc): Exported generic functions
(setf token-upostag): Exported generic functions
(setf token-upostag): Exported generic functions
(setf token-xpostag): Exported generic functions
(setf token-xpostag): Exported generic functions

A
add: Internal functions
add-diff-log: Internal functions
add-field-value: Internal functions
add-value: Internal functions
adjust-conllu: Internal functions
adjust-sentence: Exported functions
allowed-value: Internal functions
and%: Internal functions
apply-changes: Internal functions
apply-conditions-in-token: Internal functions
apply-rhs: Internal functions
apply-rule-in-sentence: Internal functions
apply-rule-in-tokens: Internal functions
apply-rules: Exported functions
apply-rules-from-files: Exported functions
apply-rules-in-sentence: Internal functions
apply-rules-in-sentence-aux: Internal functions
attachment-score-by-sentence: Internal functions
attachment-score-by-word: Internal functions

B
between: Internal functions

C
children: Internal functions
children: Internal functions
clean-dep-rel: Internal functions
clean-whitespace: Internal functions
collect-meta: Internal functions
collect-slots: Internal functions
components->string: Internal functions
confusion-matrix: Internal functions
confusion-table-access-cell: Internal functions
confusion-table-add-column: Internal functions
confusion-table-add-pair: Internal functions
confusion-table-rows: Internal functions
consume-tags: Internal functions
convert-directory: Internal functions
convert-features-to-rdf: Internal functions
convert-filename: Exported functions
convert-rdf: Exported functions
convert-rdf-file: Exported functions
convert-sentence-metadata: Internal functions
convert-sentence-to-rdf: Internal functions
convert-sentence-to-turtle: Internal functions
convert-to-rdf: Exported functions
convert-token-to-rdf: Internal functions

D
diff: Exported functions
diff-sentences: Internal functions
draw-descendent: Internal functions
draw-father: Internal functions
draw-father-lines: Internal functions
draw-no-descendets: Internal functions
draw-node: Internal functions
draw-node-values: Internal functions

E
emit-prolog: Internal functions
equal-op: Internal functions
escape-string: Internal functions
escape-turtle-char: Internal functions
eval-query: Internal functions
exact-match: Internal functions
exact-match-score: Internal functions
exact-match-sentence: Internal functions

F
find-min: Internal functions
format-cell-html: Internal functions
format-dependency: Internal functions
format-file-name: Internal functions
format-link-html: Internal functions
format-matrix: Internal functions
format-row-html: Internal functions
format-sentence-text: Internal functions
format-table-html: Internal functions
Function, add: Internal functions
Function, add-diff-log: Internal functions
Function, add-field-value: Internal functions
Function, add-value: Internal functions
Function, adjust-conllu: Internal functions
Function, adjust-sentence: Exported functions
Function, allowed-value: Internal functions
Function, and%: Internal functions
Function, apply-changes: Internal functions
Function, apply-conditions-in-token: Internal functions
Function, apply-rhs: Internal functions
Function, apply-rule-in-sentence: Internal functions
Function, apply-rule-in-tokens: Internal functions
Function, apply-rules: Exported functions
Function, apply-rules-from-files: Exported functions
Function, apply-rules-in-sentence: Internal functions
Function, apply-rules-in-sentence-aux: Internal functions
Function, attachment-score-by-sentence: Internal functions
Function, attachment-score-by-word: Internal functions
Function, between: Internal functions
Function, children: Internal functions
Function, children: Internal functions
Function, clean-dep-rel: Internal functions
Function, clean-whitespace: Internal functions
Function, collect-meta: Internal functions
Function, collect-slots: Internal functions
Function, components->string: Internal functions
Function, confusion-matrix: Internal functions
Function, confusion-table-access-cell: Internal functions
Function, confusion-table-add-column: Internal functions
Function, confusion-table-add-pair: Internal functions
Function, confusion-table-rows: Internal functions
Function, consume-tags: Internal functions
Function, convert-directory: Internal functions
Function, convert-features-to-rdf: Internal functions
Function, convert-filename: Exported functions
Function, convert-rdf: Exported functions
Function, convert-rdf-file: Exported functions
Function, convert-sentence-metadata: Internal functions
Function, convert-sentence-to-rdf: Internal functions
Function, convert-sentence-to-turtle: Internal functions
Function, convert-to-rdf: Exported functions
Function, convert-token-to-rdf: Internal functions
Function, diff: Exported functions
Function, diff-sentences: Internal functions
Function, draw-descendent: Internal functions
Function, draw-father: Internal functions
Function, draw-father-lines: Internal functions
Function, draw-no-descendets: Internal functions
Function, draw-node: Internal functions
Function, draw-node-values: Internal functions
Function, emit-prolog: Internal functions
Function, equal-op: Internal functions
Function, escape-string: Internal functions
Function, escape-turtle-char: Internal functions
Function, eval-query: Internal functions
Function, exact-match: Internal functions
Function, exact-match-score: Internal functions
Function, exact-match-sentence: Internal functions
Function, find-min: Internal functions
Function, format-cell-html: Internal functions
Function, format-dependency: Internal functions
Function, format-file-name: Internal functions
Function, format-link-html: Internal functions
Function, format-matrix: Internal functions
Function, format-row-html: Internal functions
Function, format-sentence-text: Internal functions
Function, format-table-html: Internal functions
Function, get-diff-file-path: Internal functions
Function, get-token-parent: Internal functions
Function, html-dependency-pair: Internal functions
Function, html-diff-log: Internal functions
Function, html-make-header: Internal functions
Function, html-make-info-line: Internal functions
Function, html-set-bold: Internal functions
Function, html-set-font-color: Internal functions
Function, html-write-charset: Internal functions
Function, html-write-style-css: Internal functions
Function, insert-at: Internal functions
Function, insert-token: Internal functions
Function, intern-pattern: Internal functions
Function, intern-rule: Internal functions
Function, intern-sides: Internal functions
Function, is-descendant?: Internal functions
Function, is-not-just-a-leaf: Internal functions
Function, is-root: Internal functions
Function, levenshtein: Exported functions
Function, line->mtoken: Internal functions
Function, line->token: Internal functions
Function, list-to-tsv: Internal functions
Function, make-branchs: Internal functions
Function, make-dep: Internal functions
Function, make-featurename: Internal functions
Function, make-features: Internal functions
Function, make-features-bnode: Internal functions
Function, make-id: Internal functions
Function, make-literal: Internal functions
Function, make-metadata: Internal functions
Function, make-metadata-bnode: Internal functions
Function, make-root-lines: Internal functions
Function, make-sentence: Exported functions
Function, make-token-id: Internal functions
Function, make-tree: Internal functions
Function, make-upos: Internal functions
Function, mappend: Internal functions
Function, match-token: Internal functions
Function, match?: Internal functions
Function, maximum-between: Internal functions
Function, member-op: Internal functions
Function, modify-conllu: Internal functions
Function, modify-value: Internal functions
Function, mtoken->tokens: Internal functions
Function, mtoken-equal: Internal functions
Function, niceline: Internal functions
Function, non-projective?: Exported functions
Function, non-projectivity-accuracy: Internal functions
Function, non-projectivity-precision: Internal functions
Function, non-projectivity-recall: Internal functions
Function, or%: Internal functions
Function, precision: Internal functions
Function, print-diff: Internal functions
Function, process-features: Internal functions
Function, process-tokens: Internal functions
Function, prolog-string: Internal functions
Function, query: Exported functions
Function, query-as-json: Exported functions
Function, read-conllu: Exported functions
Function, read-directory: Exported functions
Function, read-file: Exported functions
Function, read-file-tag-suffix: Exported functions
Function, read-niceline: Internal functions
Function, read-niceline-file: Internal functions
Function, read-niceline-stream: Internal functions
Function, read-rules: Internal functions
Function, read-sentence-tag-suffix: Exported functions
Function, read-stream: Exported functions
Function, recall: Internal functions
Function, regex-op: Internal functions
Function, remove-token: Internal functions
Function, report-confusion-table: Internal functions
Function, report-diff: Internal functions
Function, rhs: Internal functions
Function, rhs-vars: Internal functions
Function, rls: Internal functions
Function, rls-vars: Internal functions
Function, root-leaf: Internal functions
Function, r~: Internal functions
Function, select-sentence: Internal functions
Function, sentence->text: Exported functions
Function, sentence-average-score: Internal functions
Function, sentence-binary-tree: Exported functions
Function, sentence-diff: Internal functions
Function, sentence-equal: Exported functions
Function, sentence-hash-table: Exported functions
Function, sentence-id: Exported functions
Function, sentence-matrix: Internal functions
Function, sentence-meta-value: Exported functions
Function, sentence-root: Internal functions
Function, sentence-size: Internal functions
Function, sentence-text: Exported functions
Function, sentence-valid?: Exported functions
Function, set-head: Internal functions
Function, simple-deprel: Internal functions
Function, token-children: Internal functions
Function, token-diff: Internal functions
Function, token-equal: Internal functions
Function, token-parent: Internal functions
Function, toprologid: Internal functions
Function, tree-sentence: Exported functions
Function, t~: Internal functions
Function, unspecified-field?: Internal functions
Function, valid-line: Internal functions
Function, valid-vars: Internal functions
Function, variable-p: Internal functions
Function, word-average-score: Internal functions
Function, write-confusion-table: Internal functions
Function, write-conllu: Exported functions
Function, write-conllu-to-stream: Exported functions
Function, write-diffs-to-files: Internal functions
Function, write-mtoken: Internal functions
Function, write-prolog: Internal functions
Function, write-selected-sentence: Internal functions
Function, write-sentence: Internal functions
Function, write-sentence-tag-suffix-to-stream: Exported functions
Function, write-sentences-tag-suffix: Exported functions
Function, write-sentences-tag-suffix-to-stream: Exported functions
Function, write-token: Internal functions
Function, write-token-tag-suffix: Internal functions

G
Generic Function, (setf mtoken-end): Exported generic functions
Generic Function, (setf mtoken-form): Exported generic functions
Generic Function, (setf mtoken-misc): Internal generic functions
Generic Function, (setf mtoken-start): Exported generic functions
Generic Function, (setf sentence-meta): Exported generic functions
Generic Function, (setf sentence-mtokens): Exported generic functions
Generic Function, (setf sentence-start): Exported generic functions
Generic Function, (setf sentence-tokens): Exported generic functions
Generic Function, (setf token-deprel): Exported generic functions
Generic Function, (setf token-deps): Exported generic functions
Generic Function, (setf token-feats): Exported generic functions
Generic Function, (setf token-form): Exported generic functions
Generic Function, (setf token-head): Exported generic functions
Generic Function, (setf token-id): Exported generic functions
Generic Function, (setf token-lemma): Exported generic functions
Generic Function, (setf token-misc): Exported generic functions
Generic Function, (setf token-upostag): Exported generic functions
Generic Function, (setf token-xpostag): Exported generic functions
Generic Function, malformed-line: Internal generic functions
Generic Function, mtoken-end: Exported generic functions
Generic Function, mtoken-form: Exported generic functions
Generic Function, mtoken-misc: Internal generic functions
Generic Function, mtoken-start: Exported generic functions
Generic Function, sentence-meta: Exported generic functions
Generic Function, sentence-mtokens: Exported generic functions
Generic Function, sentence-start: Exported generic functions
Generic Function, sentence-tokens: Exported generic functions
Generic Function, token-deprel: Exported generic functions
Generic Function, token-deps: Exported generic functions
Generic Function, token-feats: Exported generic functions
Generic Function, token-form: Exported generic functions
Generic Function, token-head: Exported generic functions
Generic Function, token-id: Exported generic functions
Generic Function, token-lemma: Exported generic functions
Generic Function, token-misc: Exported generic functions
Generic Function, token-upostag: Exported generic functions
Generic Function, token-xpostag: Exported generic functions
get-diff-file-path: Internal functions
get-token-parent: Internal functions

H
html-dependency-pair: Internal functions
html-diff-log: Internal functions
html-make-header: Internal functions
html-make-info-line: Internal functions
html-set-bold: Internal functions
html-set-font-color: Internal functions
html-write-charset: Internal functions
html-write-style-css: Internal functions

I
insert-at: Internal functions
insert-token: Internal functions
intern-pattern: Internal functions
intern-rule: Internal functions
intern-sides: Internal functions
is-descendant?: Internal functions
is-not-just-a-leaf: Internal functions
is-root: Internal functions

L
levenshtein: Exported functions
line->mtoken: Internal functions
line->token: Internal functions
list-to-tsv: Internal functions

M
make-branchs: Internal functions
make-dep: Internal functions
make-featurename: Internal functions
make-features: Internal functions
make-features-bnode: Internal functions
make-id: Internal functions
make-literal: Internal functions
make-metadata: Internal functions
make-metadata-bnode: Internal functions
make-root-lines: Internal functions
make-sentence: Exported functions
make-token-id: Internal functions
make-tree: Internal functions
make-upos: Internal functions
malformed-line: Internal generic functions
malformed-line: Internal generic functions
mappend: Internal functions
match-token: Internal functions
match?: Internal functions
maximum-between: Internal functions
member-op: Internal functions
Method, (setf mtoken-end): Exported generic functions
Method, (setf mtoken-form): Exported generic functions
Method, (setf mtoken-misc): Internal generic functions
Method, (setf mtoken-start): Exported generic functions
Method, (setf sentence-meta): Exported generic functions
Method, (setf sentence-mtokens): Exported generic functions
Method, (setf sentence-start): Exported generic functions
Method, (setf sentence-tokens): Exported generic functions
Method, (setf token-deprel): Exported generic functions
Method, (setf token-deps): Exported generic functions
Method, (setf token-feats): Exported generic functions
Method, (setf token-form): Exported generic functions
Method, (setf token-head): Exported generic functions
Method, (setf token-id): Exported generic functions
Method, (setf token-lemma): Exported generic functions
Method, (setf token-misc): Exported generic functions
Method, (setf token-upostag): Exported generic functions
Method, (setf token-xpostag): Exported generic functions
Method, malformed-line: Internal generic functions
Method, mtoken-end: Exported generic functions
Method, mtoken-form: Exported generic functions
Method, mtoken-misc: Internal generic functions
Method, mtoken-start: Exported generic functions
Method, sentence-meta: Exported generic functions
Method, sentence-mtokens: Exported generic functions
Method, sentence-start: Exported generic functions
Method, sentence-tokens: Exported generic functions
Method, token-deprel: Exported generic functions
Method, token-deps: Exported generic functions
Method, token-feats: Exported generic functions
Method, token-form: Exported generic functions
Method, token-head: Exported generic functions
Method, token-id: Exported generic functions
Method, token-lemma: Exported generic functions
Method, token-misc: Exported generic functions
Method, token-upostag: Exported generic functions
Method, token-xpostag: Exported generic functions
modify-conllu: Internal functions
modify-value: Internal functions
mtoken->tokens: Internal functions
mtoken-end: Exported generic functions
mtoken-end: Exported generic functions
mtoken-equal: Internal functions
mtoken-form: Exported generic functions
mtoken-form: Exported generic functions
mtoken-misc: Internal generic functions
mtoken-misc: Internal generic functions
mtoken-start: Exported generic functions
mtoken-start: Exported generic functions

N
niceline: Internal functions
non-projective?: Exported functions
non-projectivity-accuracy: Internal functions
non-projectivity-precision: Internal functions
non-projectivity-recall: Internal functions

O
or%: Internal functions

P
precision: Internal functions
print-diff: Internal functions
process-features: Internal functions
process-tokens: Internal functions
prolog-string: Internal functions

Q
query: Exported functions
query-as-json: Exported functions

R
read-conllu: Exported functions
read-directory: Exported functions
read-file: Exported functions
read-file-tag-suffix: Exported functions
read-niceline: Internal functions
read-niceline-file: Internal functions
read-niceline-stream: Internal functions
read-rules: Internal functions
read-sentence-tag-suffix: Exported functions
read-stream: Exported functions
recall: Internal functions
regex-op: Internal functions
remove-token: Internal functions
report-confusion-table: Internal functions
report-diff: Internal functions
rhs: Internal functions
rhs-vars: Internal functions
rls: Internal functions
rls-vars: Internal functions
root-leaf: Internal functions
r~: Internal functions

S
select-sentence: Internal functions
sentence->text: Exported functions
sentence-average-score: Internal functions
sentence-binary-tree: Exported functions
sentence-diff: Internal functions
sentence-equal: Exported functions
sentence-hash-table: Exported functions
sentence-id: Exported functions
sentence-matrix: Internal functions
sentence-meta: Exported generic functions
sentence-meta: Exported generic functions
sentence-meta-value: Exported functions
sentence-mtokens: Exported generic functions
sentence-mtokens: Exported generic functions
sentence-root: Internal functions
sentence-size: Internal functions
sentence-start: Exported generic functions
sentence-start: Exported generic functions
sentence-text: Exported functions
sentence-tokens: Exported generic functions
sentence-tokens: Exported generic functions
sentence-valid?: Exported functions
set-head: Internal functions
simple-deprel: Internal functions

T
token-children: Internal functions
token-deprel: Exported generic functions
token-deprel: Exported generic functions
token-deps: Exported generic functions
token-deps: Exported generic functions
token-diff: Internal functions
token-equal: Internal functions
token-feats: Exported generic functions
token-feats: Exported generic functions
token-form: Exported generic functions
token-form: Exported generic functions
token-head: Exported generic functions
token-head: Exported generic functions
token-id: Exported generic functions
token-id: Exported generic functions
token-lemma: Exported generic functions
token-lemma: Exported generic functions
token-misc: Exported generic functions
token-misc: Exported generic functions
token-parent: Internal functions
token-upostag: Exported generic functions
token-upostag: Exported generic functions
token-xpostag: Exported generic functions
token-xpostag: Exported generic functions
toprologid: Internal functions
tree-sentence: Exported functions
t~: Internal functions

U
unspecified-field?: Internal functions

V
valid-line: Internal functions
valid-vars: Internal functions
variable-p: Internal functions

W
word-average-score: Internal functions
write-confusion-table: Internal functions
write-conllu: Exported functions
write-conllu-to-stream: Exported functions
write-diffs-to-files: Internal functions
write-mtoken: Internal functions
write-prolog: Internal functions
write-selected-sentence: Internal functions
write-sentence: Internal functions
write-sentence-tag-suffix-to-stream: Exported functions
write-sentences-tag-suffix: Exported functions
write-sentences-tag-suffix-to-stream: Exported functions
write-token: Internal functions
write-token-tag-suffix: Internal functions

Jump to:   (  
A   B   C   D   E   F   G   H   I   L   M   N   O   P   Q   R   S   T   U   V   W  

Next: , Previous: , Up: Indexes   [Contents][Index]

A.3 Variables

Jump to:   *  
D   E   F   H   I   L   M   N   S   T   U   X  
Index Entry  Section

*
*clauses*: Internal special variables
*dependencies*: Internal special variables
*deprel-value-list*: Internal special variables
*deprels*: Internal special variables
*token-fields*: Internal special variables

D
deprel: Exported classes
deps: Exported classes

E
end: Exported classes

F
feats: Exported classes
form: Exported classes
form: Exported classes

H
head: Exported classes

I
id: Exported classes

L
lemma: Exported classes

M
meta: Exported classes
misc: Exported classes
misc: Exported classes
mtokens: Exported classes

N
niceline-matcher: Internal special variables

S
Slot, deprel: Exported classes
Slot, deps: Exported classes
Slot, end: Exported classes
Slot, feats: Exported classes
Slot, form: Exported classes
Slot, form: Exported classes
Slot, head: Exported classes
Slot, id: Exported classes
Slot, lemma: Exported classes
Slot, meta: Exported classes
Slot, misc: Exported classes
Slot, misc: Exported classes
Slot, mtokens: Exported classes
Slot, start: Exported classes
Slot, start: Exported classes
Slot, text: Internal conditions
Slot, tokens: Exported classes
Slot, upostag: Exported classes
Slot, xpostag: Exported classes
Special Variable, *clauses*: Internal special variables
Special Variable, *dependencies*: Internal special variables
Special Variable, *deprel-value-list*: Internal special variables
Special Variable, *deprels*: Internal special variables
Special Variable, *token-fields*: Internal special variables
Special Variable, niceline-matcher: Internal special variables
start: Exported classes
start: Exported classes

T
text: Internal conditions
tokens: Exported classes

U
upostag: Exported classes

X
xpostag: Exported classes

Jump to:   *  
D   E   F   H   I   L   M   N   S   T   U   X  

Previous: , Up: Indexes   [Contents][Index]

A.4 Data types

Jump to:   C   M   P   S   T  
Index Entry  Section

C
cl-conllu: The cl-conllu system
cl-conllu: The cl-conllu package
Class, mtoken: Exported classes
Class, sentence: Exported classes
Class, token: Exported classes
Condition, malformed-line-error: Internal conditions
conllu.converters.niceline: The conllu<dot>converters<dot>niceline package
conllu.converters.tags: The conllu<dot>converters<dot>tags package
conllu.draw: The conllu<dot>draw package
conllu.prolog: The conllu<dot>prolog package
conllu.rdf: The conllu<dot>rdf package

M
malformed-line-error: Internal conditions
mtoken: Exported classes

P
Package, cl-conllu: The cl-conllu package
Package, conllu.converters.niceline: The conllu<dot>converters<dot>niceline package
Package, conllu.converters.tags: The conllu<dot>converters<dot>tags package
Package, conllu.draw: The conllu<dot>draw package
Package, conllu.prolog: The conllu<dot>prolog package
Package, conllu.rdf: The conllu<dot>rdf package

S
sentence: Exported classes
System, cl-conllu: The cl-conllu system

T
token: Exported classes

Jump to:   C   M   P   S   T