The cl-conllu Reference Manual

3.1.1 cl-conllu/cl-conllu.asd

Source

cl-conllu.asd.

Parent Component

cl-conllu (system).

ASDF Systems

cl-conllu.

---

3.1.2 cl-conllu/packages.lisp

Source

cl-conllu.asd.

Parent Component

cl-conllu (system).

Packages

• conllu.prolog.
• conllu.user.
• conllu.rdf.
• conllu.evaluate.
• conllu.draw.
• conllu.converters.niceline.
• conllu.editor.
• conllu.converters.tags.
• conllu.rules.
• cl-conllu.
• conllu.html.

---

3.1.3 cl-conllu/data.lisp

Dependency

packages.lisp (file).

Source

cl-conllu.asd.

Parent Component

cl-conllu (system).

Public Interface

• adjust-sentence (function).
• initialize-instance (method).
• mtoken (class).
• mtoken-end (reader method).
• (setf mtoken-end) (writer method).
• mtoken-start (reader method).
• (setf mtoken-start) (writer method).
• print-object (method).
• print-object (method).
• sentence (class).
• sentence->text (function).
• sentence-binary-tree (function).
• sentence-equal (function).
• sentence-fill-offsets (function).
• sentence-hash-table (function).
• sentence-id (function).
• sentence-meta (reader method).
• (setf sentence-meta) (writer method).
• sentence-meta-value (function).
• sentence-mtokens (reader method).
• (setf sentence-mtokens) (writer method).
• sentence-root (function).
• sentence-size (function).
• sentence-start (reader method).
• (setf sentence-start) (writer method).
• sentence-text (function).
• sentence-tokens (reader method).
• (setf sentence-tokens) (writer method).
• sentence-valid? (function).
• simple-deprel (function).
• token (class).
• token-add-feature (function).
• token-cfrom (reader method).
• (setf token-cfrom) (writer method).
• token-children (function).
• token-cto (reader method).
• (setf token-cto) (writer method).
• token-deprel (reader method).
• (setf token-deprel) (writer method).
• token-deps (reader method).
• (setf token-deps) (writer method).
• token-feats (reader method).
• (setf token-feats) (writer method).
• token-form (reader method).
• (setf token-form) (writer method).
• token-hash-features (function).
• token-head (reader method).
• (setf token-head) (writer method).
• token-id (reader method).
• (setf token-id) (writer method).
• token-lemma (reader method).
• (setf token-lemma) (writer method).
• token-misc (reader method).
• (setf token-misc) (writer method).
• token-parent (function).
• token-rem-feature (function).
• token-sentence (reader method).
• (setf token-sentence) (writer method).
• token-upostag (reader method).
• (setf token-upostag) (writer method).
• token-xpostag (reader method).
• (setf token-xpostag) (writer method).

Internals

• *token-fields* (special variable).
• abstract-token (class).
• etoken (class).
• etoken-deps (reader method).
• (setf etoken-deps) (writer method).
• etoken-feats (reader method).
• (setf etoken-feats) (writer method).
• etoken-index (reader method).
• (setf etoken-index) (writer method).
• etoken-lemma (reader method).
• (setf etoken-lemma) (writer method).
• etoken-prev (reader method).
• (setf etoken-prev) (writer method).
• etoken-upostag (reader method).
• (setf etoken-upostag) (writer method).
• etoken-xpostag (reader method).
• (setf etoken-xpostag) (writer method).
• hash-to-features (function).
• is-descendant? (function).
• mtoken-equal (function).
• sentence-by-id (function).
• sentence-etokens (reader method).
• (setf sentence-etokens) (writer method).
• sentence-get-token-by-id (function).
• sentence-matrix (function).
• set-head (function).
• token-attached (function).
• token-equal (function).
• token-lineno (reader method).
• (setf token-lineno) (writer method).
• token-misc-value (function).

---

3.1.4 cl-conllu/read-write.lisp

Dependency

data.lisp (file).

Source

cl-conllu.asd.

Parent Component

cl-conllu (system).

Public Interface

• encode (method).
• encode (method).
• lazy-stream-reader (function).
• make-sentence (function).
• read-conllu (function).
• read-directory (function).
• read-file (function).
• read-stream (function).
• write-conllu (function).
• write-conllu-to-stream (function).

Internals

• collect-meta (function).
• line->token (function).
• malformed-field (condition).
• malformed-line (condition).
• parse-field (function).
• write-sentence (function).
• write-token (generic function).

---

3.1.5 cl-conllu/evaluate.lisp

Dependencies

• data.lisp (file).
• read-write.lisp (file).

Source

cl-conllu.asd.

Parent Component

cl-conllu (system).

Public Interface

• attachment-score-by-sentence (function).
• attachment-score-by-word (function).
• exact-match (function).
• exact-match-score (function).
• non-projectivity-accuracy (function).
• non-projectivity-precision (function).
• non-projectivity-recall (function).
• precision (function).
• recall (function).

Internals

• *deprel-value-list* (special variable).
• *token-fields* (special variable).
• exact-match-sentence (function).
• sentence-average-score (function).
• sentence-diff (function).
• token-diff (function).
• word-average-score (function).

---

3.1.6 cl-conllu/confusion-matrix.lisp

Dependencies

• data.lisp (file).
• evaluate.lisp (file).

Source

cl-conllu.asd.

Parent Component

cl-conllu (system).

Public Interface

• confusion-matrix (class).
• confusion-matrix-cell-count (function).
• confusion-matrix-cell-tokens (function).
• confusion-matrix-cells-labels (function).
• confusion-matrix-columns-labels (function).
• confusion-matrix-corpus-id (reader method).
• (setf confusion-matrix-corpus-id) (writer method).
• confusion-matrix-labels (function).
• confusion-matrix-normalize (function).
• confusion-matrix-rows-labels (function).
• confusion-matrix-update (function).
• initialize-instance (method).
• make-confusion-matrix (function).
• print-object (method).

Internals

• confusion-matrix-copy (function).
• confusion-matrix-key-fn (reader method).
• (setf confusion-matrix-key-fn) (writer method).
• confusion-matrix-rows (reader method).
• (setf confusion-matrix-rows) (writer method).
• confusion-matrix-sort-fn (reader method).
• (setf confusion-matrix-sort-fn) (writer method).
• confusion-matrix-test-fn (reader method).
• (setf confusion-matrix-test-fn) (writer method).
• confusion-matrix-update-sentences (function).
• confusion-matrix-update-tokens (function).
• create-cell (function).
• existing-cell-p (function).
• insert-entry-confusion-matrix (function).

---

3.1.7 cl-conllu/html.lisp

Dependencies

• data.lisp (file).
• confusion-matrix.lisp (file).

Source

cl-conllu.asd.

Parent Component

cl-conllu (system).

Public Interface

• *confusion-matrix-style* (special variable).
• format-html (generic function).

Internals

• write-columns-headers (function).
• write-rows (function).

---

3.1.8 cl-conllu/query.lisp

Dependencies

• data.lisp (file).
• html.lisp (file).

Source

cl-conllu.asd.

Parent Component

cl-conllu (system).

Public Interface

• query (function).
• query-as-json (function).

Internals

• *deprels* (special variable).
• and% (function).
• children (function).
• eval-query (function).
• or% (function).
• r~ (function).
• t~ (function).

---

3.1.9 cl-conllu/utils.lisp

Dependencies

• data.lisp (file).
• query.lisp (file).

Source

cl-conllu.asd.

Parent Component

cl-conllu (system).

Public Interface

• diff (function).
• levenshtein (function).

Internals

• blank-line? (function).
• find-min (function).
• insert-at (function).
• mappend (function).
• print-diff (function).
• range (function).

---

3.1.10 cl-conllu/projective.lisp

Dependency

utils.lisp (file).

Source

cl-conllu.asd.

Parent Component

cl-conllu (system).

Internals

• get-projection (function).
• is-sentence-projective (function).
• is-token-projective (function).
• non-projective-punct (function).

---

3.1.11 cl-conllu/rdf.lisp

Dependencies

• data.lisp (file).
• projective.lisp (file).

Source

cl-conllu.asd.

Parent Component

cl-conllu (system).

Public Interface

• convert-rdf (function).
• convert-rdf-file (function).

Internals

• components->string (function).
• convert-sentence-to-turtle (function).
• escape-string (function).
• escape-turtle-char (function).
• make-dep (function).
• make-featurename (function).
• make-features (function).
• make-features-bnode (function).
• make-literal (function).
• make-metadata (function).
• make-metadata-bnode (function).
• make-token-id (function).
• make-upos (function).
• unspecified-field? (function).

---

3.1.12 cl-conllu/rdf-wilbur.lisp

Dependencies

• data.lisp (file).
• rdf.lisp (file).

Source

cl-conllu.asd.

Parent Component

cl-conllu (system).

Public Interface

convert-to-rdf (function).

Internals

• convert-features-to-rdf (function).
• convert-sentence-metadata (function).
• convert-sentence-to-rdf (function).
• convert-token-to-rdf (function).

---

3.1.13 cl-conllu/command-line.lisp

Dependencies

• data.lisp (file).
• rdf-wilbur.lisp (file).

Source

cl-conllu.asd.

Parent Component

cl-conllu (system).

Internals

• adjust-conllu (function).
• draw-conllu (function).
• modify-conllu (function).
• select-sentence (function).
• write-selected-sentence (function).

---

3.1.14 cl-conllu/rules.lisp

Dependencies

• utils.lisp (file).
• data.lisp (file).
• command-line.lisp (file).

Source

cl-conllu.asd.

Parent Component

cl-conllu (system).

Public Interface

• apply-rules (function).
• apply-rules-from-files (function).

Internals

• add-value (function).
• apply-changes (function).
• apply-conditions-in-token (function).
• apply-rhs (function).
• apply-rule-in-sentence (function).
• apply-rule-in-tokens (function).
• apply-rules-in-sentence (function).
• apply-rules-in-sentence-aux (function).
• equal-op (function).
• intern-pattern (function).
• intern-rule (function).
• intern-sides (function).
• match-token (function).
• match? (function).
• member-op (function).
• modify-value (function).
• read-rules (function).
• regex-op (function).
• rhs (function).
• rhs-vars (function).
• rls (function).
• rls-vars (function).
• valid-vars (function).
• variable-p (function).

---

3.1.15 cl-conllu/editor.lisp

Dependencies

• utils.lisp (file).
• data.lisp (file).
• rules.lisp (file).

Source

cl-conllu.asd.

Parent Component

cl-conllu (system).

Public Interface

conlluedit (function).

Internals

• action (function).
• actions (function).
• add-or-subt (function).
• apply-act (function).
• apply-rule (function).
• apply-rules (function).
• assocs (function).
• clear (function).
• def-match (function).
• definitions (function).
• defs-tests (function).
• error-test (macro).
• examine-acts (function).
• get-field-value (function).
• index (reader method).
• join-matchs (function).
• malformed-rule (condition).
• match-test (function).
• merge-matchs (function).
• merge-sets (function).
• multiple-merges (function).
• node-matchs (function).
• normalize-shortcut (function).
• rel-match (function).
• relation (function).
• relation-test (function).
• relations (function).
• result-act (function).
• result-acts (function).
• result-set (function).
• result-sets (function).
• sets (function).
• test-feats&misc (function).
• token-matchs (function).

---

3.1.16 cl-conllu/conllu-prolog.lisp

Dependencies

• data.lisp (file).
• editor.lisp (file).

Source

cl-conllu.asd.

Parent Component

cl-conllu (system).

Public Interface

convert-filename (function).

Internals

• *clauses* (special variable).
• *dependencies* (special variable).
• clean-dep-rel (function).
• clean-whitespace (function).
• emit-prolog (function).
• is-root (function).
• make-id (function).
• process-features (function).
• process-tokens (function).
• prolog-string (function).
• toprologid (function).
• valid-line (function).
• write-prolog (function).

---

3.1.17 cl-conllu/tag-converter.lisp

Dependencies

• data.lisp (file).
• conllu-prolog.lisp (file).

Source

cl-conllu.asd.

Parent Component

cl-conllu (system).

Public Interface

• read-file-tag-suffix (function).
• read-sentence-tag-suffix (function).
• write-sentence-tag-suffix-to-stream (function).
• write-sentences-tag-suffix (function).
• write-sentences-tag-suffix-to-stream (function).

Internals

write-token-tag-suffix (function).

---

3.1.18 cl-conllu/draw.lisp

Dependencies

• data.lisp (file).
• tag-converter.lisp (file).

Source

cl-conllu.asd.

Parent Component

cl-conllu (system).

Public Interface

• tree-sentence (function).
• tree-sentence-by-id (function).

Internals

• adopted-unfinished? (function).
• get-data (function).
• get-kids (function).
• get-stroke-size (function).
• make-tree (function).
• make-twigs (function).
• update-lines (function).

---

5.1.1 Special variables

Special Variable: *confusion-matrix-style* ¶

HTML for styling the confusion matrix.

Package

conllu.html.

Source

html.lisp.

---

5.1.2 Ordinary functions

Function: adjust-sentence (sentence) ¶

Receives a sentence and reenumerate IDs and HEAD values of each token so that their order (as in sentence-tokens) is respected.

Package

cl-conllu.

Source

data.lisp.

Function: apply-rules (sentences rules recursive) ¶

Package

conllu.rules.

Source

rules.lisp.

Function: apply-rules-from-files (conllu-file rules-file new-conllu-file log-file &key recursive) ¶

Package

conllu.rules.

Source

rules.lisp.

Function: attachment-score-by-sentence (list-sent1 list-sent2 &key labeled ignore-punct simple-dep) ¶

Attachment score by sentence (macro-average).

The attachment score is the percentage of words that have correct arcs to their heads. The unlabeled attachment score (UAS) considers only who is the head of the token, while the labeled attachment score (LAS) considers both the head and the arc label (dependency label / syntactic class).

In order to choose between labeled or unlabeled,
set the key argument LABELED.

References:
- Dependency Parsing. Kubler, Mcdonald and Nivre (pp.79-80)

Package

conllu.evaluate.

Source

evaluate.lisp.

Function: attachment-score-by-word (list-sent1 list-sent2 &key labeled ignore-punct simple-dep) ¶

Attachment score by word (micro-average).

The attachment score is the percentage of words that have correct arcs to their heads. The unlabeled attachment score (UAS) considers only who is the head of the token, while the labeled attachment score (LAS) considers both the head and the arc label (dependency label / syntactic class).

In order to choose between labeled or unlabeled,
set the key argument LABELED.

References:
- Dependency Parsing. Kubler, Mcdonald and Nivre (pp.79-80)

Package

conllu.evaluate.

Source

evaluate.lisp.

Function: confusion-matrix-cell-count (label1 label2 cm &key default-if-undefined) ¶

Returns the number of tokens that are contained in the cell defined by LABEL1 LABEL2 in the confusion matrix CM.

If DEFAULT-IF-UNDEFINED, returns 0. Otherwise, raises an error in case there is no such cell.

Package

conllu.evaluate.

Source

confusion-matrix.lisp.

Function: confusion-matrix-cell-tokens (label1 label2 cm &key default-if-undefined) ¶

Returns the list of (SENT-ID . TOKEN-ID) of tokens in the cell LABEL1 LABEL2.

If DEFAULT-IF-UNDEFINED, returns the empty list. Otherwise, raises an error in case there is no such cell.

Package

conllu.evaluate.

Source

confusion-matrix.lisp.

Function: confusion-matrix-cells-labels (cm) ¶

Returns a list of ’(LABEL1 LABEL2) for each cell in the confusion matrix CM.

Package

conllu.evaluate.

Source

confusion-matrix.lisp.

Function: confusion-matrix-columns-labels (cm) ¶

Package

conllu.evaluate.

Source

confusion-matrix.lisp.

Function: confusion-matrix-labels (cm) ¶

Returns the list of all labels in the confusion matrix CM.

Package

conllu.evaluate.

Source

confusion-matrix.lisp.

Function: confusion-matrix-normalize (cm) ¶

Returns a new CONFUSION-MATRIX with new empty cells for each pair (LABEL1 LABEL2) of labels in (confusion-matrix-labels CM) that are undefined in CM.

Package

conllu.evaluate.

Source

confusion-matrix.lisp.

Function: confusion-matrix-rows-labels (cm) ¶

Returns the list of labels occuring in the rows of the confusion matix CM.

Package

conllu.evaluate.

Source

confusion-matrix.lisp.

Function: confusion-matrix-update (list-sent1 list-sent2 cm) ¶

Updates an existing confusion matrix by a list of sentences LIST-SENT1 and LIST-SENT2.

Package

conllu.evaluate.

Source

confusion-matrix.lisp.

Function: conlluedit (sentences rules) ¶

Package

conllu.editor.

Source

editor.lisp.

Function: convert-filename (context filename-in filename-out) ¶

Package

conllu.prolog.

Source

conllu-prolog.lisp.

Function: convert-rdf (corpusname stream conlls text-fn id-fn) ¶

Converts the collection of sentences (as generated by READ-CONLLU) in CONLL, using the function TEXT-FN to extract the text of each sentence and ID-FN to extract the id of each sentence (we need this as there is no standardized way of knowing this.) Also the generated Turtle file contains a lot of duplication so when you import it into your triple-store, make sure you remove all duplicate triples afterwards.

Package

cl-conllu.

Source

rdf.lisp.

Function: convert-rdf-file (file-in file-out) ¶

Package

cl-conllu.

Source

rdf.lisp.

Function: convert-to-rdf (sentences &key text-fn id-fn corpusname namespace-string stream rdf-format conll-namespace) ¶

Converts a list of sentences (e.g. as generated by READ-CONLLU)
in SENTENCES, using the function TEXT-FN to extract the text of each sentence and ID-FN to extract the id of each sentence (we need this as there is no standardized way of knowing this.)

Currently only ntriples is supported as RDF-FORMAT.

Package

cl-conllu.

Source

rdf-wilbur.lisp.

Function: diff (sentences-a sentences-b &key test key) ¶

Package

cl-conllu.

Source

utils.lisp.

Function: exact-match (list-sent1 list-sent2 &key compared-fields identity-fields test simple-dep ignore-punct) ¶

Returns the list of sentences of LIST-SENT1 that are an exact match to the corresponding sentence of LIST-SENT2 (same position in list).

LIST-SENT1 and LIST-SENT2 must have the same size with corresponding sentences in order.

Package

conllu.evaluate.

Source

evaluate.lisp.

Function: exact-match-score (list-sent1 list-sent2 &key compared-fields identity-fields test simple-dep ignore-punct) ¶

Returns the percentage of sentences of LIST-SENT1 that are an exact match to LIST-SENT2.

LIST-SENT1 and LIST-SENT2 must have the same size with corresponding sentences in order.

The typical use case is comparing the result of a tagger (or parser) against a test set, where an exact match is a completely correct tagging (or parse) for the sentence.

References:
- Dependency Parsing. Kubler, Mcdonald and Nivre (p.79)

Package

conllu.evaluate.

Source

evaluate.lisp.

Function: lazy-stream-reader (stream &key fn-meta start-lineno) ¶

Return a function that returns one CoNLL-U sentence per call.

Package

cl-conllu.

Source

read-write.lisp.

Function: levenshtein (s1 s2 &key test) ¶

Package

cl-conllu.

Source

utils.lisp.

Function: make-confusion-matrix (list-sent1 list-sent2 &key corpus-id key-fn test-fn sort-fn) ¶

Creates a new confusion matrix from the lists of sentences LIST-SENT1 and LIST-SENT2.

Package

conllu.evaluate.

Source

confusion-matrix.lisp.

Function: make-sentence (lineno lines fn-meta) ¶

Package

cl-conllu.

Source

read-write.lisp.

Function: non-projectivity-accuracy (list-sent1 list-sent2) ¶

Package

conllu.evaluate.

Source

evaluate.lisp.

Function: non-projectivity-precision (list-sent1 list-sent2) ¶

Package

conllu.evaluate.

Source

evaluate.lisp.

Function: non-projectivity-recall (list-sent1 list-sent2) ¶

Package

conllu.evaluate.

Source

evaluate.lisp.

Function: precision (list-sent1 list-sent2 deprel &key error-type simple-dep) ¶

Restricted to words which are classified as of syntactical class (dependency type to head) DEPREL, returns the precision:
the number of true positives divided by the number of words predicted positive (that is, predicted as of class DEPREL).

We assume that LIST-SENT1 is the classified (predicted) result and LIST-SENT2 is the list of golden (correct) sentences.

ERROR-TYPE defines what is considered an error (a false negative). Some usual values are:
- ’(deprel) :: for the deprel tagging task only
- ’(head) :: for considering errors for each syntactic class - ’(deprel head) :: for considering correct only when both deprel and head are correct.

Package

conllu.evaluate.

Source

evaluate.lisp.

Function: query (query sentences) ¶

Package

cl-conllu.

Source

query.lisp.

Function: query-as-json (a-query sentences) ¶

Package

cl-conllu.

Source

query.lisp.

Function: read-conllu (input &key fn-meta) ¶

Package

cl-conllu.

Source

read-write.lisp.

Function: read-directory (path &key fn-meta) ¶

Package

cl-conllu.

Source

read-write.lisp.

Function: read-file (path &key fn-meta) ¶

Package

cl-conllu.

Source

read-write.lisp.

Function: read-file-tag-suffix (filename &key tag separator) ¶

Package

conllu.converters.tags.

Source

tag-converter.lisp.

Function: read-sentence-tag-suffix (stream field separator) ¶

Writes as sentence object input from STREAM as FORM.SEPARATOR.TAGVALUE (without dots), followed by a whitespace character.

Example:

;; Consider the file example.txt, with contents:
;; Pudim_NOUN é_VERB bom_ADJ ._PUNCT
;; E_CONJ torta_NOUN também_ADV ._PUNCT

(with-open-file (s "./example.txt")
(write-conllu-to-stream (read-sentence-tag-suffix s ’upostag "_"))) 1 Pudim _ NOUN _ _ _ _ _ _
2 é _ VERB _ _ _ _ _ _
3 bom _ ADJ _ _ _ _ _ _
4 . _ PUNCT _ _ _ _ _ _

1 E _ CONJ _ _ _ _ _ _
2 torta _ NOUN _ _ _ _ _ _
3 também _ ADV _ _ _ _ _ _
4 . _ PUNCT _ _ _ _ _ _

Package

conllu.converters.tags.

Source

tag-converter.lisp.

Function: read-stream (stream &key fn-meta stop? start-lineno) ¶

Package

cl-conllu.

Source

read-write.lisp.

Function: recall (list-sent1 list-sent2 deprel &key error-type simple-dep) ¶

Restricted to words which are originally of syntactic class (dependency type to head) DEPREL, returns the recall:
the number of true positives divided by the number of words originally positive (that is, originally of class DEPREL).

We assume that LIST-SENT1 is the classified result
and LIST-SENT2 is the list of golden (correct) sentences.

ERROR-TYPE defines what is considered an error (a false negative). Some usual values are:
- ’(deprel) :: for the deprel tagging task only
- ’(head) :: for considering errors for each syntactic class - ’(deprel head) :: for considering correct only when both deprel and head are correct.

Package

conllu.evaluate.

Source

evaluate.lisp.

Function: sentence->text (sentence &key ignore-mtokens special-format-test special-format-function) ¶

Receives SENTENCE, a sentence object, and returns a string reconstructed from its tokens and mtokens.

If IGNORE-MTOKENS, then tokens’ forms are used. Else, tokens with id contained in a mtoken are not used, with mtoken’s form being used instead.

It is possible to special format some tokens. In order to do so, both SPECIAL-FORMAT-TEST and SPECIAL-FORMAT-FUNCTION should be passed. Then for each object (token or mtoken) for which SPECIAL-FORMAT-TEST returns a non-nil result, its form is modified by SPECIAL-FORMAT-FUNCTION in the final string.

Package

cl-conllu.

Source

data.lisp.

Function: sentence-binary-tree (sentence) ¶

Based on the idea from [1], it produces a tree view of the sentence, still need to improve the priorities of children.

Code at https://github.com/sivareddyg/UDepLambda in file src/deplambda/parser/TreeTransformer.java method ’binarizeTree’

[1] Siva Reddy, O. Tackstrom, M. Collins, T. Kwiatkowski, D. Das, M. Steedman, and M. Lapataw, Transforming Dependency Structures to Logical Forms for Semantic Parsing, Transactions of the Association for Computational Linguistics, pp. 127–140, Apr. 2016.

Package

cl-conllu.

Source

data.lisp.

Function: sentence-equal (sent-1 sent-2) ¶

Tests if, for each slot, sent-1 has the same values as sent-2. For tokens and multiword tokens, it uses token-equal and mtoken-equal, respectively.

Package

cl-conllu.

Source

data.lisp.

Function: sentence-fill-offsets (sentence) ¶

Package

cl-conllu.

Source

data.lisp.

Function: sentence-hash-table (sentence) ¶

Package

cl-conllu.

Source

data.lisp.

Function: sentence-id (sentence) ¶

Package

cl-conllu.

Source

data.lisp.

Function: sentence-meta-value (sentence meta-field) ¶

Package

cl-conllu.

Source

data.lisp.

Function: sentence-root (sentence) ¶

Package

cl-conllu.

Source

data.lisp.

Function: sentence-size (sentence) ¶

Package

cl-conllu.

Source

data.lisp.

Function: sentence-text (sentence) ¶

Package

cl-conllu.

Source

data.lisp.

Function: sentence-valid? (sentence) ¶

Package

cl-conllu.

Source

data.lisp.

Function: simple-deprel (deprel) ¶

Package

cl-conllu.

Source

data.lisp.

Function: token-add-feature (token feat val) ¶

Package

cl-conllu.

Source

data.lisp.

Function: token-children (token sentence &key fn-filter) ¶

Package

cl-conllu.

Source

data.lisp.

Function: token-hash-features (token) ¶

Package

cl-conllu.

Source

data.lisp.

Function: token-parent (token sentence) ¶

Package

cl-conllu.

Source

data.lisp.

Function: token-rem-feature (token feat) ¶

Package

cl-conllu.

Source

data.lisp.

Function: tree-sentence (sentence &key fields-or-function stream show-meta) ¶

Package

conllu.draw.

Source

draw.lisp.

Function: tree-sentence-by-id (path id) ¶

Package

conllu.draw.

Source

draw.lisp.

Function: write-conllu (sentences filename &key if-exists) ¶

Package

cl-conllu.

Source

read-write.lisp.

Function: write-conllu-to-stream (sentences &optional out) ¶

Package

cl-conllu.

Source

read-write.lisp.

Function: write-sentence-tag-suffix-to-stream (sentence &key stream tag separator) ¶

Writes sentence as CoNLL-U file in STREAM as FORM.SEPARATOR.TAGVALUE (without
dots), followed by a whitespace character.

If TAG is NIL, then writes only FORMs, followed by a whitespace character.

Example:
;; supposing sentence already defined
(write-sentence-tag-suffix-to-stream (sentence :tag ’xpostag :separator "_")) Pierre_NNP Vinken_NNP ,_, 61_CD years_NNS old_JJ ,_, will_MD join_VB the_DT board_NN as_IN a_DT nonexecutive_JJ director_NN Nov._NNP 29_CD ._.
=> NIL

Package

conllu.converters.tags.

Source

tag-converter.lisp.

Function: write-sentences-tag-suffix (sentences filename &key tag separator if-exists) ¶

See documentation for write-sentence-tag-suffix-to-stream

Package

conllu.converters.tags.

Source

tag-converter.lisp.

Function: write-sentences-tag-suffix-to-stream (sentences &key stream tag separator) ¶

See documentation for write-sentence-tag-suffix-to-stream

Package

conllu.converters.tags.

Source

tag-converter.lisp.

---

5.1.3 Generic functions

Generic Reader: confusion-matrix-corpus-id (object) ¶

Generic Writer: (setf confusion-matrix-corpus-id) (object) ¶

Package

conllu.evaluate.

Methods

Reader Method: confusion-matrix-corpus-id ((confusion-matrix confusion-matrix)) ¶

Writer Method: (setf confusion-matrix-corpus-id) ((confusion-matrix confusion-matrix)) ¶

Identifier of the corpus or experiment.

Source

confusion-matrix.lisp.

Target Slot

corpus-id.

Generic Function: format-html (object) ¶

Outputs a HTML string for the object.

Package

conllu.html.

Source

html.lisp.

Methods

Method: format-html ((cm confusion-matrix)) ¶

Generic Reader: mtoken-end (object) ¶

Package

cl-conllu.

Methods

Reader Method: mtoken-end ((mtoken mtoken)) ¶

automatically generated reader method

Source

data.lisp.

Target Slot

end.

Generic Writer: (setf mtoken-end) (object) ¶

Package

cl-conllu.

Methods

Writer Method: (setf mtoken-end) ((mtoken mtoken)) ¶

automatically generated writer method

Source

data.lisp.

Target Slot

end.

Generic Reader: mtoken-start (object) ¶

Package

cl-conllu.

Methods

Reader Method: mtoken-start ((mtoken mtoken)) ¶

automatically generated reader method

Source

data.lisp.

Target Slot

start.

Generic Writer: (setf mtoken-start) (object) ¶

Package

cl-conllu.

Methods

Writer Method: (setf mtoken-start) ((mtoken mtoken)) ¶

automatically generated writer method

Source

data.lisp.

Target Slot

start.

Generic Reader: sentence-meta (object) ¶

Package

cl-conllu.

Methods

Reader Method: sentence-meta ((sentence sentence)) ¶

automatically generated reader method

Source

data.lisp.

Target Slot

meta.

Generic Writer: (setf sentence-meta) (object) ¶

Package

cl-conllu.

Methods

Writer Method: (setf sentence-meta) ((sentence sentence)) ¶

automatically generated writer method

Source

data.lisp.

Target Slot

meta.

Generic Reader: sentence-mtokens (object) ¶

Package

cl-conllu.

Methods

Reader Method: sentence-mtokens ((sentence sentence)) ¶

automatically generated reader method

Source

data.lisp.

Target Slot

mtokens.

Generic Writer: (setf sentence-mtokens) (object) ¶

Package

cl-conllu.

Methods

Writer Method: (setf sentence-mtokens) ((sentence sentence)) ¶

automatically generated writer method

Source

data.lisp.

Target Slot

mtokens.

Generic Reader: sentence-start (object) ¶

Package

cl-conllu.

Methods

Reader Method: sentence-start ((sentence sentence)) ¶

automatically generated reader method

Source

data.lisp.

Target Slot

start.

Generic Writer: (setf sentence-start) (object) ¶

Package

cl-conllu.

Methods

Writer Method: (setf sentence-start) ((sentence sentence)) ¶

automatically generated writer method

Source

data.lisp.

Target Slot

start.

Generic Reader: sentence-tokens (object) ¶

Package

cl-conllu.

Methods

Reader Method: sentence-tokens ((sentence sentence)) ¶

automatically generated reader method

Source

data.lisp.

Target Slot

tokens.

Generic Writer: (setf sentence-tokens) (object) ¶

Package

cl-conllu.

Methods

Writer Method: (setf sentence-tokens) ((sentence sentence)) ¶

automatically generated writer method

Source

data.lisp.

Target Slot

tokens.

Generic Reader: token-cfrom (object) ¶

Package

cl-conllu.

Methods

Reader Method: token-cfrom ((abstract-token abstract-token)) ¶

automatically generated reader method

Source

data.lisp.

Target Slot

cfrom.

Generic Writer: (setf token-cfrom) (object) ¶

Package

cl-conllu.

Methods

Writer Method: (setf token-cfrom) ((abstract-token abstract-token)) ¶

automatically generated writer method

Source

data.lisp.

Target Slot

cfrom.

Generic Reader: token-cto (object) ¶

Package

cl-conllu.

Methods

Reader Method: token-cto ((abstract-token abstract-token)) ¶

automatically generated reader method

Source

data.lisp.

Target Slot

cto.

Generic Writer: (setf token-cto) (object) ¶

Package

cl-conllu.

Methods

Writer Method: (setf token-cto) ((abstract-token abstract-token)) ¶

automatically generated writer method

Source

data.lisp.

Target Slot

cto.

Generic Reader: token-deprel (object) ¶

Package

cl-conllu.

Methods

Reader Method: token-deprel ((token token)) ¶

automatically generated reader method

Source

data.lisp.

Target Slot

deprel.

Generic Writer: (setf token-deprel) (object) ¶

Package

cl-conllu.

Methods

Writer Method: (setf token-deprel) ((token token)) ¶

automatically generated writer method

Source

data.lisp.

Target Slot

deprel.

Generic Reader: token-deps (object) ¶

Package

cl-conllu.

Methods

Reader Method: token-deps ((token token)) ¶

automatically generated reader method

Source

data.lisp.

Target Slot

deps.

Generic Writer: (setf token-deps) (object) ¶

Package

cl-conllu.

Methods

Writer Method: (setf token-deps) ((token token)) ¶

automatically generated writer method

Source

data.lisp.

Target Slot

deps.

Generic Reader: token-feats (object) ¶

Package

cl-conllu.

Methods

Reader Method: token-feats ((token token)) ¶

automatically generated reader method

Source

data.lisp.

Target Slot

feats.

Generic Writer: (setf token-feats) (object) ¶

Package

cl-conllu.

Methods

Writer Method: (setf token-feats) ((token token)) ¶

automatically generated writer method

Source

data.lisp.

Target Slot

feats.

Generic Reader: token-form (object) ¶

Package

cl-conllu.

Methods

Reader Method: token-form ((abstract-token abstract-token)) ¶

automatically generated reader method

Source

data.lisp.

Target Slot

form.

Generic Writer: (setf token-form) (object) ¶

Package

cl-conllu.

Methods

Writer Method: (setf token-form) ((abstract-token abstract-token)) ¶

automatically generated writer method

Source

data.lisp.

Target Slot

form.

Generic Reader: token-head (object) ¶

Package

cl-conllu.

Methods

Reader Method: token-head ((token token)) ¶

automatically generated reader method

Source

data.lisp.

Target Slot

head.

Generic Writer: (setf token-head) (object) ¶

Package

cl-conllu.

Methods

Writer Method: (setf token-head) ((token token)) ¶

automatically generated writer method

Source

data.lisp.

Target Slot

head.

Generic Reader: token-id (object) ¶

Package

cl-conllu.

Methods

Reader Method: token-id ((token token)) ¶

automatically generated reader method

Source

data.lisp.

Target Slot

id.

Generic Writer: (setf token-id) (object) ¶

Package

cl-conllu.

Methods

Writer Method: (setf token-id) ((token token)) ¶

automatically generated writer method

Source

data.lisp.

Target Slot

id.

Generic Reader: token-lemma (object) ¶

Package

cl-conllu.

Methods

Reader Method: token-lemma ((token token)) ¶

automatically generated reader method

Source

data.lisp.

Target Slot

lemma.

Generic Writer: (setf token-lemma) (object) ¶

Package

cl-conllu.

Methods

Writer Method: (setf token-lemma) ((token token)) ¶

automatically generated writer method

Source

data.lisp.

Target Slot

lemma.

Generic Reader: token-misc (object) ¶

Package

cl-conllu.

Methods

Reader Method: token-misc ((abstract-token abstract-token)) ¶

automatically generated reader method

Source

data.lisp.

Target Slot

misc.

Generic Writer: (setf token-misc) (object) ¶

Package

cl-conllu.

Methods

Writer Method: (setf token-misc) ((abstract-token abstract-token)) ¶

automatically generated writer method

Source

data.lisp.

Target Slot

misc.

Generic Reader: token-sentence (object) ¶

Package

cl-conllu.

Methods

Reader Method: token-sentence ((abstract-token abstract-token)) ¶

automatically generated reader method

Source

data.lisp.

Target Slot

sentence.

Generic Writer: (setf token-sentence) (object) ¶

Package

cl-conllu.

Methods

Writer Method: (setf token-sentence) ((abstract-token abstract-token)) ¶

automatically generated writer method

Source

data.lisp.

Target Slot

sentence.

Generic Reader: token-upostag (object) ¶

Package

cl-conllu.

Methods

Reader Method: token-upostag ((token token)) ¶

automatically generated reader method

Source

data.lisp.

Target Slot

upostag.

Generic Writer: (setf token-upostag) (object) ¶

Package

cl-conllu.

Methods

Writer Method: (setf token-upostag) ((token token)) ¶

automatically generated writer method

Source

data.lisp.

Target Slot

upostag.

Generic Reader: token-xpostag (object) ¶

Package

cl-conllu.

Methods

Reader Method: token-xpostag ((token token)) ¶

automatically generated reader method

Source

data.lisp.

Target Slot

xpostag.

Generic Writer: (setf token-xpostag) (object) ¶

Package

cl-conllu.

Methods

Writer Method: (setf token-xpostag) ((token token)) ¶

automatically generated writer method

Source

data.lisp.

Target Slot

xpostag.

---

5.1.4 Standalone methods

Method: encode ((sentence sentence) &optional stream) ¶

Package

yason.

Source

read-write.lisp.

Method: encode ((token token) &optional stream) ¶

Package

yason.

Source

read-write.lisp.

Method: initialize-instance :after ((obj confusion-matrix) &key &allow-other-keys) ¶

Source

confusion-matrix.lisp.

Method: initialize-instance :after ((obj sentence) &key tokens &allow-other-keys) ¶

Sets the TOKEN-SENTENCE slot for each token attributed to the initialize sentence OBJ.

Source

data.lisp.

Method: print-object ((obj confusion-matrix) out) ¶

Source

confusion-matrix.lisp.

Method: print-object ((obj sentence) out) ¶

Source

data.lisp.

Method: print-object ((obj token) out) ¶

Source

data.lisp.

---

5.1.5 Classes

Class: confusion-matrix ¶

Package

conllu.evaluate.

Source

confusion-matrix.lisp.

Direct methods

• (setf confusion-matrix-corpus-id).
• confusion-matrix-corpus-id.
• (setf confusion-matrix-key-fn).
• confusion-matrix-key-fn.
• (setf confusion-matrix-rows).
• confusion-matrix-rows.
• (setf confusion-matrix-sort-fn).
• confusion-matrix-sort-fn.
• (setf confusion-matrix-test-fn).
• confusion-matrix-test-fn.
• format-html.
• initialize-instance.
• print-object.

Direct slots

Slot: corpus-id ¶

Identifier of the corpus or experiment.

Initargs

:corpus-id

Readers

confusion-matrix-corpus-id.

Writers

(setf confusion-matrix-corpus-id).

Slot: key-fn ¶

Function used to label each token.

Initform

(function cl-conllu:token-upostag)

Initargs

:key-fn

Readers

confusion-matrix-key-fn.

Writers

(setf confusion-matrix-key-fn).

Slot: test-fn ¶

Function which compares two labels. Typically a form of equality.

Initform

(function equal)

Initargs

:test-fn

Readers

confusion-matrix-test-fn.

Writers

(setf confusion-matrix-test-fn).

Slot: sort-fn ¶

Function which sorts labels. By default,
converts labels to string and uses lexicographical order

Initform

(function (lambda (conllu.evaluate::x conllu.evaluate::y) (string<= (format nil "~a" conllu.evaluate::x) (format nil "~a" conllu.evaluate::y))))

Initargs

:sort-fn

Readers

confusion-matrix-sort-fn.

Writers

(setf confusion-matrix-sort-fn).

Slot: rows ¶

Parameter which contains the contents of the confusion matrix.

Readers

confusion-matrix-rows.

Writers

(setf confusion-matrix-rows).

Class: mtoken ¶

Package

cl-conllu.

Source

data.lisp.

Direct superclasses

abstract-token.

Direct methods

• (setf mtoken-end).
• mtoken-end.
• (setf mtoken-start).
• mtoken-start.
• write-token.

Direct slots

Slot: start ¶

Initargs

:start

Readers

mtoken-start.

Writers

(setf mtoken-start).

Slot: end ¶

Initargs

:end

Readers

mtoken-end.

Writers

(setf mtoken-end).

Class: sentence ¶

Package

cl-conllu.

Source

data.lisp.

Direct methods

• encode.
• initialize-instance.
• print-object.
• (setf sentence-etokens).
• sentence-etokens.
• (setf sentence-meta).
• sentence-meta.
• (setf sentence-mtokens).
• sentence-mtokens.
• (setf sentence-start).
• sentence-start.
• (setf sentence-tokens).
• sentence-tokens.

Direct slots

Slot: start ¶

Initform

0

Initargs

:start

Readers

sentence-start.

Writers

(setf sentence-start).

Slot: meta ¶

Initargs

:meta

Readers

sentence-meta.

Writers

(setf sentence-meta).

Slot: tokens ¶

Initargs

:tokens

Readers

sentence-tokens.

Writers

(setf sentence-tokens).

Slot: mtokens ¶

Initargs

:mtokens

Readers

sentence-mtokens.

Writers

(setf sentence-mtokens).

Slot: etokens ¶

Initargs

:etokens

Readers

sentence-etokens.

Writers

(setf sentence-etokens).

Class: token ¶

Package

cl-conllu.

Source

data.lisp.

Direct superclasses

abstract-token.

Direct methods

• encode.
• print-object.
• (setf token-deprel).
• token-deprel.
• (setf token-deps).
• token-deps.
• (setf token-feats).
• token-feats.
• (setf token-head).
• token-head.
• (setf token-id).
• token-id.
• (setf token-lemma).
• token-lemma.
• (setf token-upostag).
• token-upostag.
• (setf token-xpostag).
• token-xpostag.
• write-token.

Direct slots

Slot: id ¶

Initargs

:id

Readers

token-id.

Writers

(setf token-id).

Slot: lemma ¶

Initargs

:lemma

Readers

token-lemma.

Writers

(setf token-lemma).

Slot: upostag ¶

Initform

"_"

Initargs

:upostag

Readers

token-upostag.

Writers

(setf token-upostag).

Slot: xpostag ¶

Initform

"_"

Initargs

:xpostag

Readers

token-xpostag.

Writers

(setf token-xpostag).

Slot: feats ¶

Initform

"_"

Initargs

:feats

Readers

token-feats.

Writers

(setf token-feats).

Slot: head ¶

Initform

"_"

Initargs

:head

Readers

token-head.

Writers

(setf token-head).

Slot: deprel ¶

Initform

"_"

Initargs

:deprel

Readers

token-deprel.

Writers

(setf token-deprel).

Slot: deps ¶

Initform

"_"

Initargs

:deps

Readers

token-deps.

Writers

(setf token-deps).

---