The cl-conllu Reference Manual

Table of Contents

The cl-conllu Reference Manual

This is the cl-conllu Reference Manual, version 0.13, generated automatically by Declt version 3.0 "Montgomery Scott" on Mon Apr 19 14:38:01 2021 GMT+0.

1 Introduction

#+title: Library for working with CoNLL-U files with CL

The =cl-conllu= is a Common Lisp library to work with [[http://universaldependencies.org/format.html][CoNLL-U]],
licensed under the [[http://www.apache.org/licenses/LICENSE-2.0][Apache license]].

It is developed and tested with SBCL but should probably run with any
other implementation.

* Install

The =cl-conllu= library is now available from quicklisp distribution,
if you are not planning to change the code, just use:

#+BEGIN_SRC lisp
(ql:quickload :cl-conllu)
#+END_SRC

If you don't have quicklisp installed already, follow [[https://www.quicklisp.org/beta/#installation][these steps]].

If you plan on contributing, clone this project to your
=local-projects= quicklisp directory (usually at
=~/quicklisp/local-projects/=) and use the same command as above to
load the code.

* Documentation

See the https://github.com/own-pt/cl-conllu/wiki

* How to cite

http://arademaker.github.io/bibliography/tilic-stil-2017.html

#+BEGIN_EXAMPLE
@inproceedings{tilic-stil-2017,
  author = {Muniz, Henrique and Chalub, Fabricio and Rademaker, Alexandre},
  title = {CL-CONLLU: dependências universais em Common Lisp},
  booktitle = {V Workshop de Iniciação Científica em Tecnologia da
                    Informação e da Linguagem Humana (TILic)},
  year = {2017},
  address = {Uberlândia, MG, Brazil},
  note = {https://sites.google.com/view/tilic2017/}
}
#+END_EXAMPLE

2 Systems

The main system appears first, followed by any subsystem dependency.

2.1 cl-conllu

Author

Alexandre Rademaker <alexrad@br.ibm.com>

License

Apache 2.0

Description

Common Lisp library for dealing with CoNLL-U files

Long Description

This library provides a set of functions to work with CoNLL-U files. See https://universaldependencies.org/format.html for details about the CoNLL-U format adopted by the Universal Dependencies community. The library has functions for read/write files, apply rules for sentences transformation in batch mode, tree visualization, compare and evaluation trees etc. Documentation available in https://github.com/own-pt/cl-conllu/wiki.

Version

0.13

Dependencies

• cl-ppcre
• uuid
• alexandria
• cl-log
• split-sequence
• xmls
• yason
• lispbuilder-lexer
• wilbur
• cl-markup
• optima.ppcre

Source

cl-conllu.asd (file)

Components

• packages.lisp (file)
• data.lisp (file)
• read-write.lisp (file)
• evaluate.lisp (file)
• confusion-matrix.lisp (file)
• html.lisp (file)
• query.lisp (file)
• utils.lisp (file)
• projective.lisp (file)
• rdf.lisp (file)
• rdf-wilbur.lisp (file)
• command-line.lisp (file)
• rules.lisp (file)
• editor.lisp (file)
• conllu-prolog.lisp (file)
• niceline.lisp (file)
• tag-converter.lisp (file)
• draw.lisp (file)

3 Files

Files are sorted by type and then listed depth-first from the systems components trees.

3.1 Lisp

3.1.1 cl-conllu.asd

Location

cl-conllu.asd

Systems

cl-conllu (system)

3.1.2 cl-conllu/packages.lisp

Parent

cl-conllu (system)

Location

packages.lisp

Packages

• conllu.html
• cl-conllu
• conllu.rules
• conllu.converters.tags
• conllu.editor
• conllu.converters.niceline
• conllu.draw
• conllu.rdf
• conllu.evaluate
• conllu.user
• conllu.prolog

3.1.3 cl-conllu/data.lisp

Dependency

packages.lisp (file)

Parent

cl-conllu (system)

Location

data.lisp

Exported Definitions

• adjust-sentence (function)
• mtoken (class)
• mtoken-end (method)
• (setf mtoken-end) (method)
• mtoken-start (method)
• (setf mtoken-start) (method)
• sentence (class)
• sentence->text (function)
• sentence-binary-tree (function)
• sentence-equal (function)
• sentence-fill-offsets (function)
• sentence-hash-table (function)
• sentence-id (function)
• sentence-meta (method)
• (setf sentence-meta) (method)
• sentence-meta-value (function)
• sentence-mtokens (method)
• (setf sentence-mtokens) (method)
• sentence-root (function)
• sentence-size (function)
• sentence-start (method)
• (setf sentence-start) (method)
• sentence-text (function)
• sentence-tokens (method)
• (setf sentence-tokens) (method)
• sentence-valid? (function)
• simple-deprel (function)
• token (class)
• token-cfrom (method)
• (setf token-cfrom) (method)
• token-children (function)
• token-cto (method)
• (setf token-cto) (method)
• token-deprel (method)
• (setf token-deprel) (method)
• token-deps (method)
• (setf token-deps) (method)
• token-feats (method)
• (setf token-feats) (method)
• token-form (method)
• (setf token-form) (method)
• token-head (method)
• (setf token-head) (method)
• token-id (method)
• (setf token-id) (method)
• token-lemma (method)
• (setf token-lemma) (method)
• token-misc (method)
• (setf token-misc) (method)
• token-sentence (method)
• (setf token-sentence) (method)
• token-upostag (method)
• (setf token-upostag) (method)
• token-xpostag (method)
• (setf token-xpostag) (method)

Internal Definitions

• *token-fields* (special variable)
• abstract-token (class)
• etoken (class)
• etoken-deps (method)
• (setf etoken-deps) (method)
• etoken-feats (method)
• (setf etoken-feats) (method)
• etoken-index (method)
• (setf etoken-index) (method)
• etoken-lemma (method)
• (setf etoken-lemma) (method)
• etoken-prev (method)
• (setf etoken-prev) (method)
• etoken-upostag (method)
• (setf etoken-upostag) (method)
• etoken-xpostag (method)
• (setf etoken-xpostag) (method)
• is-descendant? (function)
• mtoken-equal (function)
• sentence-by-id (function)
• sentence-etokens (method)
• (setf sentence-etokens) (method)
• sentence-get-token-by-id (function)
• sentence-matrix (function)
• set-head (function)
• token-attached (function)
• token-equal (function)
• token-lineno (method)
• (setf token-lineno) (method)
• token-misc-value (function)
• token-parent (function)

3.1.4 cl-conllu/read-write.lisp

Dependency

data.lisp (file)

Parent

cl-conllu (system)

Location

read-write.lisp

Exported Definitions

• lazy-stream-reader (function)
• make-sentence (function)
• read-conllu (function)
• read-directory (function)
• read-file (function)
• read-stream (function)
• write-conllu (function)
• write-conllu-to-stream (function)

Internal Definitions

• collect-meta (function)
• line->token (function)
• malformed-field (condition)
• malformed-line (condition)
• parse-field (function)
• write-sentence (function)
• write-token (generic function)
• write-token (method)
• write-token (method)
• write-token (method)

3.1.5 cl-conllu/evaluate.lisp

Dependencies

• data.lisp (file)
• read-write.lisp (file)

Parent

cl-conllu (system)

Location

evaluate.lisp

Exported Definitions

• attachment-score-by-sentence (function)
• attachment-score-by-word (function)
• exact-match (function)
• exact-match-score (function)
• non-projectivity-accuracy (function)
• non-projectivity-precision (function)
• non-projectivity-recall (function)
• precision (function)
• recall (function)

Internal Definitions

• *deprel-value-list* (special variable)
• *token-fields* (special variable)
• exact-match-sentence (function)
• sentence-average-score (function)
• sentence-diff (function)
• token-diff (function)
• word-average-score (function)

3.1.6 cl-conllu/confusion-matrix.lisp

Dependencies

• data.lisp (file)
• evaluate.lisp (file)

Parent

cl-conllu (system)

Location

confusion-matrix.lisp

Exported Definitions

• confusion-matrix (class)
• confusion-matrix-cell-count (function)
• confusion-matrix-cell-tokens (function)
• confusion-matrix-cells-labels (function)
• confusion-matrix-columns-labels (function)
• confusion-matrix-corpus-id (method)
• (setf confusion-matrix-corpus-id) (method)
• confusion-matrix-labels (function)
• confusion-matrix-normalize (function)
• confusion-matrix-rows-labels (function)
• confusion-matrix-update (function)
• make-confusion-matrix (function)

Internal Definitions

• confusion-matrix-copy (function)
• confusion-matrix-key-fn (method)
• (setf confusion-matrix-key-fn) (method)
• confusion-matrix-rows (method)
• (setf confusion-matrix-rows) (method)
• confusion-matrix-sort-fn (method)
• (setf confusion-matrix-sort-fn) (method)
• confusion-matrix-test-fn (method)
• (setf confusion-matrix-test-fn) (method)
• confusion-matrix-update-sentences (function)
• confusion-matrix-update-tokens (function)
• create-cell (function)
• existing-cell-p (function)
• insert-entry-confusion-matrix (function)

3.1.7 cl-conllu/html.lisp

Dependencies

• data.lisp (file)
• confusion-matrix.lisp (file)

Parent

cl-conllu (system)

Location

html.lisp

Exported Definitions

• *confusion-matrix-style* (special variable)
• format-html (generic function)
• format-html (method)

Internal Definitions

• write-columns-headers (function)
• write-rows (function)

3.1.8 cl-conllu/query.lisp

Dependencies

• data.lisp (file)
• html.lisp (file)

Parent

cl-conllu (system)

Location

query.lisp

Exported Definitions

• query (function)
• query-as-json (function)

Internal Definitions

• *deprels* (special variable)
• and% (function)
• children (function)
• eval-query (function)
• or% (function)
• r~ (function)
• t~ (function)

3.1.9 cl-conllu/utils.lisp

Dependencies

• data.lisp (file)
• query.lisp (file)

Parent

cl-conllu (system)

Location

utils.lisp

Exported Definitions

• diff (function)
• levenshtein (function)

Internal Definitions

• blank-line? (function)
• find-min (function)
• insert-at (function)
• mappend (function)
• print-diff (function)
• range (function)

3.1.10 cl-conllu/projective.lisp

Dependency

utils.lisp (file)

Parent

cl-conllu (system)

Location

projective.lisp

Internal Definitions

• get-projection (function)
• is-sentence-projective (function)
• is-token-projective (function)
• non-projective-punct (function)

3.1.11 cl-conllu/rdf.lisp

Dependencies

• data.lisp (file)
• projective.lisp (file)

Parent

cl-conllu (system)

Location

rdf.lisp

Exported Definitions

• convert-rdf (function)
• convert-rdf-file (function)

Internal Definitions

• components->string (function)
• convert-sentence-to-turtle (function)
• escape-string (function)
• escape-turtle-char (function)
• make-dep (function)
• make-featurename (function)
• make-features (function)
• make-features-bnode (function)
• make-literal (function)
• make-metadata (function)
• make-metadata-bnode (function)
• make-token-id (function)
• make-upos (function)
• unspecified-field? (function)

3.1.12 cl-conllu/rdf-wilbur.lisp

Dependencies

• data.lisp (file)
• rdf.lisp (file)

Parent

cl-conllu (system)

Location

rdf-wilbur.lisp

Exported Definitions

convert-to-rdf (function)

Internal Definitions

• convert-features-to-rdf (function)
• convert-sentence-metadata (function)
• convert-sentence-to-rdf (function)
• convert-token-to-rdf (function)

3.1.13 cl-conllu/command-line.lisp

Dependencies

• data.lisp (file)
• rdf-wilbur.lisp (file)

Parent

cl-conllu (system)

Location

command-line.lisp

Internal Definitions

• adjust-conllu (function)
• draw-conllu (function)
• modify-conllu (function)
• select-sentence (function)
• write-selected-sentence (function)

3.1.14 cl-conllu/rules.lisp

Dependencies

• utils.lisp (file)
• data.lisp (file)
• command-line.lisp (file)

Parent

cl-conllu (system)

Location

rules.lisp

Exported Definitions

• apply-rules (function)
• apply-rules-from-files (function)

Internal Definitions

• add-value (function)
• apply-changes (function)
• apply-conditions-in-token (function)
• apply-rhs (function)
• apply-rule-in-sentence (function)
• apply-rule-in-tokens (function)
• apply-rules-in-sentence (function)
• apply-rules-in-sentence-aux (function)
• equal-op (function)
• intern-pattern (function)
• intern-rule (function)
• intern-sides (function)
• match-token (function)
• match? (function)
• member-op (function)
• modify-value (function)
• read-rules (function)
• regex-op (function)
• rhs (function)
• rhs-vars (function)
• rls (function)
• rls-vars (function)
• valid-vars (function)
• variable-p (function)

3.1.15 cl-conllu/editor.lisp

Dependencies

• utils.lisp (file)
• data.lisp (file)
• rules.lisp (file)

Parent

cl-conllu (system)

Location

editor.lisp

Exported Definitions

conlluedit (function)

Internal Definitions

• action (function)
• actions (function)
• add-or-subt (function)
• apply-act (function)
• apply-rule (function)
• apply-rules (function)
• assocs (function)
• clear (function)
• def-match (function)
• definitions (function)
• defs-tests (function)
• error-test (macro)
• examine-acts (function)
• get-field-value (function)
• index (method)
• join-matchs (function)
• malformed-rule (condition)
• match-test (function)
• merge-matchs (function)
• merge-sets (function)
• multiple-merges (function)
• node-matchs (function)
• normalize-shortcut (function)
• rel-match (function)
• relation (function)
• relation-test (function)
• relations (function)
• result-act (function)
• result-acts (function)
• result-set (function)
• result-sets (function)
• sets (function)
• test-feats&misc (function)
• token-matchs (function)

3.1.16 cl-conllu/conllu-prolog.lisp

Dependencies

• data.lisp (file)
• editor.lisp (file)

Parent

cl-conllu (system)

Location

conllu-prolog.lisp

Exported Definitions

convert-filename (function)

Internal Definitions

• *clauses* (special variable)
• *dependencies* (special variable)
• clean-dep-rel (function)
• clean-whitespace (function)
• emit-prolog (function)
• is-root (function)
• make-id (function)
• process-features (function)
• process-tokens (function)
• prolog-string (function)
• toprologid (function)
• valid-line (function)
• write-prolog (function)

3.1.17 cl-conllu/niceline.lisp

Dependencies

• data.lisp (file)
• conllu-prolog.lisp (file)

Parent

cl-conllu (system)

Location

niceline.lisp

Internal Definitions

• add-field-value (function)
• consume-tags (function)
• convert-directory (function)
• malformed-line (method)
• malformed-line-error (condition)
• niceline (function)
• niceline-matcher (special variable)
• read-niceline (function)
• read-niceline-file (function)
• read-niceline-stream (function)

3.1.18 cl-conllu/tag-converter.lisp

Dependencies

• data.lisp (file)
• niceline.lisp (file)

Parent

cl-conllu (system)

Location

tag-converter.lisp

Exported Definitions

• read-file-tag-suffix (function)
• read-sentence-tag-suffix (function)
• write-sentence-tag-suffix-to-stream (function)
• write-sentences-tag-suffix (function)
• write-sentences-tag-suffix-to-stream (function)

Internal Definitions

write-token-tag-suffix (function)

3.1.19 cl-conllu/draw.lisp

Dependencies

• data.lisp (file)
• tag-converter.lisp (file)

Parent

cl-conllu (system)

Location

draw.lisp

Exported Definitions

• tree-sentence (function)
• tree-sentence-by-id (function)

Internal Definitions

• adopted-unfinished? (function)
• get-data (function)
• get-kids (function)
• get-stroke-size (function)
• make-tree (function)
• make-twigs (function)
• update-lines (function)

4 Packages

Packages are listed by definition order.

4.1 conllu.html

Functions for producing html formatting of objects in the library.

Source

packages.lisp (file)

Use List

• cl-conllu
• common-lisp

Exported Definitions

• *confusion-matrix-style* (special variable)
• format-html (generic function)
• format-html (method)

Internal Definitions

• write-columns-headers (function)
• write-rows (function)

4.2 cl-conllu

Source

packages.lisp (file)

Use List

• com.ravenbrook.common-lisp-log
• split-sequence
• cl-ppcre
• common-lisp

Used By List

• conllu.user
• conllu.html
• conllu.evaluate
• conllu.editor
• conllu.rules
• conllu.draw
• conllu.converters.tags
• conllu.converters.niceline
• conllu.rdf
• conllu.prolog

Exported Definitions

• adjust-sentence (function)
• convert-rdf (function)
• convert-rdf-file (function)
• convert-to-rdf (function)
• diff (function)
• lazy-stream-reader (function)
• levenshtein (function)
• make-sentence (function)
• mtoken (class)
• mtoken-end (generic function)
• mtoken-end (method)
• (setf mtoken-end) (method)
• (setf mtoken-end) (generic function)
• mtoken-start (generic function)
• mtoken-start (method)
• (setf mtoken-start) (method)
• (setf mtoken-start) (generic function)
• query (function)
• query-as-json (function)
• read-conllu (function)
• read-directory (function)
• read-file (function)
• read-stream (function)
• sentence (class)
• sentence->text (function)
• sentence-binary-tree (function)
• sentence-equal (function)
• sentence-fill-offsets (function)
• sentence-hash-table (function)
• sentence-id (function)
• sentence-meta (generic function)
• sentence-meta (method)
• (setf sentence-meta) (method)
• (setf sentence-meta) (generic function)
• sentence-meta-value (function)
• sentence-mtokens (generic function)
• sentence-mtokens (method)
• (setf sentence-mtokens) (method)
• (setf sentence-mtokens) (generic function)
• sentence-root (function)
• sentence-size (function)
• sentence-start (generic function)
• sentence-start (method)
• (setf sentence-start) (method)
• (setf sentence-start) (generic function)
• sentence-text (function)
• sentence-tokens (generic function)
• sentence-tokens (method)
• (setf sentence-tokens) (method)
• (setf sentence-tokens) (generic function)
• sentence-valid? (function)
• simple-deprel (function)
• token (class)
• token-cfrom (generic function)
• token-cfrom (method)
• (setf token-cfrom) (method)
• (setf token-cfrom) (generic function)
• token-children (function)
• token-cto (generic function)
• token-cto (method)
• (setf token-cto) (method)
• (setf token-cto) (generic function)
• token-deprel (generic function)
• token-deprel (method)
• (setf token-deprel) (method)
• (setf token-deprel) (generic function)
• token-deps (generic function)
• token-deps (method)
• (setf token-deps) (method)
• (setf token-deps) (generic function)
• token-feats (generic function)
• token-feats (method)
• (setf token-feats) (method)
• (setf token-feats) (generic function)
• token-form (generic function)
• token-form (method)
• (setf token-form) (method)
• (setf token-form) (generic function)
• token-head (generic function)
• token-head (method)
• (setf token-head) (method)
• (setf token-head) (generic function)
• token-id (generic function)
• token-id (method)
• (setf token-id) (method)
• (setf token-id) (generic function)
• token-lemma (generic function)
• token-lemma (method)
• (setf token-lemma) (method)
• (setf token-lemma) (generic function)
• token-misc (generic function)
• token-misc (method)
• (setf token-misc) (method)
• (setf token-misc) (generic function)
• token-sentence (generic function)
• token-sentence (method)
• (setf token-sentence) (method)
• (setf token-sentence) (generic function)
• token-upostag (generic function)
• token-upostag (method)
• (setf token-upostag) (method)
• (setf token-upostag) (generic function)
• token-xpostag (generic function)
• token-xpostag (method)
• (setf token-xpostag) (method)
• (setf token-xpostag) (generic function)
• write-conllu (function)
• write-conllu-to-stream (function)

Internal Definitions

• *deprels* (special variable)
• *token-fields* (special variable)
• abstract-token (class)
• adjust-conllu (function)
• and% (function)
• blank-line? (function)
• children (function)
• collect-meta (function)
• draw-conllu (function)
• etoken (class)
• etoken-deps (generic function)
• etoken-deps (method)
• (setf etoken-deps) (method)
• (setf etoken-deps) (generic function)
• etoken-feats (generic function)
• etoken-feats (method)
• (setf etoken-feats) (method)
• (setf etoken-feats) (generic function)
• etoken-index (generic function)
• etoken-index (method)
• (setf etoken-index) (method)
• (setf etoken-index) (generic function)
• etoken-lemma (generic function)
• etoken-lemma (method)
• (setf etoken-lemma) (method)
• (setf etoken-lemma) (generic function)
• etoken-prev (generic function)
• etoken-prev (method)
• (setf etoken-prev) (method)
• (setf etoken-prev) (generic function)
• etoken-upostag (generic function)
• etoken-upostag (method)
• (setf etoken-upostag) (method)
• (setf etoken-upostag) (generic function)
• etoken-xpostag (generic function)
• etoken-xpostag (method)
• (setf etoken-xpostag) (method)
• (setf etoken-xpostag) (generic function)
• eval-query (function)
• find-min (function)
• get-projection (function)
• insert-at (function)
• is-descendant? (function)
• is-sentence-projective (function)
• is-token-projective (function)
• line->token (function)
• malformed-field (condition)
• malformed-line (condition)
• mappend (function)
• modify-conllu (function)
• mtoken-equal (function)
• non-projective-punct (function)
• or% (function)
• parse-field (function)
• print-diff (function)
• range (function)
• r~ (function)
• select-sentence (function)
• sentence-by-id (function)
• sentence-etokens (generic function)
• sentence-etokens (method)
• (setf sentence-etokens) (method)
• (setf sentence-etokens) (generic function)
• sentence-get-token-by-id (function)
• sentence-matrix (function)
• set-head (function)
• token-attached (function)
• token-equal (function)
• token-lineno (generic function)
• token-lineno (method)
• (setf token-lineno) (method)
• (setf token-lineno) (generic function)
• token-misc-value (function)
• token-parent (function)
• t~ (function)
• write-selected-sentence (function)
• write-sentence (function)
• write-token (generic function)
• write-token (method)
• write-token (method)
• write-token (method)

4.3 conllu.rules

Source

packages.lisp (file)

Use List

• cl-conllu
• common-lisp

Exported Definitions

• apply-rules (function)
• apply-rules-from-files (function)

Internal Definitions

• add-value (function)
• apply-changes (function)
• apply-conditions-in-token (function)
• apply-rhs (function)
• apply-rule-in-sentence (function)
• apply-rule-in-tokens (function)
• apply-rules-in-sentence (function)
• apply-rules-in-sentence-aux (function)
• equal-op (function)
• intern-pattern (function)
• intern-rule (function)
• intern-sides (function)
• match-token (function)
• match? (function)
• member-op (function)
• modify-value (function)
• read-rules (function)
• regex-op (function)
• rhs (function)
• rhs-vars (function)
• rls (function)
• rls-vars (function)
• valid-vars (function)
• variable-p (function)

4.4 conllu.converters.tags

Source

packages.lisp (file)

Use List

• cl-ppcre
• cl-conllu
• common-lisp

Exported Definitions

• read-file-tag-suffix (function)
• read-sentence-tag-suffix (function)
• write-sentence-tag-suffix-to-stream (function)
• write-sentences-tag-suffix (function)
• write-sentences-tag-suffix-to-stream (function)

Internal Definitions

write-token-tag-suffix (function)

4.5 conllu.editor

ruled based transformations

Source

packages.lisp (file)

Use List

• cl-conllu
• common-lisp

Exported Definitions

conlluedit (function)

Internal Definitions

• action (function)
• actions (function)
• add-or-subt (function)
• apply-act (function)
• apply-rule (function)
• apply-rules (function)
• assocs (function)
• clear (function)
• def-match (function)
• definitions (function)
• defs-tests (function)
• error-test (macro)
• examine-acts (function)
• get-field-value (function)
• index (generic function)
• index (method)
• join-matchs (function)
• malformed-rule (condition)
• match-test (function)
• merge-matchs (function)
• merge-sets (function)
• multiple-merges (function)
• node-matchs (function)
• normalize-shortcut (function)
• rel-match (function)
• relation (function)
• relation-test (function)
• relations (function)
• result-act (function)
• result-acts (function)
• result-set (function)
• result-sets (function)
• sets (function)
• test-feats&misc (function)
• token-matchs (function)

4.6 conllu.converters.niceline

Source

packages.lisp (file)

Use List

• lispbuilder-lexer
• cl-conllu
• common-lisp

Internal Definitions

• add-field-value (function)
• consume-tags (function)
• convert-directory (function)
• malformed-line (generic function)
• malformed-line (method)
• malformed-line-error (condition)
• niceline (function)
• niceline-matcher (special variable)
• read-niceline (function)
• read-niceline-file (function)
• read-niceline-stream (function)

4.7 conllu.draw

Source

packages.lisp (file)

Use List

• cl-conllu
• common-lisp

Used By List

conllu.user

Exported Definitions

• tree-sentence (function)
• tree-sentence-by-id (function)

Internal Definitions

• adopted-unfinished? (function)
• get-data (function)
• get-kids (function)
• get-stroke-size (function)
• make-tree (function)
• make-twigs (function)
• update-lines (function)

4.8 conllu.rdf

Source

packages.lisp (file)

Use List

• split-sequence
• cl-conllu
• alexandria
• wilbur
• common-lisp

Internal Definitions

• components->string (function)
• convert-features-to-rdf (function)
• convert-sentence-metadata (function)
• convert-sentence-to-rdf (function)
• convert-sentence-to-turtle (function)
• convert-token-to-rdf (function)
• escape-string (function)
• escape-turtle-char (function)
• make-dep (function)
• make-featurename (function)
• make-features (function)
• make-features-bnode (function)
• make-literal (function)
• make-metadata (function)
• make-metadata-bnode (function)
• make-token-id (function)
• make-upos (function)
• unspecified-field? (function)

4.9 conllu.evaluate

Functions for evaluating datasets and parser outputs in the CoNLL-U format.

Source

packages.lisp (file)

Use List

• cl-conllu
• common-lisp

Exported Definitions

• attachment-score-by-sentence (function)
• attachment-score-by-word (function)
• confusion-matrix (class)
• confusion-matrix-cell-count (function)
• confusion-matrix-cell-tokens (function)
• confusion-matrix-cells-labels (function)
• confusion-matrix-columns-labels (function)
• confusion-matrix-corpus-id (generic function)
• confusion-matrix-corpus-id (method)
• (setf confusion-matrix-corpus-id) (method)
• (setf confusion-matrix-corpus-id) (generic function)
• confusion-matrix-labels (function)
• confusion-matrix-normalize (function)
• confusion-matrix-rows-labels (function)
• confusion-matrix-update (function)
• exact-match (function)
• exact-match-score (function)
• make-confusion-matrix (function)
• non-projectivity-accuracy (function)
• non-projectivity-precision (function)
• non-projectivity-recall (function)
• precision (function)
• recall (function)

Internal Definitions

• *deprel-value-list* (special variable)
• *token-fields* (special variable)
• confusion-matrix-copy (function)
• confusion-matrix-key-fn (generic function)
• confusion-matrix-key-fn (method)
• (setf confusion-matrix-key-fn) (method)
• (setf confusion-matrix-key-fn) (generic function)
• confusion-matrix-rows (generic function)
• confusion-matrix-rows (method)
• (setf confusion-matrix-rows) (method)
• (setf confusion-matrix-rows) (generic function)
• confusion-matrix-sort-fn (generic function)
• confusion-matrix-sort-fn (method)
• (setf confusion-matrix-sort-fn) (method)
• (setf confusion-matrix-sort-fn) (generic function)
• confusion-matrix-test-fn (generic function)
• confusion-matrix-test-fn (method)
• (setf confusion-matrix-test-fn) (method)
• (setf confusion-matrix-test-fn) (generic function)
• confusion-matrix-update-sentences (function)
• confusion-matrix-update-tokens (function)
• create-cell (function)
• exact-match-sentence (function)
• existing-cell-p (function)
• insert-entry-confusion-matrix (function)
• sentence-average-score (function)
• sentence-diff (function)
• token-diff (function)
• word-average-score (function)

4.10 conllu.user

Source

packages.lisp (file)

Use List

• split-sequence
• conllu.draw
• cl-conllu
• common-lisp

4.11 conllu.prolog

Source

packages.lisp (file)

Use List

• cl-conllu
• split-sequence
• alexandria
• common-lisp

Exported Definitions

convert-filename (function)

Internal Definitions

• *clauses* (special variable)
• *dependencies* (special variable)
• clean-dep-rel (function)
• clean-whitespace (function)
• emit-prolog (function)
• is-root (function)
• make-id (function)
• process-features (function)
• process-tokens (function)
• prolog-string (function)
• toprologid (function)
• valid-line (function)
• write-prolog (function)

5 Definitions

Definitions are sorted by export status, category, package, and then by lexicographic order.

5.1 Exported definitions

5.1.1 Special variables

Special Variable: *confusion-matrix-style*

HTML for styling the confusion matrix.

Package

conllu.html

Source

html.lisp (file)

5.1.2 Functions

Function: adjust-sentence SENTENCE

Receives a sentence and reenumerate IDs and HEAD values of each token so that their order (as in sentence-tokens) is respected.

Package

cl-conllu

Source

data.lisp (file)

Function: apply-rules SENTENCES RULES RECURSIVE

Package

conllu.rules

Source

rules.lisp (file)

Function: apply-rules-from-files CONLLU-FILE RULES-FILE NEW-CONLLU-FILE LOG-FILE &key RECURSIVE

Package

conllu.rules

Source

rules.lisp (file)

Function: attachment-score-by-sentence LIST-SENT1 LIST-SENT2 &key LABELED IGNORE-PUNCT SIMPLE-DEP

Attachment score by sentence (macro-average).

The attachment score is the percentage of words that have correct arcs to their heads. The unlabeled attachment score (UAS) considers only who is the head of the token, while the labeled attachment score (LAS) considers both the head and the arc label (dependency label / syntactic class).

In order to choose between labeled or unlabeled,
set the key argument LABELED.

References:
- Dependency Parsing. Kubler, Mcdonald and Nivre (pp.79-80)

Package

conllu.evaluate

Source

evaluate.lisp (file)

Function: attachment-score-by-word LIST-SENT1 LIST-SENT2 &key LABELED IGNORE-PUNCT SIMPLE-DEP

Attachment score by word (micro-average).

The attachment score is the percentage of words that have correct arcs to their heads. The unlabeled attachment score (UAS) considers only who is the head of the token, while the labeled attachment score (LAS) considers both the head and the arc label (dependency label / syntactic class).

In order to choose between labeled or unlabeled,
set the key argument LABELED.

References:
- Dependency Parsing. Kubler, Mcdonald and Nivre (pp.79-80)

Package

conllu.evaluate

Source

evaluate.lisp (file)

Function: confusion-matrix-cell-count LABEL1 LABEL2 CM &key DEFAULT-IF-UNDEFINED

Returns the number of tokens that are contained in the cell defined by LABEL1 LABEL2 in the confusion matrix CM.

If DEFAULT-IF-UNDEFINED, returns 0. Otherwise, raises an error in case there is no such cell.

Package

conllu.evaluate

Source

confusion-matrix.lisp (file)

Function: confusion-matrix-cell-tokens LABEL1 LABEL2 CM &key DEFAULT-IF-UNDEFINED

Returns the list of (SENT-ID . TOKEN-ID) of tokens in the cell LABEL1 LABEL2.

If DEFAULT-IF-UNDEFINED, returns the empty list. Otherwise, raises an error in case there is no such cell.

Package

conllu.evaluate

Source

confusion-matrix.lisp (file)

Function: confusion-matrix-cells-labels CM

Returns a list of ’(LABEL1 LABEL2) for each cell in the confusion matrix CM.

Package

conllu.evaluate

Source

confusion-matrix.lisp (file)

Function: confusion-matrix-columns-labels CM

Package

conllu.evaluate

Source

confusion-matrix.lisp (file)

Function: confusion-matrix-labels CM

Returns the list of all labels in the confusion matrix CM.

Package

conllu.evaluate

Source

confusion-matrix.lisp (file)

Function: confusion-matrix-normalize CM

Returns a new CONFUSION-MATRIX with new empty cells for each pair (LABEL1 LABEL2) of labels in (confusion-matrix-labels CM) that are undefined in CM.

Package

conllu.evaluate

Source

confusion-matrix.lisp (file)

Function: confusion-matrix-rows-labels CM

Returns the list of labels occuring in the rows of the confusion matix CM.

Package

conllu.evaluate

Source

confusion-matrix.lisp (file)

Function: confusion-matrix-update LIST-SENT1 LIST-SENT2 CM

Updates an existing confusion matrix by a list of sentences LIST-SENT1 and LIST-SENT2.

Package

conllu.evaluate

Source

confusion-matrix.lisp (file)

Function: conlluedit SENTENCES RULES

Package

conllu.editor

Source

editor.lisp (file)

Function: convert-filename CONTEXT FILENAME-IN FILENAME-OUT

Package

conllu.prolog

Source

conllu-prolog.lisp (file)

Function: convert-rdf CORPUSNAME STREAM CONLLS TEXT-FN ID-FN

Converts the collection of sentences (as generated by READ-CONLLU) in CONLL, using the function TEXT-FN to extract the text of each sentence and ID-FN to extract the id of each sentence (we need this as there is no standardized way of knowing this.) Also the generated Turtle file contains a lot of duplication so when you import it into your triple-store, make sure you remove all duplicate triples afterwards.

Package

cl-conllu

Source

rdf.lisp (file)

Function: convert-rdf-file FILE-IN FILE-OUT

Package

cl-conllu

Source

rdf.lisp (file)

Function: convert-to-rdf SENTENCES &key TEXT-FN ID-FN CORPUSNAME NAMESPACE-STRING STREAM RDF-FORMAT CONLL-NAMESPACE

Converts a list of sentences (e.g. as generated by READ-CONLLU)
in SENTENCES, using the function TEXT-FN to extract the text of each sentence and ID-FN to extract the id of each sentence (we need this as there is no standardized way of knowing this.)

Currently only ntriples is supported as RDF-FORMAT.

Package

cl-conllu

Source

rdf-wilbur.lisp (file)

Function: diff SENTENCES-A SENTENCES-B &key TEST KEY

Package

cl-conllu

Source

utils.lisp (file)

Function: exact-match LIST-SENT1 LIST-SENT2 &key COMPARED-FIELDS IDENTITY-FIELDS TEST SIMPLE-DEP IGNORE-PUNCT

Returns the list of sentences of LIST-SENT1 that are an exact match to the corresponding sentence of LIST-SENT2 (same position in list).

LIST-SENT1 and LIST-SENT2 must have the same size with corresponding sentences in order.

Package

conllu.evaluate

Source

evaluate.lisp (file)

Function: exact-match-score LIST-SENT1 LIST-SENT2 &key COMPARED-FIELDS IDENTITY-FIELDS TEST SIMPLE-DEP IGNORE-PUNCT

Returns the percentage of sentences of LIST-SENT1 that are an exact match to LIST-SENT2.

LIST-SENT1 and LIST-SENT2 must have the same size with corresponding sentences in order.

The typical use case is comparing the result of a tagger (or parser) against a test set, where an exact match is a completely correct tagging (or parse) for the sentence.

References:
- Dependency Parsing. Kubler, Mcdonald and Nivre (p.79)

Package

conllu.evaluate

Source

evaluate.lisp (file)

Function: lazy-stream-reader STREAM &key FN-META START-LINENO

Return a function that returns one CoNLL-U sentence per call.

Package

cl-conllu

Source

read-write.lisp (file)

Function: levenshtein S1 S2 &key TEST

Package

cl-conllu

Source

utils.lisp (file)

Function: make-confusion-matrix LIST-SENT1 LIST-SENT2 &key CORPUS-ID KEY-FN TEST-FN SORT-FN

Creates a new confusion matrix from the lists of sentences LIST-SENT1 and LIST-SENT2.

Package

conllu.evaluate

Source

confusion-matrix.lisp (file)

Function: make-sentence LINENO LINES FN-META

Package

cl-conllu

Source

read-write.lisp (file)

Function: non-projectivity-accuracy LIST-SENT1 LIST-SENT2

Package

conllu.evaluate

Source

evaluate.lisp (file)

Function: non-projectivity-precision LIST-SENT1 LIST-SENT2

Package

conllu.evaluate

Source

evaluate.lisp (file)

Function: non-projectivity-recall LIST-SENT1 LIST-SENT2

Package

conllu.evaluate

Source

evaluate.lisp (file)

Function: precision LIST-SENT1 LIST-SENT2 DEPREL &key ERROR-TYPE SIMPLE-DEP

Restricted to words which are classified as of syntactical class (dependency type to head) DEPREL, returns the precision:
the number of true positives divided by the number of words predicted positive (that is, predicted as of class DEPREL).

We assume that LIST-SENT1 is the classified (predicted) result and LIST-SENT2 is the list of golden (correct) sentences.

ERROR-TYPE defines what is considered an error (a false negative). Some usual values are:
- ’(deprel) :: for the deprel tagging task only
- ’(head) :: for considering errors for each syntactic class - ’(deprel head) :: for considering correct only when both deprel and head are correct.

Package

conllu.evaluate

Source

evaluate.lisp (file)

Function: query QUERY SENTENCES

Package

cl-conllu

Source

query.lisp (file)

Function: query-as-json A-QUERY SENTENCES

Package

cl-conllu

Source

query.lisp (file)

Function: read-conllu INPUT &key FN-META

Package

cl-conllu

Source

read-write.lisp (file)

Function: read-directory PATH &key FN-META

Package

cl-conllu

Source

read-write.lisp (file)

Function: read-file PATH &key FN-META

Package

cl-conllu

Source

read-write.lisp (file)

Function: read-file-tag-suffix FILENAME &key TAG SEPARATOR

Package

conllu.converters.tags

Source

tag-converter.lisp (file)

Function: read-sentence-tag-suffix STREAM FIELD SEPARATOR

Writes as sentence object input from STREAM as FORM.SEPARATOR.TAGVALUE (without dots), followed by a whitespace character.

Example:

;; Consider the file example.txt, with contents:
;; Pudim_NOUN é_VERB bom_ADJ ._PUNCT
;; E_CONJ torta_NOUN também_ADV ._PUNCT

(with-open-file (s "./example.txt")
(write-conllu-to-stream (read-sentence-tag-suffix s ’upostag "_"))) 1 Pudim _ NOUN _ _ _ _ _ _
2 é _ VERB _ _ _ _ _ _
3 bom _ ADJ _ _ _ _ _ _
4 . _ PUNCT _ _ _ _ _ _

1 E _ CONJ _ _ _ _ _ _
2 torta _ NOUN _ _ _ _ _ _
3 também _ ADV _ _ _ _ _ _
4 . _ PUNCT _ _ _ _ _ _

Package

conllu.converters.tags

Source

tag-converter.lisp (file)

Function: read-stream STREAM &key FN-META STOP? START-LINENO

Package

cl-conllu

Source

read-write.lisp (file)

Function: recall LIST-SENT1 LIST-SENT2 DEPREL &key ERROR-TYPE SIMPLE-DEP

Restricted to words which are originally of syntactic class (dependency type to head) DEPREL, returns the recall:
the number of true positives divided by the number of words originally positive (that is, originally of class DEPREL).

We assume that LIST-SENT1 is the classified result
and LIST-SENT2 is the list of golden (correct) sentences.

ERROR-TYPE defines what is considered an error (a false negative). Some usual values are:
- ’(deprel) :: for the deprel tagging task only
- ’(head) :: for considering errors for each syntactic class - ’(deprel head) :: for considering correct only when both deprel and head are correct.

Package

conllu.evaluate

Source

evaluate.lisp (file)

Function: sentence->text SENTENCE &key IGNORE-MTOKENS SPECIAL-FORMAT-TEST SPECIAL-FORMAT-FUNCTION

Receives SENTENCE, a sentence object, and returns a string reconstructed from its tokens and mtokens.

If IGNORE-MTOKENS, then tokens’ forms are used. Else, tokens with id contained in a mtoken are not used, with mtoken’s form being used instead.

It is possible to special format some tokens. In order to do so, both SPECIAL-FORMAT-TEST and SPECIAL-FORMAT-FUNCTION should be passed. Then for each object (token or mtoken) for which SPECIAL-FORMAT-TEST returns a non-nil result, its form is modified by SPECIAL-FORMAT-FUNCTION in the final string.

Package

cl-conllu

Source

data.lisp (file)

Function: sentence-binary-tree SENTENCE

Based on the idea from [1], it produces a tree view of the sentence, still need to improve the priorities of children.

Code at https://github.com/sivareddyg/UDepLambda in file src/deplambda/parser/TreeTransformer.java method ’binarizeTree’

[1] Siva Reddy, O. Tackstrom, M. Collins, T. Kwiatkowski, D. Das, M. Steedman, and M. Lapataw, Transforming Dependency Structures to Logical Forms for Semantic Parsing, Transactions of the Association for Computational Linguistics, pp. 127–140, Apr. 2016.

Package

cl-conllu

Source

data.lisp (file)

Function: sentence-equal SENT-1 SENT-2

Tests if, for each slot, sent-1 has the same values as sent-2. For tokens and multiword tokens, it uses token-equal and mtoken-equal, respectively.

Package

cl-conllu

Source

data.lisp (file)

Function: sentence-fill-offsets SENTENCE

Package

cl-conllu

Source

data.lisp (file)

Function: sentence-hash-table SENTENCE

Package

cl-conllu

Source

data.lisp (file)

Function: sentence-id SENTENCE

Package

cl-conllu

Source

data.lisp (file)

Function: sentence-meta-value SENTENCE META-FIELD

Package

cl-conllu

Source

data.lisp (file)

Function: sentence-root SENTENCE

Package

cl-conllu

Source

data.lisp (file)

Function: sentence-size SENTENCE

Package

cl-conllu

Source

data.lisp (file)

Function: sentence-text SENTENCE

Package

cl-conllu

Source

data.lisp (file)

Function: sentence-valid? SENTENCE

Package

cl-conllu

Source

data.lisp (file)

Function: simple-deprel DEPREL

Package

cl-conllu

Source

data.lisp (file)

Function: token-children TOKEN SENTENCE &key FN-FILTER

Package

cl-conllu

Source

data.lisp (file)

Function: tree-sentence SENTENCE &key FIELDS-OR-FUNCTION STREAM SHOW-META

Package

conllu.draw

Source

draw.lisp (file)

Function: tree-sentence-by-id PATH ID

Package

conllu.draw

Source

draw.lisp (file)

Function: write-conllu SENTENCES FILENAME &key IF-EXISTS

Package

cl-conllu

Source

read-write.lisp (file)

Function: write-conllu-to-stream SENTENCES &optional OUT

Package

cl-conllu

Source

read-write.lisp (file)

Function: write-sentence-tag-suffix-to-stream SENTENCE &key STREAM TAG SEPARATOR

Writes sentence as CoNLL-U file in STREAM as FORM.SEPARATOR.TAGVALUE (without
dots), followed by a whitespace character.

If TAG is NIL, then writes only FORMs, followed by a whitespace character.

Example:
;; supposing sentence already defined
(write-sentence-tag-suffix-to-stream (sentence :tag ’xpostag :separator "_")) Pierre_NNP Vinken_NNP ,_, 61_CD years_NNS old_JJ ,_, will_MD join_VB the_DT board_NN as_IN a_DT nonexecutive_JJ director_NN Nov._NNP 29_CD ._.
=> NIL

Package

conllu.converters.tags

Source

tag-converter.lisp (file)

Function: write-sentences-tag-suffix SENTENCES FILENAME &key TAG SEPARATOR IF-EXISTS

See documentation for write-sentence-tag-suffix-to-stream

Package

conllu.converters.tags

Source

tag-converter.lisp (file)

Function: write-sentences-tag-suffix-to-stream SENTENCES &key STREAM TAG SEPARATOR

See documentation for write-sentence-tag-suffix-to-stream

Package

conllu.converters.tags

Source

tag-converter.lisp (file)

5.1.3 Generic functions

Generic Function: confusion-matrix-corpus-id OBJECT

Generic Function: (setf confusion-matrix-corpus-id) NEW-VALUE OBJECT

Package

conllu.evaluate

Methods

Method: confusion-matrix-corpus-id (CONFUSION-MATRIX confusion-matrix)

Method: (setf confusion-matrix-corpus-id) NEW-VALUE (CONFUSION-MATRIX confusion-matrix)

Identifier of the corpus or experiment.

Source

confusion-matrix.lisp (file)

Generic Function: format-html OBJECT

Outputs a HTML string for the object.

Package

conllu.html

Source

html.lisp (file)

Methods

Method: format-html (CM confusion-matrix)

Generic Function: mtoken-end OBJECT

Generic Function: (setf mtoken-end) NEW-VALUE OBJECT

Package

cl-conllu

Methods

Method: mtoken-end (MTOKEN mtoken)

automatically generated reader method

Source

data.lisp (file)

Method: (setf mtoken-end) NEW-VALUE (MTOKEN mtoken)

automatically generated writer method

Source

data.lisp (file)

Generic Function: mtoken-start OBJECT

Generic Function: (setf mtoken-start) NEW-VALUE OBJECT

Package

cl-conllu

Methods

Method: mtoken-start (MTOKEN mtoken)

automatically generated reader method

Source

data.lisp (file)

Method: (setf mtoken-start) NEW-VALUE (MTOKEN mtoken)

automatically generated writer method

Source

data.lisp (file)

Generic Function: sentence-meta OBJECT

Generic Function: (setf sentence-meta) NEW-VALUE OBJECT

Package

cl-conllu

Methods

Method: sentence-meta (SENTENCE sentence)

automatically generated reader method

Source

data.lisp (file)

Method: (setf sentence-meta) NEW-VALUE (SENTENCE sentence)

automatically generated writer method

Source

data.lisp (file)

Generic Function: sentence-mtokens OBJECT

Generic Function: (setf sentence-mtokens) NEW-VALUE OBJECT

Package

cl-conllu

Methods

Method: sentence-mtokens (SENTENCE sentence)

automatically generated reader method

Source

data.lisp (file)

Method: (setf sentence-mtokens) NEW-VALUE (SENTENCE sentence)

automatically generated writer method

Source

data.lisp (file)

Generic Function: sentence-start OBJECT

Generic Function: (setf sentence-start) NEW-VALUE OBJECT

Package

cl-conllu

Methods

Method: sentence-start (SENTENCE sentence)

automatically generated reader method

Source

data.lisp (file)

Method: (setf sentence-start) NEW-VALUE (SENTENCE sentence)

automatically generated writer method

Source

data.lisp (file)

Generic Function: sentence-tokens OBJECT

Generic Function: (setf sentence-tokens) NEW-VALUE OBJECT

Package

cl-conllu

Methods

Method: sentence-tokens (SENTENCE sentence)

automatically generated reader method

Source

data.lisp (file)

Method: (setf sentence-tokens) NEW-VALUE (SENTENCE sentence)

automatically generated writer method

Source

data.lisp (file)

Generic Function: token-cfrom OBJECT

Generic Function: (setf token-cfrom) NEW-VALUE OBJECT

Package

cl-conllu

Methods

Method: token-cfrom (ABSTRACT-TOKEN abstract-token)

automatically generated reader method

Source

data.lisp (file)

Method: (setf token-cfrom) NEW-VALUE (ABSTRACT-TOKEN abstract-token)

automatically generated writer method

Source

data.lisp (file)

Generic Function: token-cto OBJECT

Generic Function: (setf token-cto) NEW-VALUE OBJECT

Package

cl-conllu

Methods

Method: token-cto (ABSTRACT-TOKEN abstract-token)

automatically generated reader method

Source

data.lisp (file)

Method: (setf token-cto) NEW-VALUE (ABSTRACT-TOKEN abstract-token)

automatically generated writer method

Source

data.lisp (file)

Generic Function: token-deprel OBJECT

Generic Function: (setf token-deprel) NEW-VALUE OBJECT

Package

cl-conllu

Methods

Method: token-deprel (TOKEN token)

automatically generated reader method

Source

data.lisp (file)

Method: (setf token-deprel) NEW-VALUE (TOKEN token)

automatically generated writer method

Source

data.lisp (file)

Generic Function: token-deps OBJECT

Generic Function: (setf token-deps) NEW-VALUE OBJECT

Package

cl-conllu

Methods

Method: token-deps (TOKEN token)

automatically generated reader method

Source

data.lisp (file)

Method: (setf token-deps) NEW-VALUE (TOKEN token)

automatically generated writer method

Source

data.lisp (file)

Generic Function: token-feats OBJECT

Generic Function: (setf token-feats) NEW-VALUE OBJECT

Package

cl-conllu

Methods

Method: token-feats (TOKEN token)

automatically generated reader method

Source

data.lisp (file)

Method: (setf token-feats) NEW-VALUE (TOKEN token)

automatically generated writer method

Source

data.lisp (file)

Generic Function: token-form OBJECT

Generic Function: (setf token-form) NEW-VALUE OBJECT

Package

cl-conllu

Methods

Method: token-form (ABSTRACT-TOKEN abstract-token)

automatically generated reader method

Source

data.lisp (file)

Method: (setf token-form) NEW-VALUE (ABSTRACT-TOKEN abstract-token)

automatically generated writer method

Source

data.lisp (file)

Generic Function: token-head OBJECT

Generic Function: (setf token-head) NEW-VALUE OBJECT

Package

cl-conllu

Methods

Method: token-head (TOKEN token)

automatically generated reader method

Source

data.lisp (file)

Method: (setf token-head) NEW-VALUE (TOKEN token)

automatically generated writer method

Source

data.lisp (file)

Generic Function: token-id OBJECT

Generic Function: (setf token-id) NEW-VALUE OBJECT

Package

cl-conllu

Methods

Method: token-id (TOKEN token)

automatically generated reader method

Source

data.lisp (file)

Method: (setf token-id) NEW-VALUE (TOKEN token)

automatically generated writer method

Source

data.lisp (file)

Generic Function: token-lemma OBJECT

Generic Function: (setf token-lemma) NEW-VALUE OBJECT

Package

cl-conllu

Methods

Method: token-lemma (TOKEN token)

automatically generated reader method

Source

data.lisp (file)

Method: (setf token-lemma) NEW-VALUE (TOKEN token)

automatically generated writer method

Source

data.lisp (file)

Generic Function: token-misc OBJECT

Generic Function: (setf token-misc) NEW-VALUE OBJECT

Package

cl-conllu

Methods

Method: token-misc (ABSTRACT-TOKEN abstract-token)

automatically generated reader method

Source

data.lisp (file)

Method: (setf token-misc) NEW-VALUE (ABSTRACT-TOKEN abstract-token)

automatically generated writer method

Source

data.lisp (file)

Generic Function: token-sentence OBJECT

Generic Function: (setf token-sentence) NEW-VALUE OBJECT

Package

cl-conllu

Methods

Method: token-sentence (ABSTRACT-TOKEN abstract-token)

automatically generated reader method

Source

data.lisp (file)

Method: (setf token-sentence) NEW-VALUE (ABSTRACT-TOKEN abstract-token)

automatically generated writer method

Source

data.lisp (file)

Generic Function: token-upostag OBJECT

Generic Function: (setf token-upostag) NEW-VALUE OBJECT

Package

cl-conllu

Methods

Method: token-upostag (TOKEN token)

automatically generated reader method

Source

data.lisp (file)

Method: (setf token-upostag) NEW-VALUE (TOKEN token)

automatically generated writer method

Source

data.lisp (file)

Generic Function: token-xpostag OBJECT

Generic Function: (setf token-xpostag) NEW-VALUE OBJECT

Package

cl-conllu

Methods

Method: token-xpostag (TOKEN token)

automatically generated reader method

Source

data.lisp (file)

Method: (setf token-xpostag) NEW-VALUE (TOKEN token)

automatically generated writer method

Source

data.lisp (file)

5.1.4 Classes

Class: confusion-matrix ()

Package

conllu.evaluate

Source

confusion-matrix.lisp (file)

Direct superclasses

standard-object (class)

Direct methods

• format-html (method)
• print-object (method)
• initialize-instance (method)
• confusion-matrix-rows (method)
• confusion-matrix-rows (method)
• confusion-matrix-sort-fn (method)
• confusion-matrix-sort-fn (method)
• confusion-matrix-test-fn (method)
• confusion-matrix-test-fn (method)
• confusion-matrix-key-fn (method)
• confusion-matrix-key-fn (method)
• confusion-matrix-corpus-id (method)
• confusion-matrix-corpus-id (method)

Direct slots

Slot: corpus-id

Identifier of the corpus or experiment.

Initargs

:corpus-id

Readers

confusion-matrix-corpus-id (generic function)

Writers

(setf confusion-matrix-corpus-id) (generic function)

Slot: key-fn

Function used to label each token.

Initargs

:key-fn

Initform

(function cl-conllu:token-upostag)

Readers

confusion-matrix-key-fn (generic function)

Writers

(setf confusion-matrix-key-fn) (generic function)

Slot: test-fn

Function which compares two labels. Typically a form of equality.

Initargs

:test-fn

Initform

(function equal)

Readers

confusion-matrix-test-fn (generic function)

Writers

(setf confusion-matrix-test-fn) (generic function)

Slot: sort-fn

Function which sorts labels. By default,
converts labels to string and uses lexicographical order

Initargs

:sort-fn

Initform

(function (lambda (conllu.evaluate::x conllu.evaluate::y) (string<= (format nil "~a" conllu.evaluate::x) (format nil "~a" conllu.evaluate::y))))

Readers

confusion-matrix-sort-fn (generic function)

Writers

(setf confusion-matrix-sort-fn) (generic function)

Slot: rows

Parameter which contains the contents of the confusion matrix.

Readers

confusion-matrix-rows (generic function)

Writers

(setf confusion-matrix-rows) (generic function)

Class: mtoken ()

Package

cl-conllu

Source

data.lisp (file)

Direct superclasses

abstract-token (class)

Direct methods

• write-token (method)
• mtoken-end (method)
• mtoken-end (method)
• mtoken-start (method)
• mtoken-start (method)

Direct slots

Slot: start

Initargs

:start

Readers

mtoken-start (generic function)

Writers

(setf mtoken-start) (generic function)

Slot: end

Initargs

:end

Readers

mtoken-end (generic function)

Writers

(setf mtoken-end) (generic function)

Class: sentence ()

Package

cl-conllu

Source

data.lisp (file)

Direct superclasses

standard-object (class)

Direct methods

• encode (method)
• initialize-instance (method)
• print-object (method)
• sentence-etokens (method)
• sentence-etokens (method)
• sentence-mtokens (method)
• sentence-mtokens (method)
• sentence-tokens (method)
• sentence-tokens (method)
• sentence-meta (method)
• sentence-meta (method)
• sentence-start (method)
• sentence-start (method)

Direct slots

Slot: start

Initargs

:start

Initform

0

Readers

sentence-start (generic function)

Writers

(setf sentence-start) (generic function)

Slot: meta

Initargs

:meta

Readers

sentence-meta (generic function)

Writers

(setf sentence-meta) (generic function)

Slot: tokens

Initargs

:tokens

Readers

sentence-tokens (generic function)

Writers

(setf sentence-tokens) (generic function)

Slot: mtokens

Initargs

:mtokens

Readers

sentence-mtokens (generic function)

Writers

(setf sentence-mtokens) (generic function)

Slot: etokens

Initargs

:etokens

Readers

sentence-etokens (generic function)

Writers

(setf sentence-etokens) (generic function)

Class: token ()

Package

cl-conllu

Source

data.lisp (file)

Direct superclasses

abstract-token (class)

Direct methods

• encode (method)
• write-token (method)
• print-object (method)
• token-deps (method)
• token-deps (method)
• token-deprel (method)
• token-deprel (method)
• token-head (method)
• token-head (method)
• token-feats (method)
• token-feats (method)
• token-xpostag (method)
• token-xpostag (method)
• token-upostag (method)
• token-upostag (method)
• token-lemma (method)
• token-lemma (method)
• token-id (method)
• token-id (method)

Direct slots

Slot: id

Initargs

:id

Readers

token-id (generic function)

Writers

(setf token-id) (generic function)

Slot: lemma

Initargs

:lemma

Readers

token-lemma (generic function)

Writers

(setf token-lemma) (generic function)

Slot: upostag

Initargs

:upostag

Initform

"_"

Readers

token-upostag (generic function)

Writers

(setf token-upostag) (generic function)

Slot: xpostag

Initargs

:xpostag

Initform

"_"

Readers

token-xpostag (generic function)

Writers

(setf token-xpostag) (generic function)

Slot: feats

Initargs

:feats

Initform

"_"

Readers

token-feats (generic function)

Writers

(setf token-feats) (generic function)

Slot: head

Initargs

:head

Initform

"_"

Readers

token-head (generic function)

Writers

(setf token-head) (generic function)

Slot: deprel

Initargs

:deprel

Initform

"_"

Readers

token-deprel (generic function)

Writers

(setf token-deprel) (generic function)

Slot: deps

Initargs

:deps

Initform

"_"

Readers

token-deps (generic function)

Writers

(setf token-deps) (generic function)

5.2 Internal definitions

5.2.1 Special variables

Special Variable: *clauses*

Package

conllu.prolog

Source

conllu-prolog.lisp (file)

Special Variable: *dependencies*

Package

conllu.prolog

Source

conllu-prolog.lisp (file)

Special Variable: *deprel-value-list*

List of the 37 universal syntactic relations in UD.

Package

conllu.evaluate

Source

evaluate.lisp (file)

Special Variable: *deprels*

Package

cl-conllu

Source

query.lisp (file)

Special Variable: *token-fields*

Package

cl-conllu

Source

data.lisp (file)

Special Variable: *token-fields*

Package

conllu.evaluate

Source

evaluate.lisp (file)

Special Variable: niceline-matcher

Package

conllu.converters.niceline

Source

niceline.lisp (file)

5.2.2 Macros

Macro: error-test EXPRESSION

Package

conllu.editor

Source

editor.lisp (file)

5.2.3 Functions

Function: action EXPRESSION

Package

conllu.editor

Source

editor.lisp (file)

Function: actions ACTIONS

Package

conllu.editor

Source

editor.lisp (file)

Function: add-field-value TOKEN FIELD VALUE

Package

conllu.converters.niceline

Source

niceline.lisp (file)

Function: add-or-subt OP FIELD TOKEN VALUE

Package

conllu.editor

Source

editor.lisp (file)

Function: add-value FIELD NEW-VALUE TOKEN REST-CONDITIONS

Package

conllu.rules

Source

rules.lisp (file)

Function: adjust-conllu INPUT OUTPUT

Package

cl-conllu

Source

command-line.lisp (file)

Function: adopted-unfinished? LINES IDS

Package

conllu.draw

Source

draw.lisp (file)

Function: and% QUERY1 QUERY2 &key TKS

Package

cl-conllu

Source

query.lisp (file)

Function: apply-act RESULT-ACT

Package

conllu.editor

Source

editor.lisp (file)

Function: apply-changes TOKENS RULE

Package

conllu.rules

Source

rules.lisp (file)

Function: apply-conditions-in-token CONDITIONS TOKEN

Package

conllu.rules

Source

rules.lisp (file)

Function: apply-rhs BINDINGS RHS

Package

conllu.rules

Source

rules.lisp (file)

Function: apply-rule TOKENS SENT-ID RULE RULE-INDEX

Package

conllu.editor

Source

editor.lisp (file)

Function: apply-rule-in-sentence A-SENTENCE RULE SENT-ID

Package

conllu.rules

Source

rules.lisp (file)

Function: apply-rule-in-tokens TOKENS RULE SENT-ID &optional MATCHS

Package

conllu.rules

Source

rules.lisp (file)

Function: apply-rules TOKENS SENT-ID RULES ERRORS &optional INDEX ACUM-RECORDS

Package

conllu.editor

Source

editor.lisp (file)

Function: apply-rules-in-sentence A-SENTENCE RULES SENT-ID RECURSIVE &optional OLD-RULES-APPLIED

Package

conllu.rules

Source

rules.lisp (file)

Function: apply-rules-in-sentence-aux A-SENTENCE RULES SENT-ID &optional APPLIED?

Package

conllu.rules

Source

rules.lisp (file)

Function: assocs VALUE SETS FIELD TOKENS &optional IDS RESULT-TOKENS OLD-FIELDS

Package

conllu.editor

Source

editor.lisp (file)

Function: blank-line? LINE

Package

cl-conllu

Source

utils.lisp (file)

Function: children TKS ID

Package

cl-conllu

Source

query.lisp (file)

Function: clean-dep-rel STR

Package

conllu.prolog

Source

conllu-prolog.lisp (file)

Function: clean-whitespace LINE

Package

conllu.prolog

Source

conllu-prolog.lisp (file)

Function: clear STRING

Package

conllu.editor

Source

editor.lisp (file)

Function: collect-meta LINES

Package

cl-conllu

Source

read-write.lisp (file)

Function: components->string COMPONENTS

Package

conllu.rdf

Source

rdf.lisp (file)

Function: confusion-matrix-copy CM

Returns a new CONFUSION-MATRIX with the same cells values as CM.

Package

conllu.evaluate

Source

confusion-matrix.lisp (file)

Function: confusion-matrix-update-sentences SENT1 SENT2 CM

Updates an existing confusion matrix by a pair of matching sentences SENT1 and SENT2. That is, SENT1 and SENT2 should be alternative analyses of the same natural language sentence.

Package

conllu.evaluate

Source

confusion-matrix.lisp (file)

Function: confusion-matrix-update-tokens TOKEN1 TOKEN2 CM

Package

conllu.evaluate

Source

confusion-matrix.lisp (file)

Function: consume-tags TAGS TK

Package

conllu.converters.niceline

Source

niceline.lisp (file)

Function: convert-directory PATH

Package

conllu.converters.niceline

Source

niceline.lisp (file)

Function: convert-features-to-rdf FEATURES-STRING

Input: string
Output: list of feature nodes

Returns a list of nodes to be used as objects in triples with the predicate "conll:feats".

Examples:
(let ((wilbur:*nodes* (make-instance ’wilbur:dictionary))
(wilbur:*db* (make-instance ’wilbur:db)))
(wilbur:add-namespace "olia-sys" "http://purl.org/olia/system.owl#") (wilbur:add-namespace "conll" "http://br.ibm.com/conll/LEMMA") (convert-features-to-rdf "Mood=Ind|Tense=Past|VerbForm=Fin" (node "sentence1"))) =>
(!"http://br.ibm.com/conll/LEMMA#verbFormFin" !"http://br.ibm.com/conll/LEMMA#tensePast" !"http://br.ibm.com/conll/LEMMA#moodInd")

Package

conllu.rdf

Source

rdf-wilbur.lisp (file)