The inquisitor Reference Manual

Table of Contents

Next: , Previous: , Up: (dir)   [Contents][Index]

The inquisitor Reference Manual

This is the inquisitor Reference Manual, version 0.5, generated automatically by Declt version 2.3 "Robert April" on Wed Mar 14 04:05:00 2018 GMT+0.


Next: , Previous: , Up: Top   [Contents][Index]

1 Introduction

Inquisitor

Quicklisp Build Status Coverage Status

Encoding/end-of-line detection and external-format abstraction for Common Lisp.

The Library is a sphere whose exact center is any one of its hexagons and whose circumference is inaccessible. -- "The Library of Babel" by Jorge Luis Borges

Features

Installation

Get and install via quicklisp:

CL-USER> (ql:quickload :inquisitor)

Usage

Encoding detection

To detect encoding from stream, use (inq:detect-encoding stream scheme). This returns implementation independent encoding name. About scheme, see Encoding scheme.

for example:

CL-USER> (with-open-file (in #P"t/data/unicode/utf-8.txt"
                          :direction :input
                          :element-type '(unsigned-byte 8))
           (inq:detect-encoding in :jp))
:UTF-8

You can see the list of available encodings:

CL-USER> inq:+available-encodings+
(:UTF-8 :UCS-2LE :UCS-2BE :UTF-16 :ISO-2022-JP :EUC-JP :CP932 :BIG5 :ISO-2022-TW
 :GB2312 :GB18030 :ISO-2022-CN :EUC-KR :JOHAB :ISO-2022-KR :ISO-8859-6 :CP1256
 :ISO-8859-7 :CP1253 :ISO-8859-8 :CP1255 :ISO-8859-9 :CP1254 :ISO-8859-5
 :KOI8-R :KOI8-U :CP866 :CP1251 :ISO-8859-2 :CP1250 :ISO-8859-13 :CP1257)

Encoding scheme

Encoding scheme is a hint to detect encoding.

It's mostly impossible to detect encoding universally, because there are two encoding such that use same byte sequences to represent other characters. So, limitting target encodings has benefit to encoding detection.

Here, in inquisitor, languages are used to limit the encodings. Where languages are, roughly speaking, writing systems used in anywhere arround the world. Fixing language is equivalent to fixing possible characters. Becaus of which, encoding detection be slightly eazy.

Supported scheme (languages) is as follows:

End-of-line type detection

If you want to know end-of-line (line break) type, use (inq:detect-end-of-line stream). This returns implementation independent end-of-line name.

CL-USER> (with-open-file (in "t/data/ascii/ascii-crlf.txt"
                             :direction :input
                             :element-type '(unsigned-byte 8))
           (inquisitor:detect-end-of-line in))

:CRLF

Implementation dependent/independent names

If you want to know implementation dependent name of encodings or eol type, use (inq:independent-name dependent-name). Returned value can be used as external-format, or its part.

CL-USER> (inq:independent-name :cp932)
#<ENCODING "CP932" :UNIX>  ; on CLISP
:WINDOWS-CP932  ; on ECL
:SHIFT_JIS  ; on SBCL
:WINDOWS-31J  ; on CCL
:|X-MS932_0213|  ; on ABCL

If you want to know implementation independent name of encodings or eol type, use (inq:dependent-name independent-name).

Eol

If you want to know eol is available on your implementation, use (inq:eol-available-p).

CL-USER> (inq:eol-available-p)
NIL  ; on SBCL

Make external-format

To make external-format from impl independent names, use (inq:make-external-format enc eol).

In SBCL and CCL, same code returns different value.

On SBCL:

CL-USER> (let* ((file #P"t/data/ja/sjis.txt")
                (enc (inq:detect-encoding file :jp))
                (eol (inq:detect-end-of-line file)))
           (inq:make-external-format enc eol))
:SHIFT_JIS

On CCL:

CL-USER> (let* ((file #P"t/data/ja/sjis.txt")
                (enc (inq:detect-encoding file :jp))
                (eol (inq:detect-end-of-line file)))
           (inq:make-external-format enc eol))
#<EXTERNAL-FORMAT :WINDOWS-31J/:UNIX #x302001C574CD>

External-format detection

Inquisitor provides external-format detection method. It detects encoding and eol style, then make external-format from these. It can use with vector, byte stream and pathname.

Let's see examples with CCL.

From vector
CL-USER> (inq:detect-external-format
          (encode-string-to-octets "公的な捜索係、調査官がいる。
わたしは彼らが任務を遂行しているところを見た。")
          :jp)
#<EXTERNAL-FORMAT :UTF-8/:UNIX #x30200046719D>
From stream
CL-USER> (with-open-file (in "t/data/unicode/utf-8.txt"
                             :direction :input
                             :element-type '(unsigned-byte 8))
           (inq:detect-external-format in :jp))
#<EXTERNAL-FORMAT :UTF-8/:UNIX #x30200046719D>
From pathname
CL-USER> (inq:detect-external-format #P"t/data/unicode/utf-8.txt" :jp)
#<EXTERNAL-FORMAT :UTF-8/:UNIX #x30200046719D>

Author

Copyright

Copyright (c) 2000-2007 Shiro Kawai (shiro@acm.org)
Copyright (c) 2007 Masayuki Onjo (onjo@lispuser.net)
Copyright (c) 2011 zqwell (zqwell@gmail.com)
Copyright (c) 2015 Shinichi Tanaka (s


Next: , Previous: , Up: Top   [Contents][Index]

2 Systems

The main system appears first, followed by any subsystem dependency.


Previous: , Up: Systems   [Contents][Index]

2.1 inquisitor

Author

Shinichi Tanaka

License

MIT

Description

Encoding/end-of-line detection and of external-format abstraction for Common Lisp

Version

0.5

Dependencies
Source

inquisitor.asd (file)

Component

src (module)


Next: , Previous: , Up: Top   [Contents][Index]

3 Modules

Modules are listed depth-first from the system components tree.


Next: , Previous: , Up: Modules   [Contents][Index]

3.1 inquisitor/src

Parent

inquisitor (system)

Location

src/

Components

Previous: , Up: Modules   [Contents][Index]

3.2 inquisitor/src/encoding

Parent

src (module)

Location

src/encoding/

Components

Next: , Previous: , Up: Top   [Contents][Index]

4 Files

Files are sorted by type and then listed depth-first from the systems components trees.


Previous: , Up: Files   [Contents][Index]

4.1 Lisp


Next: , Previous: , Up: Lisp files   [Contents][Index]

4.1.1 inquisitor.asd

Location

inquisitor.asd

Systems

inquisitor (system)

Packages

inquisitor-asd


Next: , Previous: , Up: Lisp files   [Contents][Index]

4.1.2 inquisitor/src/encoding/dfa.lisp

Parent

encoding (module)

Location

src/encoding/dfa.lisp

Packages

inquisitor.encoding.dfa

Exported Definitions
Internal Definitions

Next: , Previous: , Up: Lisp files   [Contents][Index]

4.1.3 inquisitor/src/encoding/table.lisp

Dependency

dfa.lisp (file)

Parent

encoding (module)

Location

src/encoding/table.lisp

Packages

inquisitor.encoding.table

Internal Definitions

Next: , Previous: , Up: Lisp files   [Contents][Index]

4.1.4 inquisitor/src/encoding/guess.lisp

Dependencies
Parent

encoding (module)

Location

src/encoding/guess.lisp

Packages

inquisitor.encoding.guess

Exported Definitions
Internal Definitions

Next: , Previous: , Up: Lisp files   [Contents][Index]

4.1.5 inquisitor/src/eol.lisp

Parent

src (module)

Location

src/eol.lisp

Packages

inquisitor.eol

Exported Definitions

Next: , Previous: , Up: Lisp files   [Contents][Index]

4.1.6 inquisitor/src/names.lisp

Parent

src (module)

Location

src/names.lisp

Packages

inquisitor.names

Exported Definitions
Internal Definitions

+name-mapping+ (special variable)


Next: , Previous: , Up: Lisp files   [Contents][Index]

4.1.7 inquisitor/src/external-format.lisp

Dependency

names.lisp (file)

Parent

src (module)

Location

src/external-format.lisp

Packages

inquisitor.external-format

Exported Definitions

Next: , Previous: , Up: Lisp files   [Contents][Index]

4.1.8 inquisitor/src/util.lisp

Parent

src (module)

Location

src/util.lisp

Packages

inquisitor.util

Exported Definitions

Previous: , Up: Lisp files   [Contents][Index]

4.1.9 inquisitor/src/inquisitor.lisp

Dependencies
Parent

src (module)

Location

src/inquisitor.lisp

Packages

inquisitor

Exported Definitions
Internal Definitions

*default-buffer-size* (special variable)


Next: , Previous: , Up: Top   [Contents][Index]

5 Packages

Packages are listed by definition order.


Next: , Previous: , Up: Packages   [Contents][Index]

5.1 inquisitor-asd

Source

inquisitor.asd

Use List

Next: , Previous: , Up: Packages   [Contents][Index]

5.2 inquisitor.encoding.dfa

Source

dfa.lisp (file)

Use List

common-lisp

Exported Definitions
Internal Definitions

Next: , Previous: , Up: Packages   [Contents][Index]

5.3 inquisitor.encoding.table

Source

table.lisp (file)

Use List

common-lisp

Used By List

inquisitor.encoding.guess

Internal Definitions

Next: , Previous: , Up: Packages   [Contents][Index]

5.4 inquisitor.encoding.guess

Source

guess.lisp (file)

Use List
Exported Definitions
Internal Definitions

Next: , Previous: , Up: Packages   [Contents][Index]

5.5 inquisitor.eol

Source

eol.lisp (file)

Use List

common-lisp

Exported Definitions

Next: , Previous: , Up: Packages   [Contents][Index]

5.6 inquisitor.names

Source

names.lisp (file)

Nickname

inq.names

Use List

common-lisp

Exported Definitions
Internal Definitions

+name-mapping+ (special variable)


Next: , Previous: , Up: Packages   [Contents][Index]

5.7 inquisitor.external-format

Source

external-format.lisp (file)

Use List

common-lisp

Exported Definitions

Next: , Previous: , Up: Packages   [Contents][Index]

5.8 inquisitor.util

Source

util.lisp (file)

Use List

common-lisp

Exported Definitions

Previous: , Up: Packages   [Contents][Index]

5.9 inquisitor

Source

inquisitor.lisp (file)

Nickname

inq

Use List

common-lisp

Exported Definitions
Internal Definitions

*default-buffer-size* (special variable)


Next: , Previous: , Up: Top   [Contents][Index]

6 Definitions

Definitions are sorted by export status, category, package, and then by lexicographic order.


Next: , Previous: , Up: Definitions   [Contents][Index]

6.1 Exported definitions


Next: , Previous: , Up: Exported definitions   [Contents][Index]

6.1.1 Special variables

Special Variable: +available-encodings+
Package

inquisitor.names

Source

names.lisp (file)

Special Variable: +available-eols+
Package

inquisitor.names

Source

names.lisp (file)


Next: , Previous: , Up: Exported definitions   [Contents][Index]

6.1.2 Macros

Macro: define-dfa NAME &body STATES
Package

inquisitor.encoding.dfa

Source

dfa.lisp (file)

Macro: dfa-init DFA-ST DFA-AR DFA-NAME
Package

inquisitor.encoding.dfa

Source

dfa.lisp (file)

Macro: dfa-name DFA
Package

inquisitor.encoding.dfa

Source

dfa.lisp (file)

Macro: dfa-process ORDER CH
Package

inquisitor.encoding.dfa

Source

dfa.lisp (file)

Macro: generate-order &rest ENCODINGS
Package

inquisitor.encoding.dfa

Source

dfa.lisp (file)

Macro: with-byte-array (VAR DIM) &body BODY
Package

inquisitor.util

Source

util.lisp (file)


Next: , Previous: , Up: Exported definitions   [Contents][Index]

6.1.3 Functions

Function: byte-array-p VEC
Package

inquisitor.util

Source

util.lisp (file)

Function: byte-input-stream-p STREAM
Package

inquisitor.util

Source

util.lisp (file)

Function: ces-guess-from-vector VECTOR SCHEME &optional ORDER STATE

Guess character encoding scheme under the language ‘scheme‘. ‘order‘ is a _dfa state_: _dfa state_ is a list consist of a) nodes of dfa, b) arrows of dfa c) score and d) name. ‘state‘ is a state except dfa state. ‘state‘ may be used or not be used by each guess-* function of scheme, although you must be pass to this function.
Specifying ‘order‘ and ‘state‘ means, we can restart guessing from the point of ‘order‘ and ‘state‘.

‘ces-guess-from-vector‘ returns ‘encoding‘ and ‘order‘: ‘encoding‘ is an _implementation independent_ name, ‘order‘ is a state at this function stops guessing process.

Package

inquisitor.encoding.guess

Source

guess.lisp (file)

Function: dependent-name INDEPENDENT-NAME &optional TYPE
Package

inquisitor.names

Source

names.lisp (file)

Function: dfa-none ORDER
Package

inquisitor.encoding.dfa

Source

dfa.lisp (file)

Function: dfa-top ORDER
Package

inquisitor.encoding.dfa

Source

dfa.lisp (file)

Function: eol-available-p ()
Package

inquisitor.eol

Source

eol.lisp (file)

Function: eol-guess-from-vector BUFFER
Package

inquisitor.eol

Source

eol.lisp (file)

Function: independent-name DEPENDENT-NAME &optional TYPE
Package

inquisitor.names

Source

names.lisp (file)

Function: list-available-scheme ()
Package

inquisitor.encoding.guess

Source

guess.lisp (file)

Function: make-external-format ENC EOL &rest ARGS &key TYPE &allow-other-keys
Package

inquisitor.external-format

Source

external-format.lisp (file)

Function: unicode-p INDEPENDENT-NAME
Package

inquisitor.names

Source

names.lisp (file)


Previous: , Up: Exported definitions   [Contents][Index]

6.1.4 Generic functions

Generic Function: %make-external-format TYPE ENC EOL &rest ARGS &key &allow-other-keys
Package

inquisitor.external-format

Source

external-format.lisp (file)

Methods
Method: %make-external-format (TYPE (eql impl)) ENC EOL &rest ARGS &key &allow-other-keys
Generic Function: detect-encoding INPUT SYMBOL
Package

inquisitor

Source

inquisitor.lisp (file)

Methods
Method: detect-encoding (PATH pathname) (SCHEME symbol)

Detect character encoding scheme under the ‘scheme‘ from ‘pathname‘.

Method: detect-encoding (STREAM stream) (SCHEME symbol)

Detect character encoding scheme under the ‘scheme‘ from ‘stream‘. Note that this method modifies ‘stream‘’s file position.

Method: detect-encoding (BUFFER vector) (SCHEME symbol)

Detect character encoding scheme under the ‘scheme‘ from ‘buffer‘.

Generic Function: detect-end-of-line INPUT
Package

inquisitor

Source

inquisitor.lisp (file)

Methods
Method: detect-end-of-line (PATH pathname)

Detect end-of-line style from ‘pathname‘.

Method: detect-end-of-line (STREAM stream)

Detect end-of-line style from ‘stream‘. Note that this method modifies ‘stream‘’s file position.

Method: detect-end-of-line (BUFFER vector)

Detect end-of-line style from ‘buffer‘.

Generic Function: detect-external-format INPUT SYMBOL
Package

inquisitor

Source

inquisitor.lisp (file)

Methods
Method: detect-external-format (PATH pathname) (SCHEME symbol)

Detect external-format from ‘pathname‘.

Method: detect-external-format (STREAM stream) (SCHEME symbol)

Detect external-format under the ‘scheme‘ from ‘buffer‘. Note that this method method modifies ‘stream‘’s file position.

Method: detect-external-format (BUFFER vector) (SCHEME symbol)

Detect external-format under the ‘scheme‘ from ‘buffer‘.


Previous: , Up: Definitions   [Contents][Index]

6.2 Internal definitions


Next: , Previous: , Up: Internal definitions   [Contents][Index]

6.2.1 Constants

Constant: +big5-ar+
Package

inquisitor.encoding.table

Source

table.lisp (file)

Constant: +big5-st+
Package

inquisitor.encoding.table

Source

table.lisp (file)

Constant: +cp1250-ar+
Package

inquisitor.encoding.table

Source

table.lisp (file)

Constant: +cp1250-st+
Package

inquisitor.encoding.table

Source

table.lisp (file)

Constant: +cp1251-ar+
Package

inquisitor.encoding.table

Source

table.lisp (file)

Constant: +cp1251-st+
Package

inquisitor.encoding.table

Source

table.lisp (file)

Constant: +cp1253-ar+
Package

inquisitor.encoding.table

Source

table.lisp (file)

Constant: +cp1253-st+
Package

inquisitor.encoding.table

Source

table.lisp (file)

Constant: +cp1254-ar+
Package

inquisitor.encoding.table

Source

table.lisp (file)

Constant: +cp1254-st+
Package

inquisitor.encoding.table

Source

table.lisp (file)

Constant: +cp1255-ar+
Package

inquisitor.encoding.table

Source

table.lisp (file)

Constant: +cp1255-st+
Package

inquisitor.encoding.table

Source

table.lisp (file)

Constant: +cp1256-ar+
Package

inquisitor.encoding.table

Source

table.lisp (file)

Constant: +cp1256-st+
Package

inquisitor.encoding.table

Source

table.lisp (file)

Constant: +cp1257-ar+
Package

inquisitor.encoding.table

Source

table.lisp (file)

Constant: +cp1257-st+
Package

inquisitor.encoding.table

Source

table.lisp (file)

Constant: +cp866-ar+
Package

inquisitor.encoding.table

Source

table.lisp (file)

Constant: +cp866-st+
Package

inquisitor.encoding.table

Source

table.lisp (file)

Constant: +cp932-ar+
Package

inquisitor.encoding.table

Source

table.lisp (file)

Constant: +cp932-st+
Package

inquisitor.encoding.table

Source

table.lisp (file)

Constant: +euc-jp-ar+
Package

inquisitor.encoding.table

Source

table.lisp (file)

Constant: +euc-jp-st+
Package

inquisitor.encoding.table

Source

table.lisp (file)

Constant: +euc-kr-ar+
Package

inquisitor.encoding.table

Source

table.lisp (file)

Constant: +euc-kr-st+
Package

inquisitor.encoding.table

Source

table.lisp (file)

Constant: +gb18030-ar+
Package

inquisitor.encoding.table

Source

table.lisp (file)

Constant: +gb18030-st+
Package

inquisitor.encoding.table

Source

table.lisp (file)

Constant: +gb2312-ar+
Package

inquisitor.encoding.table

Source

table.lisp (file)

Constant: +gb2312-st+
Package

inquisitor.encoding.table

Source

table.lisp (file)

Constant: +iso-2022-jp-ar+
Package

inquisitor.encoding.table

Source

table.lisp (file)

Constant: +iso-2022-jp-st+
Package

inquisitor.encoding.table

Source

table.lisp (file)

Constant: +iso-8859-13-ar+
Package

inquisitor.encoding.table

Source

table.lisp (file)

Constant: +iso-8859-13-st+
Package

inquisitor.encoding.table

Source

table.lisp (file)

Constant: +iso-8859-2-ar+
Package

inquisitor.encoding.table

Source

table.lisp (file)

Constant: +iso-8859-2-st+
Package

inquisitor.encoding.table

Source

table.lisp (file)

Constant: +iso-8859-5-ar+
Package

inquisitor.encoding.table

Source

table.lisp (file)

Constant: +iso-8859-5-st+
Package

inquisitor.encoding.table

Source

table.lisp (file)

Constant: +iso-8859-6-ar+
Package

inquisitor.encoding.table

Source

table.lisp (file)

Constant: +iso-8859-6-st+
Package

inquisitor.encoding.table

Source

table.lisp (file)

Constant: +iso-8859-7-ar+
Package

inquisitor.encoding.table

Source

table.lisp (file)

Constant: +iso-8859-7-st+
Package

inquisitor.encoding.table

Source

table.lisp (file)

Constant: +iso-8859-8-ar+
Package

inquisitor.encoding.table

Source

table.lisp (file)

Constant: +iso-8859-8-st+
Package

inquisitor.encoding.table

Source

table.lisp (file)

Constant: +iso-8859-9-ar+
Package

inquisitor.encoding.table

Source

table.lisp (file)

Constant: +iso-8859-9-st+
Package

inquisitor.encoding.table

Source

table.lisp (file)

Constant: +johab-ar+
Package

inquisitor.encoding.table

Source

table.lisp (file)

Constant: +johab-st+
Package

inquisitor.encoding.table

Source

table.lisp (file)

Constant: +koi8-r-ar+
Package

inquisitor.encoding.table

Source

table.lisp (file)

Constant: +koi8-r-st+
Package

inquisitor.encoding.table

Source

table.lisp (file)

Constant: +koi8-u-ar+
Package

inquisitor.encoding.table

Source

table.lisp (file)

Constant: +koi8-u-st+
Package

inquisitor.encoding.table

Source

table.lisp (file)

Constant: +ucs-2be-ar+
Package

inquisitor.encoding.table

Source

table.lisp (file)

Constant: +ucs-2be-st+
Package

inquisitor.encoding.table

Source

table.lisp (file)

Constant: +ucs-2le-ar+
Package

inquisitor.encoding.table

Source

table.lisp (file)

Constant: +ucs-2le-st+
Package

inquisitor.encoding.table

Source

table.lisp (file)

Constant: +utf-16-ar+
Package

inquisitor.encoding.table

Source

table.lisp (file)

Constant: +utf-16-st+
Package

inquisitor.encoding.table

Source

table.lisp (file)

Constant: +utf-8-ar+
Package

inquisitor.encoding.table

Source

table.lisp (file)

Constant: +utf-8-st+
Package

inquisitor.encoding.table

Source

table.lisp (file)


Next: , Previous: , Up: Internal definitions   [Contents][Index]

6.2.2 Special variables

Special Variable: *default-buffer-size*

Specifies default buffer size is consed and used by ‘dedect-encoding‘, ‘detect-end-of-line‘ and ‘detect-external-format‘.

Package

inquisitor

Source

inquisitor.lisp (file)

Special Variable: +name-mapping+
Package

inquisitor.names

Source

names.lisp (file)

Special Variable: +schemes+
Package

inquisitor.encoding.guess

Source

guess.lisp (file)


Next: , Previous: , Up: Internal definitions   [Contents][Index]

6.2.3 Macros

Macro: arcs DFA
Package

inquisitor.encoding.dfa

Source

dfa.lisp (file)

Macro: check-byte-order-mark BUFFER BIG-ENDIAN-VALUE LITTLE-ENDIAN-VALUE ORDER STATE
Package

inquisitor.encoding.guess

Source

guess.lisp (file)

Macro: dfa-alive DFA
Package

inquisitor.encoding.dfa

Source

dfa.lisp (file)

Macro: dfa-next DFA CH
Package

inquisitor.encoding.dfa

Source

dfa.lisp (file)

Macro: do-guess-loop (&rest LOOKAHEAD-VARS) BUFFER &body BODY
Package

inquisitor.encoding.guess

Source

guess.lisp (file)

Macro: guess (BUFFER ORDER STATE (&rest VARS) (&rest ENCS)) &body SPECIALIZED-CHECK
Package

inquisitor.encoding.guess

Source

guess.lisp (file)

Macro: score DFA
Package

inquisitor.encoding.dfa

Source

dfa.lisp (file)

Macro: state DFA
Package

inquisitor.encoding.dfa

Source

dfa.lisp (file)

Macro: states DFA
Package

inquisitor.encoding.dfa

Source

dfa.lisp (file)


Next: , Previous: , Up: Internal definitions   [Contents][Index]

6.2.4 Functions

Function: dfa-alone DFA ORDER
Package

inquisitor.encoding.dfa

Source

dfa.lisp (file)

Function: guess-ar BUFFER &optional ORDER STATE
Package

inquisitor.encoding.guess

Source

guess.lisp (file)

Function: guess-bl BUFFER &optional ORDER STATE
Package

inquisitor.encoding.guess

Source

guess.lisp (file)

Function: guess-cn BUFFER &optional ORDER STATE
Package

inquisitor.encoding.guess

Source

guess.lisp (file)

Function: guess-gr BUFFER &optional ORDER STATE
Package

inquisitor.encoding.guess

Source

guess.lisp (file)

Function: guess-hw BUFFER &optional ORDER STATE
Package

inquisitor.encoding.guess

Source

guess.lisp (file)

Function: guess-jp BUFFER &optional ORDER STATE
Package

inquisitor.encoding.guess

Source

guess.lisp (file)

Function: guess-kr BUFFER &optional ORDER STATE
Package

inquisitor.encoding.guess

Source

guess.lisp (file)

Function: guess-pl BUFFER &optional ORDER STATE
Package

inquisitor.encoding.guess

Source

guess.lisp (file)

Function: guess-ru BUFFER &optional ORDER STATE
Package

inquisitor.encoding.guess

Source

guess.lisp (file)

Function: guess-tr BUFFER &optional ORDER STATE
Package

inquisitor.encoding.guess

Source

guess.lisp (file)

Function: guess-tw BUFFER &optional ORDER STATE
Package

inquisitor.encoding.guess

Source

guess.lisp (file)

Function: resolve-states STATE-DEFS
Package

inquisitor.encoding.dfa

Source

dfa.lisp (file)


Next: , Previous: , Up: Internal definitions   [Contents][Index]

6.2.5 Generic functions

Generic Function: arcs-of OBJECT
Generic Function: (setf arcs-of) NEW-VALUE OBJECT
Package

inquisitor.encoding.dfa

Methods
Method: arcs-of (<STATE> <state>)

automatically generated reader method

Source

dfa.lisp (file)

Method: (setf arcs-of) NEW-VALUE (<STATE> <state>)

automatically generated writer method

Source

dfa.lisp (file)

Generic Function: from-state-of OBJECT
Generic Function: (setf from-state-of) NEW-VALUE OBJECT
Package

inquisitor.encoding.dfa

Methods
Method: from-state-of (<ARC> <arc>)

automatically generated reader method

Source

dfa.lisp (file)

Method: (setf from-state-of) NEW-VALUE (<ARC> <arc>)

automatically generated writer method

Source

dfa.lisp (file)

Generic Function: index-of OBJECT
Generic Function: (setf index-of) NEW-VALUE OBJECT
Package

inquisitor.encoding.dfa

Methods
Method: index-of (<ARC> <arc>)

automatically generated reader method

Source

dfa.lisp (file)

Method: (setf index-of) NEW-VALUE (<ARC> <arc>)

automatically generated writer method

Source

dfa.lisp (file)

Method: index-of (<STATE> <state>)

automatically generated reader method

Source

dfa.lisp (file)

Method: (setf index-of) NEW-VALUE (<STATE> <state>)

automatically generated writer method

Source

dfa.lisp (file)

Generic Function: name-of OBJECT
Generic Function: (setf name-of) NEW-VALUE OBJECT
Package

inquisitor.encoding.dfa

Methods
Method: name-of (<STATE> <state>)

automatically generated reader method

Source

dfa.lisp (file)

Method: (setf name-of) NEW-VALUE (<STATE> <state>)

automatically generated writer method

Source

dfa.lisp (file)

Method: name-of (<DFA> <dfa>)

automatically generated reader method

Source

dfa.lisp (file)

Method: (setf name-of) NEW-VALUE (<DFA> <dfa>)

automatically generated writer method

Source

dfa.lisp (file)

Generic Function: ranges-of OBJECT
Generic Function: (setf ranges-of) NEW-VALUE OBJECT
Package

inquisitor.encoding.dfa

Methods
Method: ranges-of (<ARC> <arc>)

automatically generated reader method

Source

dfa.lisp (file)

Method: (setf ranges-of) NEW-VALUE (<ARC> <arc>)

automatically generated writer method

Source

dfa.lisp (file)

Generic Function: score-of OBJECT
Generic Function: (setf score-of) NEW-VALUE OBJECT
Package

inquisitor.encoding.dfa

Methods
Method: score-of (<ARC> <arc>)

automatically generated reader method

Source

dfa.lisp (file)

Method: (setf score-of) NEW-VALUE (<ARC> <arc>)

automatically generated writer method

Source

dfa.lisp (file)

Generic Function: states-of OBJECT
Generic Function: (setf states-of) NEW-VALUE OBJECT
Package

inquisitor.encoding.dfa

Methods
Method: states-of (<DFA> <dfa>)

automatically generated reader method

Source

dfa.lisp (file)

Method: (setf states-of) NEW-VALUE (<DFA> <dfa>)

automatically generated writer method

Source

dfa.lisp (file)

Generic Function: to-state-of OBJECT
Generic Function: (setf to-state-of) NEW-VALUE OBJECT
Package

inquisitor.encoding.dfa

Methods
Method: to-state-of (<ARC> <arc>)

automatically generated reader method

Source

dfa.lisp (file)

Method: (setf to-state-of) NEW-VALUE (<ARC> <arc>)

automatically generated writer method

Source

dfa.lisp (file)


Previous: , Up: Internal definitions   [Contents][Index]

6.2.6 Classes

Class: <arc> ()
Package

inquisitor.encoding.dfa

Source

dfa.lisp (file)

Direct superclasses

standard-object (class)

Direct methods
Direct slots
Slot: from-state
Initargs

:from-state

Readers

from-state-of (generic function)

Writers

(setf from-state-of) (generic function)

Slot: to-state
Initargs

:to-state

Readers

to-state-of (generic function)

Writers

(setf to-state-of) (generic function)

Slot: ranges
Initargs

:ranges

Readers

ranges-of (generic function)

Writers

(setf ranges-of) (generic function)

Slot: index
Initargs

:index

Readers

index-of (generic function)

Writers

(setf index-of) (generic function)

Slot: score
Initargs

:score

Readers

score-of (generic function)

Writers

(setf score-of) (generic function)

Class: <dfa> ()
Package

inquisitor.encoding.dfa

Source

dfa.lisp (file)

Direct superclasses

standard-object (class)

Direct methods
Direct slots
Slot: name
Initargs

:name

Readers

name-of (generic function)

Writers

(setf name-of) (generic function)

Slot: states
Initargs

:states

Readers

states-of (generic function)

Writers

(setf states-of) (generic function)

Class: <state> ()
Package

inquisitor.encoding.dfa

Source

dfa.lisp (file)

Direct superclasses

standard-object (class)

Direct methods
Direct slots
Slot: name
Initargs

:name

Readers

name-of (generic function)

Writers

(setf name-of) (generic function)

Slot: index
Initargs

:index

Readers

index-of (generic function)

Writers

(setf index-of) (generic function)

Slot: arcs
Initargs

:arcs

Readers

arcs-of (generic function)

Writers

(setf arcs-of) (generic function)


Previous: , Up: Top   [Contents][Index]

Appendix A Indexes


Next: , Previous: , Up: Indexes   [Contents][Index]

A.1 Concepts

Jump to:   F   I   L   M  
Index Entry  Section

F
File, Lisp, inquisitor.asd: The inquisitor<dot>asd file
File, Lisp, inquisitor/src/encoding/dfa.lisp: The inquisitor/src/encoding/dfa<dot>lisp file
File, Lisp, inquisitor/src/encoding/guess.lisp: The inquisitor/src/encoding/guess<dot>lisp file
File, Lisp, inquisitor/src/encoding/table.lisp: The inquisitor/src/encoding/table<dot>lisp file
File, Lisp, inquisitor/src/eol.lisp: The inquisitor/src/eol<dot>lisp file
File, Lisp, inquisitor/src/external-format.lisp: The inquisitor/src/external-format<dot>lisp file
File, Lisp, inquisitor/src/inquisitor.lisp: The inquisitor/src/inquisitor<dot>lisp file
File, Lisp, inquisitor/src/names.lisp: The inquisitor/src/names<dot>lisp file
File, Lisp, inquisitor/src/util.lisp: The inquisitor/src/util<dot>lisp file

I
inquisitor.asd: The inquisitor<dot>asd file
inquisitor/src: The inquisitor/src module
inquisitor/src/encoding: The inquisitor/src/encoding module
inquisitor/src/encoding/dfa.lisp: The inquisitor/src/encoding/dfa<dot>lisp file
inquisitor/src/encoding/guess.lisp: The inquisitor/src/encoding/guess<dot>lisp file
inquisitor/src/encoding/table.lisp: The inquisitor/src/encoding/table<dot>lisp file
inquisitor/src/eol.lisp: The inquisitor/src/eol<dot>lisp file
inquisitor/src/external-format.lisp: The inquisitor/src/external-format<dot>lisp file
inquisitor/src/inquisitor.lisp: The inquisitor/src/inquisitor<dot>lisp file
inquisitor/src/names.lisp: The inquisitor/src/names<dot>lisp file
inquisitor/src/util.lisp: The inquisitor/src/util<dot>lisp file

L
Lisp File, inquisitor.asd: The inquisitor<dot>asd file
Lisp File, inquisitor/src/encoding/dfa.lisp: The inquisitor/src/encoding/dfa<dot>lisp file
Lisp File, inquisitor/src/encoding/guess.lisp: The inquisitor/src/encoding/guess<dot>lisp file
Lisp File, inquisitor/src/encoding/table.lisp: The inquisitor/src/encoding/table<dot>lisp file
Lisp File, inquisitor/src/eol.lisp: The inquisitor/src/eol<dot>lisp file
Lisp File, inquisitor/src/external-format.lisp: The inquisitor/src/external-format<dot>lisp file
Lisp File, inquisitor/src/inquisitor.lisp: The inquisitor/src/inquisitor<dot>lisp file
Lisp File, inquisitor/src/names.lisp: The inquisitor/src/names<dot>lisp file
Lisp File, inquisitor/src/util.lisp: The inquisitor/src/util<dot>lisp file

M
Module, inquisitor/src: The inquisitor/src module
Module, inquisitor/src/encoding: The inquisitor/src/encoding module

Jump to:   F   I   L   M  

Next: , Previous: , Up: Indexes   [Contents][Index]

A.2 Functions

Jump to:   %   (  
A   B   C   D   E   F   G   I   L   M   N   R   S   T   U   W  
Index Entry  Section

%
%make-external-format: Exported generic functions
%make-external-format: Exported generic functions

(
(setf arcs-of): Internal generic functions
(setf arcs-of): Internal generic functions
(setf from-state-of): Internal generic functions
(setf from-state-of): Internal generic functions
(setf index-of): Internal generic functions
(setf index-of): Internal generic functions
(setf index-of): Internal generic functions
(setf name-of): Internal generic functions
(setf name-of): Internal generic functions
(setf name-of): Internal generic functions
(setf ranges-of): Internal generic functions
(setf ranges-of): Internal generic functions
(setf score-of): Internal generic functions
(setf score-of): Internal generic functions
(setf states-of): Internal generic functions
(setf states-of): Internal generic functions
(setf to-state-of): Internal generic functions
(setf to-state-of): Internal generic functions

A
arcs: Internal macros
arcs-of: Internal generic functions
arcs-of: Internal generic functions

B
byte-array-p: Exported functions
byte-input-stream-p: Exported functions

C
ces-guess-from-vector: Exported functions
check-byte-order-mark: Internal macros

D
define-dfa: Exported macros
dependent-name: Exported functions
detect-encoding: Exported generic functions
detect-encoding: Exported generic functions
detect-encoding: Exported generic functions
detect-encoding: Exported generic functions
detect-end-of-line: Exported generic functions
detect-end-of-line: Exported generic functions
detect-end-of-line: Exported generic functions
detect-end-of-line: Exported generic functions
detect-external-format: Exported generic functions
detect-external-format: Exported generic functions
detect-external-format: Exported generic functions
detect-external-format: Exported generic functions
dfa-alive: Internal macros
dfa-alone: Internal functions
dfa-init: Exported macros
dfa-name: Exported macros
dfa-next: Internal macros
dfa-none: Exported functions
dfa-process: Exported macros
dfa-top: Exported functions
do-guess-loop: Internal macros

E
eol-available-p: Exported functions
eol-guess-from-vector: Exported functions

F
from-state-of: Internal generic functions
from-state-of: Internal generic functions
Function, byte-array-p: Exported functions
Function, byte-input-stream-p: Exported functions
Function, ces-guess-from-vector: Exported functions
Function, dependent-name: Exported functions
Function, dfa-alone: Internal functions
Function, dfa-none: Exported functions
Function, dfa-top: Exported functions
Function, eol-available-p: Exported functions
Function, eol-guess-from-vector: Exported functions
Function, guess-ar: Internal functions
Function, guess-bl: Internal functions
Function, guess-cn: Internal functions
Function, guess-gr: Internal functions
Function, guess-hw: Internal functions
Function, guess-jp: Internal functions
Function, guess-kr: Internal functions
Function, guess-pl: Internal functions
Function, guess-ru: Internal functions
Function, guess-tr: Internal functions
Function, guess-tw: Internal functions
Function, independent-name: Exported functions
Function, list-available-scheme: Exported functions
Function, make-external-format: Exported functions
Function, resolve-states: Internal functions
Function, unicode-p: Exported functions

G
generate-order: Exported macros
Generic Function, %make-external-format: Exported generic functions
Generic Function, (setf arcs-of): Internal generic functions
Generic Function, (setf from-state-of): Internal generic functions
Generic Function, (setf index-of): Internal generic functions
Generic Function, (setf name-of): Internal generic functions
Generic Function, (setf ranges-of): Internal generic functions
Generic Function, (setf score-of): Internal generic functions
Generic Function, (setf states-of): Internal generic functions
Generic Function, (setf to-state-of): Internal generic functions
Generic Function, arcs-of: Internal generic functions
Generic Function, detect-encoding: Exported generic functions
Generic Function, detect-end-of-line: Exported generic functions
Generic Function, detect-external-format: Exported generic functions
Generic Function, from-state-of: Internal generic functions
Generic Function, index-of: Internal generic functions
Generic Function, name-of: Internal generic functions
Generic Function, ranges-of: Internal generic functions
Generic Function, score-of: Internal generic functions
Generic Function, states-of: Internal generic functions
Generic Function, to-state-of: Internal generic functions
guess: Internal macros
guess-ar: Internal functions
guess-bl: Internal functions
guess-cn: Internal functions
guess-gr: Internal functions
guess-hw: Internal functions
guess-jp: Internal functions
guess-kr: Internal functions
guess-pl: Internal functions
guess-ru: Internal functions
guess-tr: Internal functions
guess-tw: Internal functions

I
independent-name: Exported functions
index-of: Internal generic functions
index-of: Internal generic functions
index-of: Internal generic functions

L
list-available-scheme: Exported functions

M
Macro, arcs: Internal macros
Macro, check-byte-order-mark: Internal macros
Macro, define-dfa: Exported macros
Macro, dfa-alive: Internal macros
Macro, dfa-init: Exported macros
Macro, dfa-name: Exported macros
Macro, dfa-next: Internal macros
Macro, dfa-process: Exported macros
Macro, do-guess-loop: Internal macros
Macro, generate-order: Exported macros
Macro, guess: Internal macros
Macro, score: Internal macros
Macro, state: Internal macros
Macro, states: Internal macros
Macro, with-byte-array: Exported macros
make-external-format: Exported functions
Method, %make-external-format: Exported generic functions
Method, (setf arcs-of): Internal generic functions
Method, (setf from-state-of): Internal generic functions
Method, (setf index-of): Internal generic functions
Method, (setf index-of): Internal generic functions
Method, (setf name-of): Internal generic functions
Method, (setf name-of): Internal generic functions
Method, (setf ranges-of): Internal generic functions
Method, (setf score-of): Internal generic functions
Method, (setf states-of): Internal generic functions
Method, (setf to-state-of): Internal generic functions
Method, arcs-of: Internal generic functions
Method, detect-encoding: Exported generic functions
Method, detect-encoding: Exported generic functions
Method, detect-encoding: Exported generic functions
Method, detect-end-of-line: Exported generic functions
Method, detect-end-of-line: Exported generic functions
Method, detect-end-of-line: Exported generic functions
Method, detect-external-format: Exported generic functions
Method, detect-external-format: Exported generic functions
Method, detect-external-format: Exported generic functions
Method, from-state-of: Internal generic functions
Method, index-of: Internal generic functions
Method, index-of: Internal generic functions
Method, name-of: Internal generic functions
Method, name-of: Internal generic functions
Method, ranges-of: Internal generic functions
Method, score-of: Internal generic functions
Method, states-of: Internal generic functions
Method, to-state-of: Internal generic functions

N
name-of: Internal generic functions
name-of: Internal generic functions
name-of: Internal generic functions

R
ranges-of: Internal generic functions
ranges-of: Internal generic functions
resolve-states: Internal functions

S
score: Internal macros
score-of: Internal generic functions
score-of: Internal generic functions
state: Internal macros
states: Internal macros
states-of: Internal generic functions
states-of: Internal generic functions

T
to-state-of: Internal generic functions
to-state-of: Internal generic functions

U
unicode-p: Exported functions

W
with-byte-array: Exported macros

Jump to:   %   (  
A   B   C   D   E   F   G   I   L   M   N   R   S   T   U   W  

Next: , Previous: , Up: Indexes   [Contents][Index]

A.3 Variables

Jump to:   *   +  
A   C   F   I   N   R   S   T  
Index Entry  Section

*
*default-buffer-size*: Internal special variables

+
+available-encodings+: Exported special variables
+available-eols+: Exported special variables
+big5-ar+: Internal constants
+big5-st+: Internal constants
+cp1250-ar+: Internal constants
+cp1250-st+: Internal constants
+cp1251-ar+: Internal constants
+cp1251-st+: Internal constants
+cp1253-ar+: Internal constants
+cp1253-st+: Internal constants
+cp1254-ar+: Internal constants
+cp1254-st+: Internal constants
+cp1255-ar+: Internal constants
+cp1255-st+: Internal constants
+cp1256-ar+: Internal constants
+cp1256-st+: Internal constants
+cp1257-ar+: Internal constants
+cp1257-st+: Internal constants
+cp866-ar+: Internal constants
+cp866-st+: Internal constants
+cp932-ar+: Internal constants
+cp932-st+: Internal constants
+euc-jp-ar+: Internal constants
+euc-jp-st+: Internal constants
+euc-kr-ar+: Internal constants
+euc-kr-st+: Internal constants
+gb18030-ar+: Internal constants
+gb18030-st+: Internal constants
+gb2312-ar+: Internal constants
+gb2312-st+: Internal constants
+iso-2022-jp-ar+: Internal constants
+iso-2022-jp-st+: Internal constants
+iso-8859-13-ar+: Internal constants
+iso-8859-13-st+: Internal constants
+iso-8859-2-ar+: Internal constants
+iso-8859-2-st+: Internal constants
+iso-8859-5-ar+: Internal constants
+iso-8859-5-st+: Internal constants
+iso-8859-6-ar+: Internal constants
+iso-8859-6-st+: Internal constants
+iso-8859-7-ar+: Internal constants
+iso-8859-7-st+: Internal constants
+iso-8859-8-ar+: Internal constants
+iso-8859-8-st+: Internal constants
+iso-8859-9-ar+: Internal constants
+iso-8859-9-st+: Internal constants
+johab-ar+: Internal constants
+johab-st+: Internal constants
+koi8-r-ar+: Internal constants
+koi8-r-st+: Internal constants
+koi8-u-ar+: Internal constants
+koi8-u-st+: Internal constants
+name-mapping+: Internal special variables
+schemes+: Internal special variables
+ucs-2be-ar+: Internal constants
+ucs-2be-st+: Internal constants
+ucs-2le-ar+: Internal constants
+ucs-2le-st+: Internal constants
+utf-16-ar+: Internal constants
+utf-16-st+: Internal constants
+utf-8-ar+: Internal constants
+utf-8-st+: Internal constants

A
arcs: Internal classes

C
Constant, +big5-ar+: Internal constants
Constant, +big5-st+: Internal constants
Constant, +cp1250-ar+: Internal constants
Constant, +cp1250-st+: Internal constants
Constant, +cp1251-ar+: Internal constants
Constant, +cp1251-st+: Internal constants
Constant, +cp1253-ar+: Internal constants
Constant, +cp1253-st+: Internal constants
Constant, +cp1254-ar+: Internal constants
Constant, +cp1254-st+: Internal constants
Constant, +cp1255-ar+: Internal constants
Constant, +cp1255-st+: Internal constants
Constant, +cp1256-ar+: Internal constants
Constant, +cp1256-st+: Internal constants
Constant, +cp1257-ar+: Internal constants
Constant, +cp1257-st+: Internal constants
Constant, +cp866-ar+: Internal constants
Constant, +cp866-st+: Internal constants
Constant, +cp932-ar+: Internal constants
Constant, +cp932-st+: Internal constants
Constant, +euc-jp-ar+: Internal constants
Constant, +euc-jp-st+: Internal constants
Constant, +euc-kr-ar+: Internal constants
Constant, +euc-kr-st+: Internal constants
Constant, +gb18030-ar+: Internal constants
Constant, +gb18030-st+: Internal constants
Constant, +gb2312-ar+: Internal constants
Constant, +gb2312-st+: Internal constants
Constant, +iso-2022-jp-ar+: Internal constants
Constant, +iso-2022-jp-st+: Internal constants
Constant, +iso-8859-13-ar+: Internal constants
Constant, +iso-8859-13-st+: Internal constants
Constant, +iso-8859-2-ar+: Internal constants
Constant, +iso-8859-2-st+: Internal constants
Constant, +iso-8859-5-ar+: Internal constants
Constant, +iso-8859-5-st+: Internal constants
Constant, +iso-8859-6-ar+: Internal constants
Constant, +iso-8859-6-st+: Internal constants
Constant, +iso-8859-7-ar+: Internal constants
Constant, +iso-8859-7-st+: Internal constants
Constant, +iso-8859-8-ar+: Internal constants
Constant, +iso-8859-8-st+: Internal constants
Constant, +iso-8859-9-ar+: Internal constants
Constant, +iso-8859-9-st+: Internal constants
Constant, +johab-ar+: Internal constants
Constant, +johab-st+: Internal constants
Constant, +koi8-r-ar+: Internal constants
Constant, +koi8-r-st+: Internal constants
Constant, +koi8-u-ar+: Internal constants
Constant, +koi8-u-st+: Internal constants
Constant, +ucs-2be-ar+: Internal constants
Constant, +ucs-2be-st+: Internal constants
Constant, +ucs-2le-ar+: Internal constants
Constant, +ucs-2le-st+: Internal constants
Constant, +utf-16-ar+: Internal constants
Constant, +utf-16-st+: Internal constants
Constant, +utf-8-ar+: Internal constants
Constant, +utf-8-st+: Internal constants

F
from-state: Internal classes

I
index: Internal classes
index: Internal classes

N
name: Internal classes
name: Internal classes

R
ranges: Internal classes

S
score: Internal classes
Slot, arcs: Internal classes
Slot, from-state: Internal classes
Slot, index: Internal classes
Slot, index: Internal classes
Slot, name: Internal classes
Slot, name: Internal classes
Slot, ranges: Internal classes
Slot, score: Internal classes
Slot, states: Internal classes
Slot, to-state: Internal classes
Special Variable, *default-buffer-size*: Internal special variables
Special Variable, +available-encodings+: Exported special variables
Special Variable, +available-eols+: Exported special variables
Special Variable, +name-mapping+: Internal special variables
Special Variable, +schemes+: Internal special variables
states: Internal classes

T
to-state: Internal classes

Jump to:   *   +  
A   C   F   I   N   R   S   T  

Previous: , Up: Indexes   [Contents][Index]

A.4 Data types

Jump to:   <  
C   I   P   S  
Index Entry  Section

<
<arc>: Internal classes
<dfa>: Internal classes
<state>: Internal classes

C
Class, <arc>: Internal classes
Class, <dfa>: Internal classes
Class, <state>: Internal classes

I
inquisitor: The inquisitor system
inquisitor: The inquisitor package
inquisitor-asd: The inquisitor-asd package
inquisitor.encoding.dfa: The inquisitor<dot>encoding<dot>dfa package
inquisitor.encoding.guess: The inquisitor<dot>encoding<dot>guess package
inquisitor.encoding.table: The inquisitor<dot>encoding<dot>table package
inquisitor.eol: The inquisitor<dot>eol package
inquisitor.external-format: The inquisitor<dot>external-format package
inquisitor.names: The inquisitor<dot>names package
inquisitor.util: The inquisitor<dot>util package

P
Package, inquisitor: The inquisitor package
Package, inquisitor-asd: The inquisitor-asd package
Package, inquisitor.encoding.dfa: The inquisitor<dot>encoding<dot>dfa package
Package, inquisitor.encoding.guess: The inquisitor<dot>encoding<dot>guess package
Package, inquisitor.encoding.table: The inquisitor<dot>encoding<dot>table package
Package, inquisitor.eol: The inquisitor<dot>eol package
Package, inquisitor.external-format: The inquisitor<dot>external-format package
Package, inquisitor.names: The inquisitor<dot>names package
Package, inquisitor.util: The inquisitor<dot>util package

S
System, inquisitor: The inquisitor system

Jump to:   <  
C   I   P   S