The monomyth Reference Manual

Table of Contents

The monomyth Reference Manual

This is the monomyth Reference Manual, version 0.3.1, generated automatically by Declt version 3.0 "Montgomery Scott" on Mon Apr 19 17:08:18 2021 GMT+0.

1 Introduction

Monomyth

Monomyth is a distributed data processing system built using Common Lisp and based heavily on Broadway. It is designed to split the messaging systems into two, one defined and controlled by Monomyth, and one defined and controlled by the user. The messaging controlled by the user pertains only to data, which moves between persisted data streams and node threads. The structure and manipulation of this data is largely defined by the user (though there are data stream specific aspects certain node types might handle). Monomyth itself handles all aspects of system orchestration via the Monomyth Orchestration Protocol (MMOP). The work itself is done on a group of distributed workers that use concurrent, user defined nodes to process the data and are controlled by a single master server.

Design documentation can be found at design/doc.org.

Tests

To run the tests you will need to have roswell and qlot installed, the tests have been verified on SBCL 2.0.3. Then perform the following:

source test_env.sh
docker-compose up -d
qlot install
qlot exec ./bin/test.ros

Example

The example right now is pretty arbitrary, both in set up and the computations involved. In one process start qlot exec ./bin/example-master.ros, and then in a few others run qlot exec ./bin/example-worker.ros. Once all the workers have connected to the master (you will see log entries), press the return button in the first process.

Status

This project has its basic architecture set up, but lacks most of the functionality needed for a 1.0 release.

The features likely to be targeted for a 1.0 release:

• Support for sending the results of a node to multiple queues.
• DSL support for sending multiple nodes to a single queue.
• DSL support filtering which message goes to which queue.
• DSL support for iteration.
• Support for nodes not sending messages anywhere at all (for loading nodes).
• Support for nodes not picking messages off queue (for generators).
• Basic heartbeat and restart for workers.
• Basic monitoring of workers and nodes, possibly data flow.
• More fine grained control of node threads.
• Startup CLI.
• Possible (but very unlikely) Kafka support.

2 Systems

The main system appears first, followed by any subsystem dependency.

2.1 monomyth

Author

Paul Ricks

License

MPL 2.0

Description

A distributed data processing library for CL

Version

0.3.1

Dependencies

• flexi-streams
• cl-store
• stmx
• closer-mop
• rutils
• trivia
• optima
• jonathan
• fset
• alexandria
• cl-algebraic-data-type
• pzmq
• uuid
• iterate
• verbose
• cl-rabbit
• babel

Source

monomyth.asd (file)

Component

src (module)

3 Modules

Modules are listed depth-first from the system components tree.

3.1 monomyth/src

Parent

monomyth (system)

Location

src/

Components

• node-recipe.lisp (file)
• mmop.lisp (file)
• mmop-worker.lisp (file)
• mmop-master.lisp (file)
• mmop-control.lisp (file)
• node.lisp (file)
• rmq-node.lisp (file)
• rmq-node-recipe.lisp (file)
• worker.lisp (file)
• rmq-worker.lisp (file)
• master.lisp (file)
• dsl.lisp (file)

4 Files

Files are sorted by type and then listed depth-first from the systems components trees.

4.1 Lisp

4.1.1 monomyth.asd

Location

monomyth.asd

Systems

monomyth (system)

4.1.2 monomyth/src/node-recipe.lisp

Parent

src (module)

Location

src/node-recipe.lisp

Packages

monomyth/node-recipe

Exported Definitions

• deserialize-recipe (function)
• name-node (generic function)
• name-node (method)
• node-recipe (class)
• node-recipe/batch-size (method)
• node-recipe/type (method)
• serialize-recipe (function)

4.1.3 monomyth/src/mmop.lisp

Parent

src (module)

Location

src/mmop.lisp

Packages

monomyth/mmop

Exported Definitions

• *mmop-v0* (special variable)
• *mmop-versions* (special variable)
• create-frames (generic function)
• mmop-error (condition)
• mmop-error/message (method)
• mmop-error/version (method)
• pull-msg (function)
• send-msg (function)
• send-msg-frames (function)

Internal Definitions

handle-libzmq-error (macro)

4.1.4 monomyth/src/mmop-worker.lisp

Parent

src (module)

Location

src/mmop-worker.lisp

Packages

monomyth/mmop-worker

Exported Definitions

• create-frames (method)
• create-frames (method)
• create-frames (method)
• pull-worker-message (function)
• received-mmop (structure)
• sent-mmop (structure)
• shutdown-worker-v0 (constant)
• shutdown-worker-v0 (structure)
• start-node-failure-v0 (function)
• start-node-failure-v0 (structure)
• start-node-success-v0 (function)
• start-node-success-v0 (structure)
• start-node-v0 (function)
• start-node-v0 (structure)
• worker-ready-v0 (constant)
• worker-ready-v0 (structure)

Internal Definitions

• start-node-failure-v0%0 (function)
• start-node-failure-v0%1 (function)
• start-node-failure-v0%2 (function)
• start-node-success-v0%0 (function)
• start-node-v0%0 (function)
• start-node-v0%1 (function)
• translate-v0 (function)

4.1.5 monomyth/src/mmop-master.lisp

Parent

src (module)

Location

src/mmop-master.lisp

Packages

monomyth/mmop-master

Exported Definitions

• create-frames (method)
• create-frames (method)
• create-frames (method)
• create-frames (method)
• create-frames (method)
• create-frames (method)
• create-frames (method)
• create-frames (method)
• json-info-response-v0 (function)
• json-info-response-v0 (structure)
• ping-v0 (function)
• ping-v0 (structure)
• pong-v0 (function)
• pong-v0 (structure)
• pull-master-message (function)
• received-mmop (structure)
• recipe-info-v0 (function)
• recipe-info-v0 (structure)
• sent-mmop (structure)
• shutdown-worker-v0 (function)
• shutdown-worker-v0 (structure)
• start-node-failure-v0 (function)
• start-node-failure-v0 (structure)
• start-node-request-failure-v0 (function)
• start-node-request-failure-v0 (structure)
• start-node-request-success-v0 (function)
• start-node-request-success-v0 (structure)
• start-node-request-v0 (function)
• start-node-request-v0 (structure)
• start-node-success-v0 (function)
• start-node-success-v0 (structure)
• start-node-v0 (function)
• start-node-v0 (structure)
• stop-worker-request-failure-v0 (function)
• stop-worker-request-failure-v0 (structure)
• stop-worker-request-success-v0 (function)
• stop-worker-request-success-v0 (structure)
• stop-worker-request-v0 (function)
• stop-worker-request-v0 (structure)
• worker-info-v0 (function)
• worker-info-v0 (structure)
• worker-ready-v0 (function)
• worker-ready-v0 (structure)

Internal Definitions

• json-info-response-v0%0 (function)
• json-info-response-v0%1 (function)
• ping-v0%0 (function)
• pong-v0%0 (function)
• recipe-info-v0%0 (function)
• shutdown-worker-v0%0 (function)
• start-node-failure-v0%0 (function)
• start-node-failure-v0%1 (function)
• start-node-failure-v0%2 (function)
• start-node-failure-v0%3 (function)
• start-node-request-failure-v0%0 (function)
• start-node-request-failure-v0%1 (function)
• start-node-request-failure-v0%2 (function)
• start-node-request-success-v0%0 (function)
• start-node-request-v0%0 (function)
• start-node-request-v0%1 (function)
• start-node-success-v0%0 (function)
• start-node-success-v0%1 (function)
• start-node-v0%0 (function)
• start-node-v0%1 (function)
• stop-worker-request-failure-v0%0 (function)
• stop-worker-request-failure-v0%1 (function)
• stop-worker-request-failure-v0%2 (function)
• stop-worker-request-success-v0%0 (function)
• stop-worker-request-v0%0 (function)
• stop-worker-request-v0%1 (function)
• translate-v0 (function)
• worker-info-v0%0 (function)
• worker-ready-v0%0 (function)

4.1.6 monomyth/src/mmop-control.lisp

Parent

src (module)

Location

src/mmop-control.lisp

Packages

monomyth/mmop-control

Exported Definitions

• create-frames (method)
• create-frames (method)
• create-frames (method)
• create-frames (method)
• create-frames (method)
• json-info-response-v0 (function)
• json-info-response-v0 (structure)
• ping-v0 (constant)
• ping-v0 (structure)
• pong-v0 (constant)
• pong-v0 (structure)
• pull-control-message (function)
• received-mmop (structure)
• recipe-info-v0 (constant)
• recipe-info-v0 (structure)
• sent-mmop (structure)
• start-node-request-failure-v0 (function)
• start-node-request-failure-v0 (structure)
• start-node-request-success-v0 (constant)
• start-node-request-success-v0 (structure)
• start-node-request-v0 (function)
• start-node-request-v0 (structure)
• stop-worker-request-failure-v0 (function)
• stop-worker-request-failure-v0 (structure)
• stop-worker-request-success-v0 (constant)
• stop-worker-request-success-v0 (structure)
• stop-worker-request-v0 (function)
• stop-worker-request-v0 (structure)
• worker-info-v0 (constant)
• worker-info-v0 (structure)

Internal Definitions

• json-info-response-v0%0 (function)
• start-node-request-failure-v0%0 (function)
• start-node-request-failure-v0%1 (function)
• start-node-request-v0%0 (function)
• stop-worker-request-failure-v0%0 (function)
• stop-worker-request-failure-v0%1 (function)
• stop-worker-request-v0%0 (function)
• translate-v0 (function)

4.1.7 monomyth/src/node.lisp

Parent

src (module)

Location

src/node.lisp

Packages

monomyth/node

Exported Definitions

• handle-failure (generic function)
• node (class)
• node-error (condition)
• node-error/items (method)
• node-error/step (method)
• node/batch-size (method)
• node/node-name (method)
• node/type (method)
• place-items (generic function)
• pull-items (generic function)
• run-iteration (generic function)
• run-iteration (method)
• shutdown (generic function)
• shutdown (method)
• startup (generic function)
• startup (method)
• transform-fn (generic function)
• transform-items (generic function)
• transform-items (method)

Internal Definitions

• node-error/message (method)
• node/running (method)
• (setf node/running) (method)

4.1.8 monomyth/src/rmq-node.lisp

Dependency

node.lisp (file)

Parent

src (module)

Location

src/rmq-node.lisp

Packages

monomyth/rmq-node

Exported Definitions

• ack-message (function)
• build-rmq-message (function)
• get-message (function)
• handle-failure (method)
• nack-message (function)
• place-items (method)
• pull-items (method)
• rmq-message-body (function)
• (setf rmq-message-body) (function)
• rmq-message-delivery-tag (function)
• rmq-node (class)
• send-message (function)
• setup-connection (function)
• shutdown (method)
• startup (method)
• transform-items (method)

Internal Definitions

• *channel* (special variable)
• *get-timeout* (special variable)
• build-error-response (function)
• copy-rmq-message (function)
• rabbit-mq-call (macro)
• rmq-message (structure)
• rmq-message-p (function)
• rmq-node/conn (method)
• rmq-node/dest-queue (method)
• rmq-node/exchange (method)
• rmq-node/fail-queue (method)
• rmq-node/source-queue (method)

4.1.9 monomyth/src/rmq-node-recipe.lisp

Dependency

node-recipe.lisp (file)

Parent

src (module)

Location

src/rmq-node-recipe.lisp

Packages

monomyth/rmq-node-recipe

Exported Definitions

• name-fail-queue (generic function)
• name-fail-queue (method)
• rmq-node-recipe (class)
• rmq-node-recipe/dest-queue (method)
• rmq-node-recipe/source-queue (method)

4.1.10 monomyth/src/worker.lisp

Dependencies

• node.lisp (file)
• mmop.lisp (file)
• mmop-worker.lisp (file)

Parent

src (module)

Location

src/worker.lisp

Packages

monomyth/worker

Exported Definitions

• build-node (generic function)
• run-worker (function)
• start-worker (generic function)
• start-worker (method)
• stop-worker (generic function)
• stop-worker (method)
• worker (class)
• worker/name (method)

Internal Definitions

• handle-message (function)
• name-worker (function)
• worker/context (method)
• worker/mmop-version (method)
• worker/nodes (method)
• worker/socket (method)
• (setf worker/socket) (method)

4.1.11 monomyth/src/rmq-worker.lisp

Dependencies

• worker.lisp (file)
• node.lisp (file)
• rmq-node.lisp (file)
• node-recipe.lisp (file)
• rmq-node-recipe.lisp (file)

Parent

src (module)

Location

src/rmq-worker.lisp

Packages

monomyth/rmq-worker

Exported Definitions

• build-rmq-worker (function)
• rmq-worker (class)
• rmq-worker/host (method)
• rmq-worker/password (method)
• rmq-worker/port (method)
• rmq-worker/username (method)

4.1.12 monomyth/src/master.lisp

Parent

src (module)

Location

src/master.lisp

Packages

monomyth/master

Exported Definitions

• add-recipe (function)
• add-recipes (generic function)
• ask-to-shutdown-worker (function)
• ask-to-start-node (function)
• master (structure)
• master-context (function)
• master-recipes (function)
• master-workers (function)
• start-master (function)
• stop-master (function)
• worker-info-outstanding-request-counts (function)
• worker-info-type-counts (function)

Internal Definitions

• %stmx-impl/notx-set/master-running (function)
• %stmx-impl/notx/master-running (function)
• (setf %stmx-impl/notx/master-running) (setf expander)
• %stmx-impl/swtx-set/master-running (function)
• %stmx-impl/swtx/master-running (function)
• (setf %stmx-impl/swtx/master-running) (setf expander)
• %stmx-impl/tstruct/build-master (function)
• %stmx-impl/tstruct/master-context (function)
• %stmx-impl/tstruct/master-recipes (function)
• %stmx-impl/tstruct/master-running (function)
• (setf %stmx-impl/tstruct/master-running) (function)
• %stmx-impl/tstruct/master-workers (function)
• %stmx-impl/tx-set/master-running (function)
• *end-message* (special variable)
• *internal-conn-name* (special variable)
• *router-thread-name* (special variable)
• *shutdown-pause* (special variable)
• *worker-thread-prefix* (special variable)
• add-worker (function)
• build-master (function)
• build-worker-info (function)
• combine-type-plist (function)
• confirm-start-node-failure (function)
• copy-master (function)
• copy-worker-info (function)
• determine-worker-for-node (function)
• find-worker-lowest-node-type-count (function)
• forward-frames-to-client (function)
• forward-frames-to-worker (function)
• get-all-worker-type-info (function)
• get-worker-type-info (function)
• handle-message (function)
• handle-pull-msg (function)
• master-p (function)
• master-running (function)
• (setf master-running) (setf expander)
• pull-master-type-info (function)
• pull-worker-type-info (function)
• pull-worker-type-queued-info (function)
• pull-worker-type-running-info (function)
• route-incoming-message (function)
• route-outgoing-message (function)
• send-pong-v0 (function)
• send-recipe-info (function)
• send-worker-info (function)
• start-handler-thread (function)
• start-node (function)
• start-router-loop (function)
• start-successful (function)
• start-unsuccessful (function)
• total-posible-nodes (function)
• worker-info (structure)
• worker-info-p (function)

4.1.13 monomyth/src/dsl.lisp

Dependencies

• node-recipe.lisp (file)
• rmq-node-recipe.lisp (file)
• node.lisp (file)
• rmq-node.lisp (file)
• worker.lisp (file)
• rmq-worker.lisp (file)
• master.lisp (file)

Parent

src (module)

Location

src/dsl.lisp

Packages

monomyth/dsl

Exported Definitions

• build-queues (function)
• define-rmq-node (macro)
• define-system (macro)
• mashup-symbol (function)

Internal Definitions

• *end-name* (special variable)
• *start-name* (special variable)
• define-rmq-node-internal (function)

5 Packages

Packages are listed by definition order.

5.1 monomyth/node-recipe

Source

node-recipe.lisp (file)

Use List

• uuid
• common-lisp

Used By List

• monomyth/dsl
• monomyth/master
• monomyth/rmq-worker
• monomyth/worker
• monomyth/rmq-node-recipe
• monomyth/mmop-master
• monomyth/mmop-worker

Exported Definitions

• deserialize-recipe (function)
• name-node (generic function)
• name-node (method)
• node-recipe (class)
• node-recipe/batch-size (generic function)
• node-recipe/batch-size (method)
• node-recipe/type (generic function)
• node-recipe/type (method)
• serialize-recipe (function)

5.2 monomyth/mmop

Source

mmop.lisp (file)

Use List

• rutils.bind
• common-lisp

Used By List

• monomyth/master
• monomyth/worker
• monomyth/mmop-control
• monomyth/mmop-master
• monomyth/mmop-worker

Exported Definitions

• *mmop-v0* (special variable)
• *mmop-versions* (special variable)
• create-frames (generic function)
• create-frames (method)
• create-frames (method)
• create-frames (method)
• create-frames (method)
• create-frames (method)
• create-frames (method)
• create-frames (method)
• create-frames (method)
• create-frames (method)
• create-frames (method)
• create-frames (method)
• create-frames (method)
• create-frames (method)
• create-frames (method)
• create-frames (method)
• create-frames (method)
• mmop-error (condition)
• mmop-error/message (generic function)
• mmop-error/message (method)
• mmop-error/version (generic function)
• mmop-error/version (method)
• pull-msg (function)
• send-msg (function)
• send-msg-frames (function)

Internal Definitions

handle-libzmq-error (macro)

5.3 monomyth/mmop-worker

Source

mmop-worker.lisp (file)

Nickname

mmop-w

Use List

• monomyth/node-recipe
• monomyth/mmop
• rutils.bind
• common-lisp

Used By List

monomyth/worker

Exported Definitions

• pull-worker-message (function)
• received-mmop (structure)
• sent-mmop (structure)
• shutdown-worker-v0 (constant)
• shutdown-worker-v0 (structure)
• start-node-failure-v0 (function)
• start-node-failure-v0 (structure)
• start-node-success-v0 (function)
• start-node-success-v0 (structure)
• start-node-v0 (function)
• start-node-v0 (structure)
• worker-ready-v0 (constant)
• worker-ready-v0 (structure)

Internal Definitions

• start-node-failure-v0%0 (function)
• start-node-failure-v0%1 (function)
• start-node-failure-v0%2 (function)
• start-node-success-v0%0 (function)
• start-node-v0%0 (function)
• start-node-v0%1 (function)
• translate-v0 (function)

5.4 monomyth/mmop-master

Source

mmop-master.lisp (file)

Nickname

mmop-m

Use List

• monomyth/node-recipe
• monomyth/mmop
• rutils.bind
• common-lisp

Used By List

monomyth/master

Exported Definitions

• json-info-response-v0 (function)
• json-info-response-v0 (structure)
• ping-v0 (function)
• ping-v0 (structure)
• pong-v0 (function)
• pong-v0 (structure)
• pull-master-message (function)
• received-mmop (structure)
• recipe-info-v0 (function)
• recipe-info-v0 (structure)
• sent-mmop (structure)
• shutdown-worker-v0 (function)
• shutdown-worker-v0 (structure)
• start-node-failure-v0 (function)
• start-node-failure-v0 (structure)
• start-node-request-failure-v0 (function)
• start-node-request-failure-v0 (structure)
• start-node-request-success-v0 (function)
• start-node-request-success-v0 (structure)
• start-node-request-v0 (function)
• start-node-request-v0 (structure)
• start-node-success-v0 (function)
• start-node-success-v0 (structure)
• start-node-v0 (function)
• start-node-v0 (structure)
• stop-worker-request-failure-v0 (function)
• stop-worker-request-failure-v0 (structure)
• stop-worker-request-success-v0 (function)
• stop-worker-request-success-v0 (structure)
• stop-worker-request-v0 (function)
• stop-worker-request-v0 (structure)
• worker-info-v0 (function)
• worker-info-v0 (structure)
• worker-ready-v0 (function)
• worker-ready-v0 (structure)

Internal Definitions

• json-info-response-v0%0 (function)
• json-info-response-v0%1 (function)
• ping-v0%0 (function)
• pong-v0%0 (function)
• recipe-info-v0%0 (function)
• shutdown-worker-v0%0 (function)
• start-node-failure-v0%0 (function)
• start-node-failure-v0%1 (function)
• start-node-failure-v0%2 (function)
• start-node-failure-v0%3 (function)
• start-node-request-failure-v0%0 (function)
• start-node-request-failure-v0%1 (function)
• start-node-request-failure-v0%2 (function)
• start-node-request-success-v0%0 (function)
• start-node-request-v0%0 (function)
• start-node-request-v0%1 (function)
• start-node-success-v0%0 (function)
• start-node-success-v0%1 (function)
• start-node-v0%0 (function)
• start-node-v0%1 (function)
• stop-worker-request-failure-v0%0 (function)
• stop-worker-request-failure-v0%1 (function)
• stop-worker-request-failure-v0%2 (function)
• stop-worker-request-success-v0%0 (function)
• stop-worker-request-v0%0 (function)
• stop-worker-request-v0%1 (function)
• translate-v0 (function)
• worker-info-v0%0 (function)
• worker-ready-v0%0 (function)

5.5 monomyth/mmop-control

Source

mmop-control.lisp (file)

Nickname

mmop-c

Use List

• monomyth/mmop
• rutils.bind
• common-lisp

Exported Definitions

• json-info-response-v0 (function)
• json-info-response-v0 (structure)
• ping-v0 (constant)
• ping-v0 (structure)
• pong-v0 (constant)
• pong-v0 (structure)
• pull-control-message (function)
• received-mmop (structure)
• recipe-info-v0 (constant)
• recipe-info-v0 (structure)
• sent-mmop (structure)
• start-node-request-failure-v0 (function)
• start-node-request-failure-v0 (structure)
• start-node-request-success-v0 (constant)
• start-node-request-success-v0 (structure)
• start-node-request-v0 (function)
• start-node-request-v0 (structure)
• stop-worker-request-failure-v0 (function)
• stop-worker-request-failure-v0 (structure)
• stop-worker-request-success-v0 (constant)
• stop-worker-request-success-v0 (structure)
• stop-worker-request-v0 (function)
• stop-worker-request-v0 (structure)
• worker-info-v0 (constant)
• worker-info-v0 (structure)

Internal Definitions

• json-info-response-v0%0 (function)
• start-node-request-failure-v0%0 (function)
• start-node-request-failure-v0%1 (function)
• start-node-request-v0%0 (function)
• stop-worker-request-failure-v0%0 (function)
• stop-worker-request-failure-v0%1 (function)
• stop-worker-request-v0%0 (function)
• translate-v0 (function)

5.6 monomyth/node

Source

node.lisp (file)

Use List

• stmx
• uuid
• common-lisp

Used By List

• monomyth/dsl
• monomyth/rmq-worker
• monomyth/worker
• monomyth/rmq-node

Exported Definitions

• handle-failure (generic function)
• handle-failure (method)
• node (class)
• node-error (condition)
• node-error/items (generic function)
• node-error/items (method)
• node-error/step (generic function)
• node-error/step (method)
• node/batch-size (generic function)
• node/batch-size (method)
• node/node-name (generic function)
• node/node-name (method)
• node/type (generic function)
• node/type (method)
• place-items (generic function)
• place-items (method)
• pull-items (generic function)
• pull-items (method)
• run-iteration (generic function)
• run-iteration (method)
• shutdown (generic function)
• shutdown (method)
• shutdown (method)
• startup (generic function)
• startup (method)
• startup (method)
• transform-fn (generic function)
• transform-items (generic function)
• transform-items (method)
• transform-items (method)

Internal Definitions

• node-error/message (generic function)
• node-error/message (method)
• node/running (generic function)
• node/running (method)
• (setf node/running) (method)
• (setf node/running) (generic function)

5.7 monomyth/rmq-node

Source

rmq-node.lisp (file)

Use List

• stmx
• cl-rabbit
• monomyth/node
• common-lisp

Used By List

• monomyth/dsl
• monomyth/rmq-worker

Exported Definitions

• ack-message (function)
• build-rmq-message (function)
• get-message (function)
• nack-message (function)
• rmq-message-body (function)
• (setf rmq-message-body) (function)
• rmq-message-delivery-tag (function)
• rmq-node (class)
• send-message (function)
• setup-connection (function)

Internal Definitions

• *channel* (special variable)
• *get-timeout* (special variable)
• build-error-response (function)
• copy-rmq-message (function)
• rabbit-mq-call (macro)
• rmq-message (structure)
• rmq-message-p (function)
• rmq-node/conn (generic function)
• rmq-node/conn (method)
• rmq-node/dest-queue (generic function)
• rmq-node/dest-queue (method)
• rmq-node/exchange (generic function)
• rmq-node/exchange (method)
• rmq-node/fail-queue (generic function)
• rmq-node/fail-queue (method)
• rmq-node/source-queue (generic function)
• rmq-node/source-queue (method)

5.8 monomyth/rmq-node-recipe

Source

rmq-node-recipe.lisp (file)

Use List

• monomyth/node-recipe
• common-lisp

Used By List

• monomyth/dsl
• monomyth/rmq-worker

Exported Definitions

• name-fail-queue (generic function)
• name-fail-queue (method)
• rmq-node-recipe (class)
• rmq-node-recipe/dest-queue (generic function)
• rmq-node-recipe/dest-queue (method)
• rmq-node-recipe/source-queue (generic function)
• rmq-node-recipe/source-queue (method)

5.9 monomyth/worker

Source

worker.lisp (file)

Use List

• monomyth/node
• monomyth/node-recipe
• monomyth/mmop-worker
• monomyth/mmop
• uuid
• common-lisp

Used By List

• monomyth/dsl
• monomyth/rmq-worker

Exported Definitions

• build-node (generic function)
• run-worker (function)
• start-worker (generic function)
• start-worker (method)
• stop-worker (generic function)
• stop-worker (method)
• worker (class)
• worker/name (generic function)
• worker/name (method)

Internal Definitions

• handle-message (function)
• name-worker (function)
• worker/context (generic function)
• worker/context (method)
• worker/mmop-version (generic function)
• worker/mmop-version (method)
• worker/nodes (generic function)
• worker/nodes (method)
• worker/socket (generic function)
• worker/socket (method)
• (setf worker/socket) (method)
• (setf worker/socket) (generic function)

5.10 monomyth/rmq-worker

Source

rmq-worker.lisp (file)

Use List

• cl-rabbit
• monomyth/node
• monomyth/node-recipe
• monomyth/rmq-node-recipe
• monomyth/rmq-node
• monomyth/worker
• common-lisp

Used By List

monomyth/dsl

Exported Definitions

• build-rmq-worker (function)
• rmq-worker (class)
• rmq-worker/host (generic function)
• rmq-worker/host (method)
• rmq-worker/password (generic function)
• rmq-worker/password (method)
• rmq-worker/port (generic function)
• rmq-worker/port (method)
• rmq-worker/username (generic function)
• rmq-worker/username (method)

5.11 monomyth/master

Source

master.lisp (file)

Use List

• jonathan
• monomyth/mmop-master
• monomyth/node-recipe
• monomyth/mmop
• stmx.util
• stmx
• common-lisp

Used By List

monomyth/dsl

Exported Definitions

• add-recipe (function)
• add-recipes (generic function)
• ask-to-shutdown-worker (function)
• ask-to-start-node (function)
• master (structure)
• master-context (function)
• master-recipes (function)
• master-workers (function)
• start-master (function)
• stop-master (function)
• worker-info-outstanding-request-counts (function)
• worker-info-type-counts (function)

Internal Definitions

• %stmx-impl/notx-set/master-running (function)
• %stmx-impl/notx/master-running (function)
• (setf %stmx-impl/notx/master-running) (setf expander)
• %stmx-impl/swtx-set/master-running (function)
• %stmx-impl/swtx/master-running (function)
• (setf %stmx-impl/swtx/master-running) (setf expander)
• %stmx-impl/tstruct/build-master (function)
• %stmx-impl/tstruct/master-context (function)
• %stmx-impl/tstruct/master-recipes (function)
• %stmx-impl/tstruct/master-running (function)
• (setf %stmx-impl/tstruct/master-running) (function)
• %stmx-impl/tstruct/master-workers (function)
• %stmx-impl/tx-set/master-running (function)
• *end-message* (special variable)
• *internal-conn-name* (special variable)
• *router-thread-name* (special variable)
• *shutdown-pause* (special variable)
• *worker-thread-prefix* (special variable)
• add-worker (function)
• build-master (function)
• build-worker-info (function)
• combine-type-plist (function)
• confirm-start-node-failure (function)
• copy-master (function)
• copy-worker-info (function)
• determine-worker-for-node (function)
• find-worker-lowest-node-type-count (function)
• forward-frames-to-client (function)
• forward-frames-to-worker (function)
• get-all-worker-type-info (function)
• get-worker-type-info (function)
• handle-message (function)
• handle-pull-msg (function)
• master-p (function)
• master-running (function)
• (setf master-running) (setf expander)
• pull-master-type-info (function)
• pull-worker-type-info (function)
• pull-worker-type-queued-info (function)
• pull-worker-type-running-info (function)
• route-incoming-message (function)
• route-outgoing-message (function)
• send-pong-v0 (function)
• send-recipe-info (function)
• send-worker-info (function)
• start-handler-thread (function)
• start-node (function)
• start-router-loop (function)
• start-successful (function)
• start-unsuccessful (function)
• total-posible-nodes (function)
• worker-info (structure)
• worker-info-p (function)

5.12 monomyth/dsl

Source

dsl.lisp (file)

Use List

• monomyth/master
• monomyth/node-recipe
• monomyth/worker
• monomyth/rmq-worker
• monomyth/rmq-node-recipe
• monomyth/node
• stmx
• monomyth/rmq-node
• common-lisp

Exported Definitions

• build-queues (function)
• define-rmq-node (macro)
• define-system (macro)
• mashup-symbol (function)

Internal Definitions

• *end-name* (special variable)
• *start-name* (special variable)
• define-rmq-node-internal (function)

6 Definitions

Definitions are sorted by export status, category, package, and then by lexicographic order.

6.1 Exported definitions

6.1.1 Constants

Constant: ping-v0

Package

monomyth/mmop-control

Source

mmop-control.lisp (file)

Constant: pong-v0

Package

monomyth/mmop-control

Source

mmop-control.lisp (file)

Constant: recipe-info-v0

Package

monomyth/mmop-control

Source

mmop-control.lisp (file)

Constant: shutdown-worker-v0

Package

monomyth/mmop-worker

Source

mmop-worker.lisp (file)

Constant: start-node-request-success-v0

Package

monomyth/mmop-control

Source

mmop-control.lisp (file)

Constant: stop-worker-request-success-v0

Package

monomyth/mmop-control

Source

mmop-control.lisp (file)

Constant: worker-info-v0

Package

monomyth/mmop-control

Source

mmop-control.lisp (file)

Constant: worker-ready-v0

Package

monomyth/mmop-worker

Source

mmop-worker.lisp (file)

6.1.2 Special variables

Special Variable: *mmop-v0*

Package

monomyth/mmop

Source

mmop.lisp (file)

Special Variable: *mmop-versions*

Package

monomyth/mmop

Source

mmop.lisp (file)

6.1.3 Macros

Macro: define-rmq-node NAME TRANSFORM-FUNC SOURCE-QUEUE DEST-QUEUE SIZE

Defines all classes, methods, and functions for a new node type.

Package

monomyth/dsl

Source

dsl.lisp (file)

Macro: define-system &rest NODES

Takes a list of plist (:name :fn :batch-size) and turns them into rmq nodes
that work in sequential order.
All recipes are also set up to be loaded into master server via the add-recipes method.

Package

monomyth/dsl

Source

dsl.lisp (file)

6.1.4 Functions

Function: ack-message NODE MESSAGE

acks a message as complete

Package

monomyth/rmq-node

Source

rmq-node.lisp (file)

Function: add-recipe MASTER RECIPE

adds a recipe to the master records

Package

monomyth/master

Source

master.lisp (file)

Function: ask-to-shutdown-worker MASTER SOCKET CLIENT-ID WORKER-ID

uses a master to tell a worker to shutdown via MMOP.
No state in the master is currently changes, returns t if the call seems to have been sent, nil otherwise

Package

monomyth/master

Source

master.lisp (file)

Function: ask-to-start-node MASTER SOCKET CLIENT-ID TYPE-ID

attempts to start a node of type-id on one of the masters workers. returns t if it works, nil otherwise

Package

monomyth/master

Source

master.lisp (file)

Function: build-queues NODES

turns the linear list of edges into queue names

Package

monomyth/dsl

Source

dsl.lisp (file)

Function: build-rmq-message &key (BODY BODY) (DELIVERY-TAG DELIVERY-TAG)

Package

monomyth/rmq-node

Source

rmq-node.lisp (file)

Function: build-rmq-worker &key HOST PORT USERNAME PASSWORD

Package

monomyth/rmq-worker

Source

rmq-worker.lisp (file)

Function: deserialize-recipe BUFFER

turns a serialized buffer back into a recipe

Package

monomyth/node-recipe

Source

node-recipe.lisp (file)

Function: get-message NODE

gets a message off the source queue and changes the message to be a string (as opposed to a byte array)
return :success t with the :result if things go well

Package

monomyth/rmq-node

Source

rmq-node.lisp (file)

Function: json-info-response-v0 %0 %1

Package

monomyth/mmop-master

Source

mmop-master.lisp (file)

Function: json-info-response-v0 %0

Package

monomyth/mmop-control

Source

mmop-control.lisp (file)

Function: mashup-symbol &rest OBJECTS

takes a bunch of symbols and combines them

Package

monomyth/dsl

Source

dsl.lisp (file)

Function: master-context INSTANCE

Package

monomyth/master

Source

master.lisp (file)

Function: master-recipes INSTANCE

Package

monomyth/master

Source

master.lisp (file)

Function: master-workers INSTANCE

Package

monomyth/master

Source

master.lisp (file)

Function: nack-message NODE MESSAGE REQUEUE

nacks a message as incomplete, re-queues message if asked to

Package

monomyth/rmq-node

Source

rmq-node.lisp (file)

Function: ping-v0 %0

Package

monomyth/mmop-master

Source

mmop-master.lisp (file)

Function: pong-v0 %0

Package

monomyth/mmop-master

Source

mmop-master.lisp (file)

Function: pull-control-message SOCKET

pulls down a message designed for the control server and attempts to translate it into the correct adt

Package

monomyth/mmop-control

Source

mmop-control.lisp (file)

Function: pull-master-message SOCKET

pulls down a message designed for the master router socket and attempts to translate it into an equivalent struct

Package

monomyth/mmop-master

Source

mmop-master.lisp (file)

Function: pull-msg SOCKET

Pulls down all message frames

Package

monomyth/mmop

Source

mmop.lisp (file)

Function: pull-worker-message SOCKET

pulls down a message designed for the worker dealer socket and attempts to translate it into an equivalent struct

Package

monomyth/mmop-worker

Source

mmop-worker.lisp (file)

Function: recipe-info-v0 %0

Package

monomyth/mmop-master

Source

mmop-master.lisp (file)

Function: rmq-message-body INSTANCE

Function: (setf rmq-message-body) VALUE INSTANCE

Package

monomyth/rmq-node

Source

rmq-node.lisp (file)

Function: rmq-message-delivery-tag INSTANCE

Package

monomyth/rmq-node

Source

rmq-node.lisp (file)

Function: run-worker WORKER

main event loop for the worker

Package

monomyth/worker

Source

worker.lisp (file)

Function: send-message NODE QUEUE MESSAGE

sends a message to the specified queue

Package

monomyth/rmq-node

Source

rmq-node.lisp (file)

Function: send-msg SOCKET VERSION MSG

translates a message struct into frames, and then sends them

Package

monomyth/mmop

Source

mmop.lisp (file)

Function: send-msg-frames SOCKET VERSION FRAMES

Helper function that sends a set of frames as single message

Package

monomyth/mmop

Source

mmop.lisp (file)

Function: serialize-recipe RECIPE

turns the recipe into a buffer acceptable to ZMQ

Package

monomyth/node-recipe

Source

node-recipe.lisp (file)

Function: setup-connection &key HOST PORT USERNAME PASSWORD VHOST

builds a new connection, sets up the socket, and logs in defaults are the local rabbit-mq defaults

Package

monomyth/rmq-node

Source

rmq-node.lisp (file)

Function: shutdown-worker-v0 %0

Package

monomyth/mmop-master

Source

mmop-master.lisp (file)

Function: start-master THREAD-COUNT CLIENT-PORT

starts up all worker threads and the router loop for load balancing

Package

monomyth/master

Source

master.lisp (file)

Function: start-node-failure-v0 %0 %1 %2

Package

monomyth/mmop-worker

Source

mmop-worker.lisp (file)

Function: start-node-failure-v0 %0 %1 %2 %3

Package

monomyth/mmop-master

Source

mmop-master.lisp (file)

Function: start-node-request-failure-v0 %0 %1 %2

Package

monomyth/mmop-master

Source

mmop-master.lisp (file)

Function: start-node-request-failure-v0 %0 %1

Package

monomyth/mmop-control

Source

mmop-control.lisp (file)

Function: start-node-request-success-v0 %0

Package

monomyth/mmop-master

Source

mmop-master.lisp (file)

Function: start-node-request-v0 %0 %1

Package

monomyth/mmop-master

Source

mmop-master.lisp (file)

Function: start-node-request-v0 %0

Package

monomyth/mmop-control

Source

mmop-control.lisp (file)

Function: start-node-success-v0 %0

Package

monomyth/mmop-worker

Source

mmop-worker.lisp (file)

Function: start-node-success-v0 %0 %1

Package

monomyth/mmop-master

Source

mmop-master.lisp (file)

Function: start-node-v0 %0 %1

Package

monomyth/mmop-worker

Source

mmop-worker.lisp (file)

Function: start-node-v0 %0 %1

Package

monomyth/mmop-master

Source

mmop-master.lisp (file)

Function: stop-master MASTER

Package

monomyth/master

Source

master.lisp (file)

Function: stop-worker-request-failure-v0 %0 %1 %2

Package

monomyth/mmop-master

Source

mmop-master.lisp (file)

Function: stop-worker-request-failure-v0 %0 %1

Package

monomyth/mmop-control

Source

mmop-control.lisp (file)

Function: stop-worker-request-success-v0 %0

Package

monomyth/mmop-master

Source

mmop-master.lisp (file)

Function: stop-worker-request-v0 %0 %1

Package

monomyth/mmop-master

Source

mmop-master.lisp (file)

Function: stop-worker-request-v0 %0

Package

monomyth/mmop-control

Source

mmop-control.lisp (file)

Function: worker-info-outstanding-request-counts INSTANCE

Package

monomyth/master

Source

master.lisp (file)

Function: worker-info-type-counts INSTANCE

Package

monomyth/master

Source

master.lisp (file)

Function: worker-info-v0 %0

Package

monomyth/mmop-master

Source

mmop-master.lisp (file)

Function: worker-ready-v0 %0

Package

monomyth/mmop-master

Source

mmop-master.lisp (file)

6.1.5 Generic functions

Generic Function: add-recipes MASTER

add all recipes created by the define system macro

Package

monomyth/master

Source

master.lisp (file)

Generic Function: build-node WORKER RECIPE

uses a worker and recipe to build a new node

Package

monomyth/worker

Source

worker.lisp (file)

Generic Function: create-frames MESSAGE

takes a message struct and builds a list of zmq frames to be sent

Package

monomyth/mmop

Source

mmop.lisp (file)

Methods

Method: create-frames (MESSAGE stop-worker-request-v0)

Source

mmop-control.lisp (file)

Method: create-frames (MESSAGE start-node-request-v0)

Source

mmop-control.lisp (file)

Method: create-frames (MESSAGE worker-info-v0)

Source

mmop-control.lisp (file)

Method: create-frames (MESSAGE recipe-info-v0)

Source

mmop-control.lisp (file)

Method: create-frames (MESSAGE ping-v0)

Source

mmop-control.lisp (file)

Method: create-frames (MESSAGE shutdown-worker-v0)

Source

mmop-master.lisp (file)

Method: create-frames (MESSAGE start-node-v0)

Source

mmop-master.lisp (file)

Method: create-frames (MESSAGE stop-worker-request-failure-v0)

Source

mmop-master.lisp (file)

Method: create-frames (MESSAGE stop-worker-request-success-v0)

Source

mmop-master.lisp (file)

Method: create-frames (MESSAGE start-node-request-failure-v0)

Source

mmop-master.lisp (file)

Method: create-frames (MESSAGE start-node-request-success-v0)

Source

mmop-master.lisp (file)

Method: create-frames (MESSAGE json-info-response-v0)

Source

mmop-master.lisp (file)

Method: create-frames (MESSAGE pong-v0)

Source

mmop-master.lisp (file)

Method: create-frames (MESSAGE start-node-failure-v0)

Source

mmop-worker.lisp (file)

Method: create-frames (MESSAGE start-node-success-v0)

Source

mmop-worker.lisp (file)

Method: create-frames (MESSAGE worker-ready-v0)

Source

mmop-worker.lisp (file)

Generic Function: handle-failure NODE STEP RESULT

actions to take if the returned plist contains :success false expects an explanation under :error in the result
the step can be :pull, :transform, or :place
the result is the full payload sent by the last step

Package

monomyth/node

Source

node.lisp (file)

Methods

Method: handle-failure (NODE rmq-node) STEP RESULT

Source

rmq-node.lisp (file)

Generic Function: mmop-error/message CONDITION

Package

monomyth/mmop

Methods

Method: mmop-error/message (CONDITION mmop-error)

Source

mmop.lisp (file)

Generic Function: mmop-error/version CONDITION

Package

monomyth/mmop

Methods

Method: mmop-error/version (CONDITION mmop-error)

Source

mmop.lisp (file)

Generic Function: name-fail-queue RECIPE

uses the node type to name the fail queue in a deterministic manor

Package

monomyth/rmq-node-recipe

Source

rmq-node-recipe.lisp (file)

Methods

Method: name-fail-queue (RECIPE rmq-node-recipe)

Generic Function: name-node RECIPE

takes a recipe and produces a unique node name

Package

monomyth/node-recipe

Source

node-recipe.lisp (file)

Methods

Method: name-node (RECIPE node-recipe)

Generic Function: node-error/items CONDITION

Package

monomyth/node

Methods

Method: node-error/items (CONDITION node-error)

Source

node.lisp (file)

Generic Function: node-error/step CONDITION

Package

monomyth/node

Methods

Method: node-error/step (CONDITION node-error)

Source

node.lisp (file)

Generic Function: node-recipe/batch-size OBJECT

Package

monomyth/node-recipe

Methods

Method: node-recipe/batch-size (NODE-RECIPE node-recipe)

the batch size that is passed directly to the node if not set uses the default (10)

Source

node-recipe.lisp (file)

Generic Function: node-recipe/type OBJECT

Package

monomyth/node-recipe

Methods

Method: node-recipe/type (NODE-RECIPE node-recipe)

node ’type’, often used to name nodes

Source

node-recipe.lisp (file)

Generic Function: node/batch-size OBJECT

Package

monomyth/node

Methods

Method: node/batch-size (NODE node)

number of items to pull in pull-items at a time

Source

node.lisp (file)

Generic Function: node/node-name OBJECT

Package

monomyth/node

Methods

Method: node/node-name (NODE node)

name of the node

Source

node.lisp (file)

Generic Function: node/type OBJECT

Package

monomyth/node

Methods

Method: node/type (NODE node)

the node type corresponds to the node recipe type

Source

node.lisp (file)

Generic Function: place-items NODE RESULT

places the finished items on the message bus
takes the entire payload sent by transorm
assumes that the items are passed under :items should return a plist with one of the slots as :success

Package

monomyth/node

Source

node.lisp (file)

Methods

Method: place-items (NODE rmq-node) RESULT

Source

rmq-node.lisp (file)

Generic Function: pull-items NODE

tells the node to pull count items from the message bus should return a plist with one of the slots as :success

Package

monomyth/node

Source

node.lisp (file)

Methods

Method: pull-items (NODE rmq-node)

Source

rmq-node.lisp (file)

Generic Function: rmq-node-recipe/dest-queue OBJECT

Package

monomyth/rmq-node-recipe

Methods

Method: rmq-node-recipe/dest-queue (RMQ-NODE-RECIPE rmq-node-recipe)

automatically generated reader method

Source

rmq-node-recipe.lisp (file)

Generic Function: rmq-node-recipe/source-queue OBJECT

Package

monomyth/rmq-node-recipe

Methods

Method: rmq-node-recipe/source-queue (RMQ-NODE-RECIPE rmq-node-recipe)

automatically generated reader method

Source

rmq-node-recipe.lisp (file)

Generic Function: rmq-worker/host OBJECT

Package

monomyth/rmq-worker

Methods

Method: rmq-worker/host (RMQ-WORKER rmq-worker)

rabbit mq host

Source

rmq-worker.lisp (file)

Generic Function: rmq-worker/password OBJECT

Package

monomyth/rmq-worker

Methods

Method: rmq-worker/password (RMQ-WORKER rmq-worker)

automatically generated reader method

Source

rmq-worker.lisp (file)

Generic Function: rmq-worker/port OBJECT

Package

monomyth/rmq-worker

Methods

Method: rmq-worker/port (RMQ-WORKER rmq-worker)

rabbit mq port

Source

rmq-worker.lisp (file)

Generic Function: rmq-worker/username OBJECT

Package

monomyth/rmq-worker

Methods

Method: rmq-worker/username (RMQ-WORKER rmq-worker)

rabbit mq username

Source

rmq-worker.lisp (file)

Generic Function: run-iteration NODE

runs an entire operation start to finish

Package

monomyth/node

Source

node.lisp (file)

Methods

Method: run-iteration (NODE node)

Generic Function: shutdown NODE

graceful shutdown of the node

Package

monomyth/node

Source

node.lisp (file)

Methods

Method: shutdown (NODE rmq-node)

closes the channel and then destroys the connections.
note that this means that once an rmq-node is shutdown, it cannot be started up again

Source

rmq-node.lisp (file)

Method: shutdown (NODE node) before

Generic Function: start-worker WORKER MASTER-ADDRESS

starts the worker processes, by the time this method is done it should be okay start a node

Package

monomyth/worker

Source

worker.lisp (file)

Methods

Method: start-worker (WORKER worker) MASTER-ADDRESS

Generic Function: startup NODE &optional BUILD-WORKER-THREAD

performs any initial start up to ensure the node is working as corrected. The build worker thread option exists for testing purposes

Package

monomyth/node

Source

node.lisp (file)

Methods

Method: startup (NODE rmq-node) &optional BUILD-WORKER-THREAD

opens a channel using the nodes connections after setting up the socket.
also ensures all three queues are up and sets up basic consume for the source queue

Source

rmq-node.lisp (file)

Method: startup (NODE node) &optional BUILD-WORKER-THREAD after

Generic Function: stop-worker WORKER

stops the worker processes and frees all resources and connections

Package

monomyth/worker

Source

worker.lisp (file)

Methods

Method: stop-worker (WORKER worker)

Generic Function: transform-fn NODE ITEM

the core transform function

Package

monomyth/node

Source

node.lisp (file)

Generic Function: transform-items NODE PULLED

extracts the items from the pull step (provided it was successful) and applies the transform function to each one

Package

monomyth/node

Source

node.lisp (file)

Methods

Method: transform-items (NODE rmq-node) PULLED

Source

rmq-node.lisp (file)

Method: transform-items (NODE node) PULLED

Generic Function: worker/name OBJECT

Package

monomyth/worker

Methods

Method: worker/name (WORKER worker)

a unique worker name set before startup

Source

worker.lisp (file)

6.1.6 Conditions

Condition: mmop-error ()

an error that happens in the mmop protocol

Package

monomyth/mmop

Source

mmop.lisp (file)

Direct superclasses

error (condition)

Direct methods

• mmop-error/version (method)
• mmop-error/message (method)

Direct slots

Slot: message

Initargs

:message

Initform

(quote (error "mmop-error message must be set"))

Readers

mmop-error/message (generic function)

Slot: mmop-version

Initargs

:version

Initform

(quote "undefined")

Readers

mmop-error/version (generic function)

Condition: node-error ()

an internal node error, handled by run-iteration

Package

monomyth/node

Source

node.lisp (file)

Direct superclasses

error (condition)

Direct methods

• node-error/items (method)
• node-error/message (method)
• node-error/step (method)

Direct slots

Slot: step

the step the node failed on
should be :place, :transform, or :pull if handle failure will take it

Initargs

:step

Initform

(quote (error "node error step must be set"))

Readers

node-error/step (generic function)

Slot: message

Initargs

:message

Initform

(quote (error "node error message must be set"))

Readers

node-error/message (generic function)

Slot: items

the items to be reprocessed

Initargs

:items

Initform

(quote nil)

Readers

node-error/items (generic function)

6.1.7 Structures

Structure: json-info-response-v0 ()

Package

monomyth/mmop-master

Source

mmop-master.lisp (file)

Direct superclasses

sent-mmop (structure)

Direct methods

• create-frames (method)
• make-load-form (method)
• print-object (method)

Direct slots

Slot: %0

Type

string

Initform

(error "unspecified field.")

Readers

json-info-response-v0%0 (function)

Writers

(setf json-info-response-v0%0) (function)

Slot: %1

Type

string

Initform

(error "unspecified field.")

Readers

json-info-response-v0%1 (function)

Writers

(setf json-info-response-v0%1) (function)

Structure: json-info-response-v0 ()

Package

monomyth/mmop-control

Source

mmop-control.lisp (file)

Direct superclasses

received-mmop (structure)

Direct methods

• make-load-form (method)
• print-object (method)

Direct slots

Slot: %0

Type

string

Initform

(error "unspecified field.")

Readers

json-info-response-v0%0 (function)

Writers

(setf json-info-response-v0%0) (function)

Structure: master ()

the master system only has two fields, a table of worker identifiers to worker infos, and a table of node type symbols to node recipes

Package

monomyth/master

Source

master.lisp (file)

Direct superclasses

structure-object (structure)

Direct slots

Slot: workers

Initform

(stmx::tstruct-slot-initialize (quote monomyth/master:master) (quote monomyth/master::workers) (quote (make-instance (quote stmx.util:thash-table) :test (quote equal))))

Readers

%stmx-impl/tstruct/master-workers (function)

Writers

(setf %stmx-impl/tstruct/master-workers) (function)

Slot: recipes

Initform

(stmx::tstruct-slot-initialize (quote monomyth/master:master) (quote monomyth/master::recipes) (quote (make-instance (quote stmx.util:thash-table) :test (quote equal))))

Readers

%stmx-impl/tstruct/master-recipes (function)

Writers

(setf %stmx-impl/tstruct/master-recipes) (function)

Slot: context

Initform

(stmx::tstruct-slot-initialize (quote monomyth/master:master) (quote monomyth/master::context) (quote (pzmq:ctx-new)))

Readers

%stmx-impl/tstruct/master-context (function)

Writers

(setf %stmx-impl/tstruct/master-context) (function)

Slot: running

Type

(stmx:transactional t)

Initform

(stmx::tstruct-slot-initialize (quote monomyth/master:master) (quote monomyth/master::running) (quote t))

Readers

%stmx-impl/tstruct/master-running (function)

Writers

(setf %stmx-impl/tstruct/master-running) (function)

Structure: ping-v0 ()

Package

monomyth/mmop-master

Source

mmop-master.lisp (file)

Direct superclasses

received-mmop (structure)

Direct methods

• make-load-form (method)
• print-object (method)

Direct slots

Slot: %0

Type

string

Initform

(error "unspecified field.")

Readers

ping-v0%0 (function)

Writers

(setf ping-v0%0) (function)

Structure: ping-v0 ()

Package

monomyth/mmop-control

Source

mmop-control.lisp (file)

Direct superclasses

sent-mmop (structure)

Direct methods

• create-frames (method)
• make-load-form (method)
• print-object (method)

Structure: pong-v0 ()

Package

monomyth/mmop-master

Source

mmop-master.lisp (file)

Direct superclasses

sent-mmop (structure)

Direct methods

• create-frames (method)
• make-load-form (method)
• print-object (method)

Direct slots

Slot: %0

Type

string

Initform

(error "unspecified field.")

Readers

pong-v0%0 (function)

Writers

(setf pong-v0%0) (function)

Structure: pong-v0 ()

Package

monomyth/mmop-control

Source

mmop-control.lisp (file)

Direct superclasses

received-mmop (structure)

Direct methods

• make-load-form (method)
• print-object (method)

Structure: received-mmop ()

Package

monomyth/mmop-worker

Source

mmop-worker.lisp (file)

Direct superclasses

algebraic-data-type (structure)

Direct subclasses

• start-node-v0 (structure)
• shutdown-worker-v0 (structure)

Structure: received-mmop ()

Package

monomyth/mmop-master

Source

mmop-master.lisp (file)

Direct superclasses

algebraic-data-type (structure)

Direct subclasses

• ping-v0 (structure)
• recipe-info-v0 (structure)
• worker-info-v0 (structure)
• start-node-request-v0 (structure)
• stop-worker-request-v0 (structure)
• worker-ready-v0 (structure)
• start-node-success-v0 (structure)
• start-node-failure-v0 (structure)

Structure: received-mmop ()

Package

monomyth/mmop-control

Source

mmop-control.lisp (file)

Direct superclasses

algebraic-data-type (structure)

Direct subclasses

• pong-v0 (structure)
• json-info-response-v0 (structure)
• start-node-request-success-v0 (structure)
• start-node-request-failure-v0 (structure)
• stop-worker-request-success-v0 (structure)
• stop-worker-request-failure-v0 (structure)

Structure: recipe-info-v0 ()

Package

monomyth/mmop-master

Source

mmop-master.lisp (file)

Direct superclasses

received-mmop (structure)

Direct methods

• make-load-form (method)
• print-object (method)

Direct slots

Slot: %0

Type

string

Initform

(error "unspecified field.")

Readers

recipe-info-v0%0 (function)

Writers

(setf recipe-info-v0%0) (function)

Structure: recipe-info-v0 ()

Package

monomyth/mmop-control

Source

mmop-control.lisp (file)

Direct superclasses

sent-mmop (structure)

Direct methods

• create-frames (method)
• make-load-form (method)
• print-object (method)

Structure: sent-mmop ()

Package

monomyth/mmop-worker

Source

mmop-worker.lisp (file)

Direct superclasses

algebraic-data-type (structure)

Direct subclasses

• worker-ready-v0 (structure)
• start-node-success-v0 (structure)
• start-node-failure-v0 (structure)

Structure: sent-mmop ()

Package

monomyth/mmop-master

Source

mmop-master.lisp (file)

Direct superclasses

algebraic-data-type (structure)

Direct subclasses

• pong-v0 (structure)
• start-node-request-success-v0 (structure)
• start-node-request-failure-v0 (structure)
• json-info-response-v0 (structure)
• start-node-v0 (structure)
• stop-worker-request-success-v0 (structure)
• stop-worker-request-failure-v0 (structure)
• shutdown-worker-v0 (structure)

Structure: sent-mmop ()

Package

monomyth/mmop-control

Source

mmop-control.lisp (file)

Direct superclasses

algebraic-data-type (structure)

Direct subclasses

• ping-v0 (structure)
• recipe-info-v0 (structure)
• worker-info-v0 (structure)
• start-node-request-v0 (structure)
• stop-worker-request-v0 (structure)

Structure: shutdown-worker-v0 ()

Package

monomyth/mmop-worker

Source

mmop-worker.lisp (file)

Direct superclasses

received-mmop (structure)

Direct methods

• make-load-form (method)
• print-object (method)

Structure: shutdown-worker-v0 ()

Package

monomyth/mmop-master

Source

mmop-master.lisp (file)

Direct superclasses

sent-mmop (structure)

Direct methods

• create-frames (method)
• make-load-form (method)
• print-object (method)

Direct slots

Slot: %0

Type

string

Initform

(error "unspecified field.")

Readers

shutdown-worker-v0%0 (function)

Writers

(setf shutdown-worker-v0%0) (function)

Structure: start-node-failure-v0 ()

Package

monomyth/mmop-worker

Source

mmop-worker.lisp (file)

Direct superclasses

sent-mmop (structure)

Direct methods

• create-frames (method)
• make-load-form (method)
• print-object (method)

Direct slots

Slot: %0

Type

string

Initform

(error "unspecified field.")

Readers

start-node-failure-v0%0 (function)

Writers

(setf start-node-failure-v0%0) (function)

Slot: %1

Type

string

Initform

(error "unspecified field.")

Readers

start-node-failure-v0%1 (function)

Writers

(setf start-node-failure-v0%1) (function)

Slot: %2

Type

string

Initform

(error "unspecified field.")

Readers

start-node-failure-v0%2 (function)

Writers

(setf start-node-failure-v0%2) (function)

Structure: start-node-failure-v0 ()

Package

monomyth/mmop-master

Source

mmop-master.lisp (file)

Direct superclasses

received-mmop (structure)

Direct methods

• make-load-form (method)
• print-object (method)

Direct slots

Slot: %0

Type

string

Initform

(error "unspecified field.")

Readers

start-node-failure-v0%0 (function)

Writers

(setf start-node-failure-v0%0) (function)

Slot: %1

Type

string

Initform

(error "unspecified field.")

Readers

start-node-failure-v0%1 (function)

Writers

(setf start-node-failure-v0%1) (function)

Slot: %2

Type

string

Initform

(error "unspecified field.")

Readers

start-node-failure-v0%2 (function)

Writers

(setf start-node-failure-v0%2) (function)

Slot: %3

Type

string

Initform

(error "unspecified field.")

Readers

start-node-failure-v0%3 (function)

Writers

(setf start-node-failure-v0%3) (function)

Structure: start-node-request-failure-v0 ()

Package

monomyth/mmop-master

Source

mmop-master.lisp (file)

Direct superclasses

sent-mmop (structure)

Direct methods

• create-frames (method)
• make-load-form (method)
• print-object (method)

Direct slots

Slot: %0

Type

string

Initform

(error "unspecified field.")

Readers

start-node-request-failure-v0%0 (function)

Writers

(setf start-node-request-failure-v0%0) (function)

Slot: %1

Type

string

Initform

(error "unspecified field.")

Readers

start-node-request-failure-v0%1 (function)

Writers

(setf start-node-request-failure-v0%1) (function)

Slot: %2

Type

integer

Initform

(error "unspecified field.")

Readers

start-node-request-failure-v0%2 (function)

Writers

(setf start-node-request-failure-v0%2) (function)