Skip to content

Repository files navigation

CKS Runtime

The canonical operational environment for Canonical Knowledge Structures.

Python License Tests PyPI

πŸš€ Live demo β†’ β€” explore the CKS ecosystem graph directly in your browser, no server required.

CKS Runtime is the canonical execution environment for Canonical Knowledge Structures (CKS).

Where CKS Core defines the semantics of knowledge, CKS Runtime defines its operational lifecycle.

Runtime provides the infrastructure required to execute, manage, version, persist and expose Canonical Knowledge Structures without becoming a semantic authority itself. Now fully async with PostgreSQL support.


Ecosystem

CKS Runtime is part of a family of interoperable projects built on the Canonical Knowledge Structure.

Project Description Repository
cks-core Canonical semantic engine – the single source of canonical truth. Deus-corp/cks-core
cks-runtime Operational environment – sessions, transactions, persistence. Deus-corp/cks-runtime
cks-mcp MCP server – exposes CKS to LLMs and autonomous agents. Deus-corp/cks-mcp
cks-studio Visual workspace – explore, monitor, and manage graphs. Deus-corp/cks-studio
cks-website Documentation & demo site. Deus-corp/cks-website

πŸ“– Full documentation, case studies, and an interactive demo are available at the CKS Documentation Site.


Why Runtime?

Canonical knowledge is immutable.

Operational state is not.

Applications need to:

  • create sessions
  • execute transactions
  • maintain history
  • persist state
  • expose APIs
  • coordinate diagnostics

These responsibilities belong to Runtime rather than CKS Core.

Canonical Knowledge Structure
            β”‚
            β–Ό
        CKS Runtime
            β”‚
 β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”Όβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
 β–Ό          β–Ό          β–Ό
Session  Versioning  Storage

Runtime manages operational behaviour.

CKS Core defines semantic behaviour.


Core Principles

CKS Runtime is founded on four architectural principles.

Runtime is not a semantic authority.

Semantic meaning permanently belongs to CKS Core.

Runtime never redefines knowledge.


Runtime orchestrates semantic services.

Validation.

Evolution.

Serialization.

Diagnostics.

These services originate from CKS Core.

Runtime coordinates their execution.


Operational state belongs to Runtime.

Sessions.

Transactions.

Persistence.

Version History.

These are Runtime responsibilities.


Observable behaviour is standardized.

The Runtime Standard specifies observable operational behaviour rather than implementation techniques.


Runtime Architecture

The CKS ecosystem is organized into four architectural layers.

Applications
        β”‚
        β–Ό
Adapters
        β”‚
        β–Ό
CKS Runtime
        β”‚
        β–Ό
Public CKS Core API
        β”‚
        β–Ό
CKS Core

Responsibilities are strictly separated.

Layer Responsibility
CKS Core Semantic authority
CKS Runtime Operational orchestration
Adapters Protocol exposure
Applications Business logic

The current Reference Runtime provides:

  • Runtime Sessions
  • Transaction Management
  • Version History
  • Storage Abstraction
  • Runtime Diagnostics
  • Explainability Coordination
  • Canonical Runtime API
  • Reference Runtime Architecture
  • Runtime Conformance Model
  • CKS Core Integration (via CksCoreAdapter)
  • Execution Engine – canonical operations (Validate, Serialize, Explain, Evolve, Diff) via CoreBridge
  • Operation Dispatcher – registry-based operation resolution
  • Event System – lifecycle events published via EventBus
  • Time-Travel Operations – ListVersionsOperation, RevertVersionOperation
  • Structural Diff – compact change computation between versions
  • Three‑way merge of knowledge structures via cks-core's merge() function
  • Query Subgraph – k‑hop neighbourhood extraction with type filters and budget/ranking, delegated to cks-core's query_subgraph()
  • Persistent Storage – SQLite-backed storage via SQLiteStorage, surviving server restarts. Configurable through RuntimeConfig.storage_path.
  • Indexed & Vectorized Embeddings – search_embeddings uses NumPy matrix operations for ~10Γ— faster similarity search, with a database index for multi-session scalability.
  • PostgreSQL Storage Backend β€” production-grade, async connection pooling, JSONB payloads, outbox with SELECT ... FOR UPDATE SKIP LOCKED, and pgvector-powered semantic search with HNSW index.
  • Shared Patch Codec β€” consistent serialization/deserialization of structural operators across SQLite and Postgres backends.
  • Session Garbage Collector – background task that automatically archives stale closed sessions, keeping storage compact in long-running deployments. Configurable retention window and sweep interval.
  • Local embeddings via fastembed – offline, token-free semantic search with FastEmbedEmbeddingClient (pip install cks-runtime[fastembed]).
  • Gossip Replication (ADR-008) β€” peer-to-peer session exchange: replica identity, HMAC-signed envelopes, replay protection, peer discovery (PeerDiscovery, HTTPPeerDiscovery), weighted peer selection with backoff (PeerScheduler), and a background anti-entropy service (GossipService). HTTP transport via aiohttp (pip install cks-runtime[gossip]).
  • CRDT Adapter (ADR-013) β€” conflict-free replicated storage layer beneath gossip: a grow-only set with a content-addressed Merkle prefix tree, an MV-Register with causal ordering and automatic fork detection, and quarantine validation (cks.validate() + Merkle-identity checks) wired into every incoming merge. Publishes CRDTForkDetected events and detects duplicate replica IDs to block silent divergence.
  • Autonomous Sweepers β€” seven background, detection-only sweepers that escalate findings into the persistent outbox rather than acting unilaterally: ContradictionSweeper, InferenceStalenessSweeper (ADR-009), ProvenanceStalenessSweeper (ADR-010), TemporalStalenessSweeper (ADR-011), GraphFreshnessSweeper, GraphAutoUpdateSweeper, and GraphHealthSweeper. Shared observability via SweeperStatusMixin/list_agent_statuses(), and remote start/stop control through persisted overrides (ADR-015).
  • Agent Infrastructure β€” liveness tracking (cks_agent_liveness) and stop signalling (ADR-016) for external standalone agent processes (Critic, Enrichment, Fork Resolution, Pipeline); AgentStepStarted/AgentStepCompleted events for pipeline observability.
  • Graph Registry β€” register_graph/get_graph/list_graphs persist named session references, the storage foundation for cks-mcp's Memory Agent.
  • Backup & Disaster Recovery (ADR-012) β€” export_storage()/import_storage() across every backend for full data dumps and clear/merge restores.
  • Persistent Outbox β€” task-type filtering, dead-letter queue (dead_letter_outbox_task, list_dead_letter_tasks), and batch peek/drain by type, so multiple workers can share one outbox table without stealing each other's tasks.

Design Goals

CKS Runtime is designed to be:

  • deterministic
  • implementation-independent
  • transport-independent
  • storage-independent
  • session-oriented
  • transaction-oriented
  • semantically neutral

Relationship to CKS Core

CKS Runtime depends upon CKS Core.

CKS Runtime never replaces CKS Core.

CKS Core
    defines semantics

        β”‚

        β–Ό

CKS Runtime
    orchestrates semantics
    manages operational lifecycle

Runtime communicates exclusively through the public CKS Core API.


Installation

From PyPI:

pip install cks-runtime

Or from source:

git clone https://github.com/Deus-corp/cks-runtime.git

cd cks-runtime

pip install -e .

Quick Example

from cks_runtime import Runtime
from cks_runtime_plugins.cks_core import CksCoreAdapter
from cks_runtime.operations.operation_types import (
    ValidateOperation,
    EvolveOperation,
    ListVersionsOperation,
    RevertVersionOperation,
)

# Create Runtime with real CKS Core
runtime = Runtime(core=CksCoreAdapter())

# Create a session and validate a knowledge structure
session = runtime.create_session({"example": True})
tx = runtime.begin_transaction(session)
tx.add_operation(ValidateOperation("v1", knowledge_structure=session.knowledge_structure))
version = runtime.commit_transaction(tx)

# Evolve the structure
tx2 = runtime.begin_transaction(session)
tx2.add_operation(EvolveOperation("evolve", knowledge_structure=session.knowledge_structure, evolution=[]))
version2 = runtime.commit_transaction(tx2)

# List versions
versions = runtime.executor.execute(ListVersionsOperation(), session)
print(versions.payload)

# Revert to the first version
tx3 = runtime.begin_transaction(session)
tx3.add_operation(RevertVersionOperation("revert", target_version_id=version.version_id))
runtime.commit_transaction(tx3)

Storage Backends

CKS Runtime supports pluggable storage backends through a unified async interface (AsyncRuntimeStorage):

Backend Type Status Notes
InMemoryStorage Sync βœ… Stable For testing and ephemeral sessions
SQLiteStorage Sync βœ… Stable Persistent, single‑writer, WAL mode
PostgresStorage Async βœ… Stable Production‑grade, connection pooling, JSONB, outbox, pgvector embeddings with HNSW index

Sync backends (InMemoryStorage, SQLiteStorage) are automatically adapted to the async interface via SyncStorageAdapter (using asyncio.to_thread), so existing code works unchanged. Use await Runtime.create(...) for full async startup, or plain Runtime(...) for lightweight testing without persistence.


Documentation

πŸ“š CKS Documentation β€” architecture guides, case studies, and API reference across all CKS projects.

The Runtime Standard consists of the following normative specifications.

Specification Purpose
SPEC-001 Runtime Overview
SPEC-002 Session Model
SPEC-003 Runtime API
SPEC-004 Diagnostics
SPEC-005 Transactions
SPEC-006 Storage
SPEC-007 Version History
SPEC-008 Runtime Conformance

Supporting documents include:

  • Runtime Charter
  • Architectural Analyses
  • Architecture Decision Records
  • Reference Architecture

Project Status

Current implementation status:

Component Status
Runtime Architecture βœ… Complete
Session Model βœ… Complete
Transaction Model βœ… Complete
Version History βœ… Complete
Diagnostics βœ… Complete
Storage Abstraction βœ… Complete
Async Runtime βœ… Complete
PostgreSQL Backend βœ… Complete
Session Garbage Collector βœ… Complete
Core Integration (CoreBridge) βœ… Complete
Execution Engine (Operations + Dispatcher) βœ… Complete
Event System βœ… Complete
Time-Travel Operations βœ… Complete
Structural Diff βœ… Complete
Query Subgraph βœ… Complete
Persistent Storage (SQLite) βœ… Complete
Gossip Replication (ADR-008) βœ… Complete β€” peer discovery, anti-entropy, duplicate replica ID detection
CRDT Adapter (ADR-013) βœ… Complete β€” G-Set + Merkle tree, MV-Register, fork detection, quarantine
Autonomous Sweepers (7) βœ… Complete β€” contradiction, inference/provenance/temporal staleness, graph freshness/auto-update/health
Sweeper Control (ADR-015) βœ… Complete
Agent Liveness & Control (ADR-016) βœ… Complete
Graph Registry βœ… Complete
Backup & Disaster Recovery (ADR-012) βœ… Complete
Outbox: task-type filter, DLQ βœ… Complete
Test Suite βœ… 734 tests passing (+69 requiring optional backends: Postgres, gossip)

The current implementation serves as the reference implementation of the CKS Runtime Standard (SPEC-001 … SPEC-008).

Future work focuses on Runtime Platform 2.0: dependency resolution and parallel execution in the Execution Engine, distributed transactions and leader election, and a unified observability platform. See ROADMAP.md for the full breakdown.


Long-Term Vision

CKS Runtime aims to become the canonical operational foundation shared by every CKS-compatible implementation.

Future adapter standardsβ€”including MCP, CLI, HTTP and othersβ€”will rely on Runtime rather than communicating directly with CKS Core.

This preserves a single semantic authority while allowing unlimited operational implementations.


License

MIT