TollMeshCache

Production-ready distributed coordination and caching system with 7-language SDK support. No central coordinator required.

Production Status

All 7 SDKs published and production-ready on official package managers:

Language Package Manager Version Status
Python PyPI 1.0.0 Live
Node.js/TypeScript npm 1.0.0 Live
Rust crates.io 1.0.0 Live
Ruby RubyGems 1.0.0 Live
C#/.NET NuGet 1.0.0 Live
PHP Packagist 1.0.0 Live
Java Maven Central 1.0.0 Live

Core Features (Complete)

Job Queues

Distributed task processing with exactly-once semantics, priority levels, and automatic retries.

Key Capabilities:

  • FIFO and priority-based processing
  • Exactly-once delivery guarantees
  • Automatic retry with exponential backoff
  • Dead-letter queue for failed jobs
  • Distributed coordination without central broker

Available in: All 7 languages with identical APIs

Sorted Sets

O(log n) leaderboards and rankings using skip list data structures. Perfect for scoring systems and range queries.

Key Capabilities:

  • O(log n) insert, update, and range queries
  • CRDT-based conflict resolution
  • Automatic score aggregation
  • Range queries by score or rank
  • TTL-based expiration

Available in: All 7 languages with identical APIs

Streams

Append-only event logs with consumer groups for reliable event processing and replay.

Key Capabilities:

  • Append-only immutable event log
  • Consumer group coordination
  • Offset tracking and liveness detection
  • Event replay and rebalancing
  • TTL retention policies

Available in: All 7 languages with identical APIs

Pub/Sub

Topic-based messaging with poll-based delivery — no persistent connection required.

Key Capabilities:

  • Publish/subscribe with pattern-based topic filters
  • Poll-based delivery (works over plain HTTP, no socket/streaming needed)
  • Long-poll support for low-latency delivery without busy-waiting

Available in: All 7 languages with identical APIs

Transactions

Multi-operation atomic commits — queue operations, then commit or roll back as a unit.

Key Capabilities:

  • Atomic multi-operation commit
  • Explicit rollback
  • Transaction status tracking

Available in: All 7 languages with identical APIs

Persistence

Write-ahead log plus point-in-time snapshots, for crash recovery.

Key Capabilities:

  • Checksummed WAL entries
  • On-demand snapshotting of live CRDT state
  • Restore from latest snapshot

Available in: All 7 languages with identical APIs

Pipelines

Safe composition of built-in operations into named, multi-step sequences — no code-execution surface.

Key Capabilities:

  • Chain get/set/zadd/zscore/enqueue/xadd into one call
  • Pass a step’s result into a later step
  • Register once, execute by name, or run one-off inline

Available in: All 7 languages with identical APIs

WASM Scripting

Real arbitrary-code execution — a script is Go source, compiled by TinyGo to WebAssembly and run sandboxed via wazero. Not a Redis-derived Lua VM; a genuinely different, from-scratch design.

Key Capabilities:

  • Compile once, execute many times cheaply (mirrors Redis’s SCRIPT LOAD/EVALSHA)
  • Hard execution timeout and memory limit per call, enforced by the sandbox
  • An infinite loop or runaway script is force-terminated without affecting the server or other scripts

Available in: All 7 languages with identical APIs

Hybrid lexical (BM25) and vector (cosine similarity) document search.

Key Capabilities:

  • BM25 full-text search
  • Vector similarity search
  • Combined hybrid ranking

Available in: All 7 languages with identical APIs

Ranking

Reorder result sets by strategy, with optional per-field score boosts.

Available in: All 7 languages with identical APIs

Metrics

Per-node operational metrics, in JSON or Prometheus text-exposition format.

Available in: All 7 languages with identical APIs

Installation

Python 

pip install tollmeshcache

Python Documentation

Node.js / TypeScript 

npm install @tollmesh/tollmeshcache

Node.js Documentation

Rust 

cargo add tollmeshcache

Rust Documentation

Ruby 

gem install tollmeshcache

Ruby Documentation

C# / .NET 

dotnet add package TollMeshCache

C# Documentation

PHP 

composer require toll-mesh/cache

PHP Documentation

Java 

<dependency>
    <groupId>io.github.prakhar998</groupId>
    <artifactId>tollmeshcache</artifactId>
    <version>1.0.0</version>
</dependency>

Java Documentation

Architecture

Key Design Principles:

  • CRDT-based consistency: Eventual consistency without central coordinator
  • Lamport clocks: Distributed ordering and causality tracking
  • Skip lists: O(log n) sorted operations
  • Append-only logs: Immutable event history

No Single Point of Failure Every node operates independently with automatic convergence.

Use Cases

Rate Limiting - Distributed token bucket for API throttling across microservices

Gaming Leaderboards - Real-time player rankings with O(log n) updates

Job Processing - Background task queues with exactly-once semantics

Event Sourcing - Immutable event logs for audit and replay

Replay Protection - Built-in nonce tracking prevents duplicate operations

Documentation

Quick Examples

Rate Limiting (Python) 

from tollmeshcache import Client
from datetime import timedelta

client = Client('localhost:8080')
result = client.consume('api-limit', limit=100, window=timedelta(minutes=1))

if result.ok:
    print(f"Allowed. Remaining: {result.remaining}")

Leaderboard (Node.js) 

import { Client } from '@tollmesh/tollmeshcache';

const client = new Client({ host: 'localhost' });

await client.zadd('leaderboard', 100, 'alice');
await client.zadd('leaderboard', 150, 'bob');

const top10 = await client.zrange('leaderboard', 0, 10);

Event Processing (Rust) 

let client = Client::new("localhost:8080").await?;

client.xadd("events", json!({"event": "order", "user": "alice"})).await?;
let events = client.xrange("events", "-", "+").await?;

Contributing

Report issues or contribute improvements:

License

Apache License 2.0 - Free for commercial and personal use.