Lattice
10 plugins0 runs0% saved

Lesson Compose order is execution order. Keep Privacy Filter before anything that can leave the device.

Compose

Plugin matrix

Enable, isolate and order executors. Local plugins never leave the device. Cloud hops only see what survives the compressor and the privacy filter.

  1. 01Cache Gatelocal
  2. 02Privacy Filterlocal
  3. 03Context Compressorlocal
  4. 04Vector Retrieverlocal
  5. 05Skill Matcherlocal
  6. 06Prompt Budgetlocal
  7. 07Smart Routerhybrid
  8. 08Local Echolocal
  9. 09Cloud Reasoncloud
  10. 10Result Cachelocal

Cache Gate

01

Reuse prior traces

Hashes the normalized query against the local result cache. A hit returns the stored answer and skips every downstream plugin — the cheapest possible hop.

localairgapped

Cloud token pressure

2ms local · 0 tok out est.

Privacy Filter

02

Redact before any hop

Strips emails, keys, SSNs and phone numbers from text that might leave the device. In air-gapped mode it blocks every network plugin outright.

localairgapped

Cloud token pressure

4ms local · 0 tok out est.

Context Compressor

03

History → embeddings

Replaces raw conversation dumps with compact int8 embeddings plus short extractive summaries. Typical prompt cut: 70–90%.

localairgapped

Cloud token pressure

12ms local · 0 tok out est.

Vector Retriever

04

Top-k local search

Cosine search over the on-device 96-dim quantized store. Only the most relevant snippets are eligible for the prompt.

localairgapped

Cloud token pressure

8ms local · 0 tok out est.

Skill Matcher

05

Route by skill vectors

Matches the query against persisted skill vectors so the pipeline can bias retrieval and routing toward the right capability.

localairgapped

Cloud token pressure

5ms local · 0 tok out est.

Prompt Budget

06

Hard token ceiling

Clips retrieved snippets to a configured token budget so a noisy store cannot inflate the prompt.

localairgapped

Cloud token pressure

1ms local · 0 tok out est.

Smart Router

07

Local, hybrid, or cloud

Scores complexity, privacy, cache state and estimated cost. Simple factual lookups stay local; hard reasoning may take a hybrid hop.

hybridsandboxed

Cloud token pressure

3ms local · 0 tok out est.

Local Echo

08

Extractive answers, no LLM

Builds an answer from the highest-scoring local snippets. Used whenever the router stays on-device or air-gap is armed.

localairgapped

Cloud token pressure

10ms local · 0 tok out est.

Cloud Reason

09

Compressed cloud hop

Sends only retrieved, redacted snippets to a cloud reasoner. Blocked in air-gapped mode. Never receives raw history.

cloudnetwork

Cloud token pressure

0ms local · 280 tok out est.

Result Cache

10

Persist the trace

Writes the answer and routing trace back to IndexedDB so identical queries cost nothing next time.

localairgapped

Cloud token pressure

3ms local · 0 tok out est.