Cache Gate
01Reuse prior traces
Hashes the normalized query against the local result cache. A hit returns the stored answer and skips every downstream plugin — the cheapest possible hop.
Cloud token pressure
2ms local · 0 tok out est.
Lesson Compose order is execution order. Keep Privacy Filter before anything that can leave the device.
Compose
Enable, isolate and order executors. Local plugins never leave the device. Cloud hops only see what survives the compressor and the privacy filter.
Reuse prior traces
Hashes the normalized query against the local result cache. A hit returns the stored answer and skips every downstream plugin — the cheapest possible hop.
Cloud token pressure
2ms local · 0 tok out est.
Redact before any hop
Strips emails, keys, SSNs and phone numbers from text that might leave the device. In air-gapped mode it blocks every network plugin outright.
Cloud token pressure
4ms local · 0 tok out est.
History → embeddings
Replaces raw conversation dumps with compact int8 embeddings plus short extractive summaries. Typical prompt cut: 70–90%.
Cloud token pressure
12ms local · 0 tok out est.
Top-k local search
Cosine search over the on-device 96-dim quantized store. Only the most relevant snippets are eligible for the prompt.
Cloud token pressure
8ms local · 0 tok out est.
Route by skill vectors
Matches the query against persisted skill vectors so the pipeline can bias retrieval and routing toward the right capability.
Cloud token pressure
5ms local · 0 tok out est.
Hard token ceiling
Clips retrieved snippets to a configured token budget so a noisy store cannot inflate the prompt.
Cloud token pressure
1ms local · 0 tok out est.
Local, hybrid, or cloud
Scores complexity, privacy, cache state and estimated cost. Simple factual lookups stay local; hard reasoning may take a hybrid hop.
Cloud token pressure
3ms local · 0 tok out est.
Extractive answers, no LLM
Builds an answer from the highest-scoring local snippets. Used whenever the router stays on-device or air-gap is armed.
Cloud token pressure
10ms local · 0 tok out est.
Compressed cloud hop
Sends only retrieved, redacted snippets to a cloud reasoner. Blocked in air-gapped mode. Never receives raw history.
Cloud token pressure
0ms local · 280 tok out est.
Persist the trace
Writes the answer and routing trace back to IndexedDB so identical queries cost nothing next time.
Cloud token pressure
3ms local · 0 tok out est.