What is a cluster?
A cluster is a synthesized summary of a group of related memories. It’s not a new memory. It’s not a retrieval candidate. It’s a compressed, high-level understanding of what a bunch of individual memories have in common. Your agent has dozens of separate memories about your programming preferences. Rust this. Python that. Vim bindings here. Terminal over IDE there. Individually, each one is a fact. Together, they paint a picture. A cluster captures that picture in one sentence:“User strongly prefers low-level systems programming, uses keyboard-centric tools, and avoids GUI-heavy workflows.”Dozens of memories compressed into one insight. Same meaning. Fraction of the footprint.
Why cluster? Because noise kills recall
More memories doesn’t mean better recall. It often means worse. When you search through thousands of facts, you get redundancy. The same answer appears fifteen times in fifteen different wordings. Unique, important but less frequent memories get buried under the weight of repetitive observations. Clustering fights back. By grouping related memories and synthesizing their shared meaning, clusters reduce the dimensionality of the knowledge base without losing information. The original memories are all still there. The cluster just gives the system a higher-level vantage point.How it works
Clustering happens in two phases:| Phase | When | What happens |
|---|---|---|
| Assignment | At ingestion | New memory is matched against existing clusters. If it fits, it joins. If not, it waits for the next batch. |
| Synthesis | When a cluster hits minimum size | All member memories are read together and compressed into one summary. |
Clusters and retrieval
Clusters play a supporting role during retrieval:| Aspect | Role |
|---|---|
| Individual memories | Primary retrieval results. Grounded, verifiable, traceable to source. |
| Cluster summaries | Interpretations. Useful for understanding patterns, not a substitute for specific answers. |
So what are they good for?
| Signal | What it tells the system |
|---|---|
| Dense cluster | This topic is well-covered with repeated observations |
| Memory can’t find a cluster | This might be something novel worth paying attention to |
| Over time | The system self-organizes around what’s established, what’s forming, and what’s noise |