Human-AI Interaction · Layered Memory

Tangible Mem

Inspectable and Correctable Hierarchical Memory
for Long-Term Research Meetings

Shang-Jung Tsai Yu-Jen Chen Yi-Hsin Lee
Advisor: Yu-Chun Yen National Yang Ming Chiao Tung University
Conceptual overview showing opaque memory becoming L1 evidence, L2 topic states, L3 topic families, and a human-facing Memory Observatory with sidecar correction.
Tangible Mem turns hidden memory state into inspectable layers and gives people a non-destructive path to challenge what enters the model context.

Abstract

Research decisions, rationales, and open questions evolve across meetings, yet many AI assistants reduce that history to a short chat window or an opaque set of retrieved chunks. Tangible Mem is a hierarchical memory system and inspection workbench for long-term research meetings. It preserves source-grounded evidence as immutable L1 objects, derives reusable L2 topic states and L3 topic-family navigation, and exposes the resulting retrieval path through Memory Observatory.

The interface lets people inspect which evidence and topic context enter a prompt, compare retrieval strategies, and record corrections through sidecars without overwriting raw evidence. The current implementation supports technical walkthroughs and preliminary evaluations on internal research meetings and the public ICSI meeting corpus; a human-subject study has not yet been completed.

Evidence first, hierarchy second

Each layer has a different evidence status. Derived topic structure supports navigation and synthesis, while factual claims remain connected to L1 evidence.

L1

Evidence objects

Source-grounded meeting memories with transcript evidence and provenance.

Immutable source layer
L2

Topic states

Persistent topic summaries and selected event timelines across meetings.

Derived context
L3

Topic families

Higher-level navigation for related topic states when collections grow large.

Navigation, not evidence
+

Sidecar correction

Human review changes the effective memory view without rewriting raw L1.

Non-destructive control
System flow from meeting transcript to L1 store, L2 and L3 topic surface, retrieval trace, answer context, Observatory views, sidecar feedback, and effective memory.
Retrieval starts from source-grounded L1 evidence, expands into selected L2 evolution context, and uses L3 only for broader navigation.

Inspect, challenge, and verify

The live system remains a FastAPI application. This project page presents static captures from the current ICSI artifact-backed interface rather than simulating a backend on GitHub Pages.

Quality and evidence tradeoffs

These two evaluations answer different questions and are intentionally reported separately. Neither is evidence from a completed user study.

Internal research meetings 14 questions

LLM-judge answer quality

A preliminary comparison using Gemini 2.5 Pro for answer generation and judging. Full Context is an uncapped upper-bound condition.

Method Quality / 5 Avg. tokens
Full Context 4.894 81,069
RAG Baseline 4.507 21,284
Layered Memory 4.789 14,115

Layered Memory scored below uncapped Full Context and above the tested RAG baseline while using substantially less prompt context. This is not a claim of general superiority.

Public ICSI corpus 20 held-out questions

No-LLM retrieval diagnostic

A retrieval and evidence-coverage comparison. No answer generation or answer-quality judging was used.

Method Expected L1 recall Avg. tokens
Full Context L1 1.0000 575,199
Lexical RAG 0.5583 2,370
Layered Memory 0.8958 7,358

The layered configuration recovered more expected source evidence than top-20 lexical RAG at a larger—but still far smaller than full-context—prompt budget.

Claim boundary. These artifacts support a technical system demonstration and preliminary diagnostics. They do not establish user trust, usability gains, state-of-the-art retrieval, or generated-answer superiority on the ICSI corpus.

Resources and limitations

Project poster

A Traceable Hierarchical Memory System

Open PDF

PDF preview is unavailable in this browser. Open the poster.