TF-Engram: A Train-Free Engram with SSD-Backed Memory for Large Language Models

arXiv:2607.07388v1 Announce Type: new Abstract: Large Language Models (LLMs) store factual knowledge and domain-specific patterns implicitly in dense Transformer parameters, making knowledge expansion costly through pretraining, fine-tuning, retrieval augmentation, or longer contexts. Engram-style memory offers a compact hidden-state injection pathway, but existing GPU-resident designs often rely on hash-based compression, causing unrelated phrases to collide in shared slots and weakening phrase...

arXiv cs.CL ·Yutang Ma, Kecheng Huang, Xikun Jiang, Zili Shao ·
compartilhar: