X-LogSMask: Expand Transformer for Graph-Structured Data

arXiv:2607.01553v1 Announce Type: new Abstract: Transformers have become general-purpose architectures, but their all-to-all self-attention is poorly matched to graph data, whose interactions are sparse, structured and multi-scale. Existing Graph Transformers address this mismatch through structural encodings, hybrid message-passing modules or learned attention constraints, often introducing additional complexity and limited interpretability. Here we introduce X-LogSMask, an explainable multi-he...

arXiv cs.LG ·Leyan Li, Rennong Yang, Zhenxing Zhang, Liping Hu ·
compartilhar: