Depth Enables Local Entropy: Quadratic Depth Dependence in Deep Variation-Norm ReLU Regression

arXiv:2608.17434v1 Announce Type: new Abstract: We study Gaussian regression over the explicit vector-valued Parhi--Nowak deep-RBV^2 architecture with depth L, width w, layer-sum variation budget A, and output bound B. For this O(L w^2)-parameterized architecture, the known lower and upper bounds differ by one factor of depth. We construct a local packing showing that the quadratic depth dependence is intrinsic under an explicit sample-size-dependent radius condition. The packing has log-cardina...

arXiv cs.AI ·Tao Jiang, Minbo Gao, Shaowei Cai ·
compartilhar: