Zyphra Hierarchical Attention (ZHA) retrofits pretrained LLMs with a tree indexer, adding 81,920 parameters, nearly matching dense accuracy.