https://guangxuanx.com/blog/stacking-swa.html
Why Stacking Sliding Windows Can't See Very Far
Guangxuan Xiao
August 25, 2025
"Modern LLMs use sliding window attention for efficiency, but why can't stacking sliding windows see as far as theory suggests?"