RWKV-5 Eagle and RWKV-6 Finch: Expanding the State into a Matrix and Making Recurrence Dynamic
This article explains, with evidence from the original paper, how Eagle and Finch retain RWKV-4's efficient inference path while adding matrix states, multiple heads, and data-dependent recurrence.