Skip to main content

// TOPIC STREAM

49 posts tagged with "Explainer"

Concept-first guides to complex systems.

Conceptual diagram connecting recurrent memory cells with a matrix state
Research::6 min

xLSTM: How to Scale Recurrent Memory Again

xLSTM redesigns LSTM gating and memory structures from the perspective of scaling modern language models. Based on the public abstract and metadata, this article examines the roles of sLSTM and mLSTM, the meaning of parallelization and memory state, and performance conditions that remain unverified.

Conceptual diagram of an attack path that overwrites a Mamba hidden state
Security::6 min

Hidden State Poisoning: When Mamba's Efficient State Becomes an Attack Surface

Hidden State Poisoning Attacks against Mamba-based Language Models analyzes how a short trigger can overwrite the hidden state of Mamba-family models and break information retrieval. Centered on HiSPA and RoBench-25, this article explains the relationship between efficient state and the security boundary within the scope of the original abstract.

referenced
Conceptual diagram of retrieving relevant tokens from input context and copying them into a linear recurrent state
Research::6 min

Resona: Using Retrieval to Improve Context Copying in Linear Recurrent Models

Resona is a framework that retrieves needed information from the input context and reinjects it into a linear recurrent language model. Based on the paper's abstract, this article examines the bottleneck in context copying, the meaning of combining retrieval with recurrence, and the evaluation, cost, and evidence that must be checked before practical adoption.

A dark glass-style image contrasting a fixed-size state vector with externally searchable memory
Research::7 min

Is a Fixed-Size Hidden State Memory, or Compression?

This article distinguishes fixed-size recurrent hidden states as memory devices versus information compression. It explains the role of state through S4, Mamba, RWKV, and Resona, while treating Qdrant and Statey separately as external-memory contexts.

2 more topics
referenced
A security shield surrounding the state boundary of recurrent state and agent tool calls
Security::7 min

Is Recurrent State a New Attack Surface?

This article treats recurrent state and agent memory as security boundaries. It connects Mamba, Hidden State Poisoning, trajeckt, and Valmis while separating paper evidence from product and security context to examine the risks of state poisoning, reuse, and data flows.

3 more topics
referenced
A dark glass-style image in which Transformer attention and recurrent state paths intersect
Research::8 min

Does SSM Replace the Transformer, or Do They Divide the Work?

This article reads the competition between state space models and Transformers as a question of division of labor rather than structural replacement. Based on the abstracts and publicly stated claims of Mamba, Griffin, Jamba, and Mamba-3, it organizes the trade-offs among long contexts, generation, and hardware efficiency.

2 more topics
referenced