Skip to main content

// TOPIC STREAM

31 posts tagged with "LLM"

LLM architecture, training, inference, and tooling.

A dark glass-style image contrasting a fixed-size state vector with externally searchable memory
Research::7 min

Is a Fixed-Size Hidden State Memory, or Compression?

This article distinguishes fixed-size recurrent hidden states as memory devices versus information compression. It explains the role of state through S4, Mamba, RWKV, and Resona, while treating Qdrant and Statey separately as external-memory contexts.

2 more topics
referenced
A security shield surrounding the state boundary of recurrent state and agent tool calls
Security::7 min

Is Recurrent State a New Attack Surface?

This article treats recurrent state and agent memory as security boundaries. It connects Mamba, Hidden State Poisoning, trajeckt, and Valmis while separating paper evidence from product and security context to examine the risks of state poisoning, reuse, and data flows.

3 more topics
referenced
A dark glass-style image in which Transformer attention and recurrent state paths intersect
Research::8 min

Does SSM Replace the Transformer, or Do They Divide the Work?

This article reads the competition between state space models and Transformers as a question of division of labor rather than structural replacement. Based on the abstracts and publicly stated claims of Mamba, Griffin, Jamba, and Mamba-3, it organizes the trade-offs among long contexts, generation, and hardware efficiency.

2 more topics
referenced
AgentsCAD cover image in a dark glass terminal style, depicting a B-Rep mesh connected to multi-agent LLMs
Research::6 min

AgentsCAD: Automated Design for Manufacturing of FDM Parts — Multi-Agent LLM Reasoning and Geometric Feature Recognition

A technical review of AgentsCAD: research that automates design-for-manufacturing (DFAM) modifications for FDM by combining STEP B-Rep parsing, overhang detection, GraphSAGE-based semantic label injection, multi-agent LLM reasoning with Claude Sonnet, and GPT-4o visual verification. It also states the uncertainty where evidence is limited.

referenced
Dark glass terminal displaying an abstract AutoGPT agent platform UI
Product::5 min

AutoGPT Platform Analysis: Agent Platform Architecture and a Practical Self-Hosting Guide

A technical overview of the AutoGPT platform's autogpt_platform components, self-hosting flow, major tools including Forge, agbenchmark, the frontend, and CLI, and licensing considerations, based on the Significant-Gravitas/AutoGPT README and documentation excerpts. Because some source details are partial, consult the official documentation as well.

referenced
DemoPSD cover image visualizing token distributions and mixtures that represent disagreement-based knowledge distillation
Research::5 min

DemoPSD: An Analysis of Disagreement-Modulated Policy Self-Distillation

A summary of DemoPSD's core idea and implications: selective adoption of teacher guidance based on disagreement, a reverse-KL barycenter target, and theoretical claims and experimental results concerning privileged-information leakage and preservation of exploration. It is grounded in arXiv 2607.02502v1 and marks details outside the supplied evidence as uncertain.

EAGLE-360 cover image in a dark glass terminal style, visualizing 360-degree exploration
Research::6 min

EAGLE-360: Embodied Active Global-to-Local Exploration in 360° Environments

The 2026 EAGLE-360 paper proposes a Global-to-Local strategy, RoPE Rolling positional encoding, and an SFT plus GRPO training pipeline for active exploration in 360° panoramic spaces. Based on the public abstract, this post provides a technical overview of the contributions and design, explaining both the evidence and uncertainty around the stated dataset and performance claims.