Memory

13 papers selected. Empowering WebAssembly with Thin Kernel Interfaces Arjun Ramesh, Tianshu Huang, Ben L. Titzer, Anthony Rowe 0001 TL;DR — A new OS interface design exposes thin, capability-based kernel primitives directly to WebAssembly modules, eliminating the POSIX translation layer. Why notable — WebAssembly is increasingly used beyond the browser as a portable, sandboxed compute substrate; this work shows that rethinking the system interface from scratch yields significantly lower overhead and better safety properties than layering Wasm on top of POSIX. ...

11 papers selected. DistServe: Disaggregating Prefill and Decoding for Goodput-optimized Large Language Model Serving Yinmin Zhong, Shengyu Liu, Junda Chen, Jianbo Hu et al. TL;DR — Separates the compute-heavy prefill phase from the memory-bound decoding phase onto different GPU pools, eliminating head-of-line blocking and significantly improving LLM serving throughput. Why notable — Became one of the most influential LLM systems papers of 2024; the prefill–decode disaggregation insight is now widely adopted in production inference stacks (vLLM, SGLang, etc.). ...