publish-assistant/site/data/papers/NSDI-2024-digest.yaml

venue: NSDI
year: 2024
papers:
- title: 'MegaScale: Scaling Large Language Model Training to More Than 10, 000 GPUs'
  authors:
  - Ziheng Jiang
  - Haibin Lin
  - Yinmin Zhong
  - Qi Huang
  - Yangrui Chen
  - Zhi Zhang
  - Yanghua Peng
  - Xiang Li 0067
  - Cong Xie
  - Shibiao Nong
  - Yulu Jia
  - Sun He
  - Hongmin Chen
  - Zhihao Bai
  - Qi Hou
  - Shipeng Yan
  - Ding Zhou
  - Yiyao Sheng
  - Zhuo Jiang
  - Haohan Xu
  - Haoran Wei
  - Zhang Zhang 0003
  - Pengfei Nie
  - Leqi Zou
  - Sida Zhao
  - Liang Xiang
  - Zherui Liu
  - Zhe Li
  - Xiaoying Jia 0001
  - Jianxi Ye
  - Xin Jin 0008
  - Xin Liu 0086
  reason: "ByteDance's full production account of training LLMs at 10,000+ GPUs, with novel co-design of the network stack, fault tolerance, and collective communication to sustain near-linear scaling."

- title: 'Harmony: A Congestion-free Datacenter Architecture'
  authors:
  - Saksham Agarwal
  - Qizhe Cai
  - Rachit Agarwal 0001
  - David B. Shmoys
  - Amin Vahdat
  reason: "Proposes rethinking datacenter fabrics to eliminate congestion by construction rather than managing it reactively, achieving line-rate throughput without per-packet feedback from Cornell and Google."

- title: 'DINT: Fast In-Kernel Distributed Transactions with eBPF'
  authors:
  - Yang Zhou 0008
  - Xingyu Xiang
  - Matthew Kiley
  - Sowmya Dharanipragada
  - Minlan Yu
  reason: "Demonstrates that eBPF programs executing entirely inside the kernel can enforce linearizable, ACID-compliant distributed transactions at dramatically lower latency than user-space approaches."

- title: Making Kernel Bypass Practical for the Cloud with Junction
  authors:
  - Joshua Fried
  - Gohar Irfan Chaudhry
  - Enrique Saurez
  - Esha Choukse
  - Íñigo Goiri
  - Sameh Elnikety
  - Rodrigo Fonseca
  - Adam Belay
  reason: "Junction (MIT + Microsoft) is the first system to bring full kernel-bypass networking to multi-tenant cloud VMs without requiring application modifications or sacrificing isolation."

- title: 'SIEVE is Simpler than LRU: an Efficient Turn-Key Eviction Algorithm for Web Caches'
  authors:
  - Yazhuo Zhang
  - Juncheng Yang
  - Yao Yue
  - Ymir Vigfusson
  - K. V. Rashmi
  reason: "Surprising finding that a single-queue eviction policy requiring almost no state changes outperforms LRU and all modern approximations on production web-cache workloads."

- title: A large-scale deployment of DCTCP
  authors:
  - Abhishek Dhamija
  - Balasubramanian Madhavan
  - Hechao Li
  - Jie Meng
  - Shrikrishna Khare
  - Madhavi Rao
  - Lawrence Brakmo
  - Neil Spring
  - Prashanth Kannan
  - Srikanth Sundaresan
  - Soudeh Ghorbani
  reason: "A rare, candid production report from Meta on deploying DCTCP at hyperscale, surfacing unexpected interactions with heterogeneous hardware, cross-traffic, and operational constraints."

- title: 'Brain-on-Switch: Towards Advanced Intelligent Network Data Plane via NN-Driven Traffic Analysis at Line-Speed'
  authors:
  - Jinzhu Yan
  - Haotian Xu
  - Zhuotao Liu
  - Qi Li 0002
  - Ke Xu 0002
  - Mingwei Xu 0001
  - Jianping Wu
  reason: "Executes neural-network inference for traffic classification directly in the programmable switch data plane at line rate, eliminating the round-trip to a CPU-based classifier."

- title: 'Horus: Granular In-Network Task Scheduler for Cloud Datacenters'
  authors:
  - Parham Yassini
  - Khaled Diab 0001
  - Saeed Mahloujifar
  - Mohamed Hefeeda
  reason: "Offloads microsecond-granularity task scheduling decisions into programmable switches, reducing load-balancing latency by orders of magnitude compared to software schedulers."

- title: 'CAPA: An Architecture For Operating Cluster Networks With High Availability'
  authors:
  - Bingzhe Liu
  - Colin Scott
  - Mukarram Tariq
  - Andrew D. Ferguson
  - Phillipa Gill
  - Richard Alimi
  - Omid Alipourfard
  - Deepak Arulkannan
  - Virginia Beauregard
  - Patrick Conner
  - Philip Brighten Godfrey
  - Xander Lin
  - Joon Ong
  - Mayur Patel
  - Amr Sabaa
  - Arjun Singh
  - Alex Smirnov
  - Manish Verma
  - Prerepa V. Viswanadham
  - Amin Vahdat
  reason: "Google's production architecture for maintaining five-nines availability in Jupiter-scale cluster networks, detailing how control-plane redundancy and fast failover are achieved in practice."

- title: Revisiting Congestion Control for Lossless Ethernet
  authors:
  - Yiran Zhang
  - Qingkai Meng 0001
  - Chaolei Hu
  - Fengyuan Ren
  reason: "Identifies fundamental flaws in PFC-based lossless Ethernet that cause cascading head-of-line blocking and proposes a redesigned congestion control that avoids them."

- title: 'Sirius: Composing Network Function Chains into P4-Capable Edge Gateways'
  authors:
  - Jiaqi Gao
  - Jiamin Cao
  - Yifan Li
  - Mengqi Liu 0001
  - Ming Tang
  - Dennis Cai
  - Ennan Zhai
  reason: "Alibaba's production system for composing arbitrary NF chains into P4-programmed edge gateways, replacing a fleet of dedicated middleboxes and cutting per-packet processing cost significantly."

- title: 'CASSINI: Network-Aware Job Scheduling in Machine Learning Clusters'
  authors:
  - Sudarsanan Rajasekaran
  - Manya Ghobadi
  - Aditya Akella
  reason: "Shows that ignoring network topology when scheduling ML training jobs causes severe collective-communication contention, and that topology-aware co-scheduling yields substantial throughput gains."

- title: 'Cloudcast: High-Throughput, Cost-Aware Overlay Multicast in the Cloud'
  authors:
  - Sarah Wooders
  - Shu Liu
  - Paras Jain 0001
  - Xiangxi Mo
  - Joseph E. Gonzalez
  - Vincent Liu 0001
  - Ion Stoica
  reason: "Berkeley/Penn system that builds overlay multicast trees across cloud regions optimized for egress cost, enabling high-throughput data dissemination at a fraction of unicast cloud egress fees."