ShuffleInfer: Disaggregate LLM Inference for Mixed Downstream Workloads.

Cunchen Hu

Cunchen Hu Heyang Huang Liangliang Xu Xusheng Chen Chenxi Wang 0005 Jiang Xu Shuang Chen Hao Feng Sa Wang Yungang Bao Ninghui Sun Yizhou Shan ShuffleInfer: Disaggregate LLM Inference for Mixed Downstream Workloads. 77:1-77:24 2025 June 22 ACM Trans. Archit. Code Optim. 2 https://doi.org/10.1145/3732941 db/journals/taco/taco22.html#HuHXCWXCFWBSS25 streams/journals/taco

Heyang Huang Cunchen Hu Jiaqi Zhu Ziyuan Gao Liangliang Xu Yizhou Shan Yungang Bao Ninghui Sun Tianwei Zhang 0004 Sa Wang DDiT: Dynamic Resource Allocation for Diffusion Transformer Model Serving. 2025 June abs/2506.13497 CoRR https://doi.org/10.48550/arXiv.2506.13497 db/journals/corr/corr2506.html#abs-2506-13497 streams/journals/corr

Haonan Wang Xuxin Xiao Mingyu Yan Zhuoyuan Zhu Dengke Han Duo Wang Wenming Li Xiaochun Ye Cunchen Hu Hongyang Chen 0001 Guangyu Sun A Systematic Characterization of LLM Inference on GPUs. 2025 December abs/2512.01644 CoRR https://doi.org/10.48550/arXiv.2512.01644 db/journals/corr/corr2512.html#abs-2512-01644 streams/journals/corr

Cunchen Hu Heyang Huang Liangliang Xu Xusheng Chen Jiang Xu Shuang Chen Hao Feng Chenxi Wang 0005 Sa Wang Yungang Bao Ninghui Sun Yizhou Shan Inference without Interference: Disaggregate LLM Inference for Mixed Downstream Workloads. 2024 abs/2401.11181 CoRR https://doi.org/10.48550/arXiv.2401.11181 db/journals/corr/corr2401.html#abs-2401-11181

Cunchen Hu Heyang Huang Junhao Hu Jiang Xu Xusheng Chen Tao Xie 0001 Chenxi Wang 0005 Sa Wang Yungang Bao Ninghui Sun Yizhou Shan MemServe: Context Caching for Disaggregated LLM Serving with Elastic Memory Pool. 2024 abs/2406.17565 CoRR https://doi.org/10.48550/arXiv.2406.17565 db/journals/corr/corr2406.html#abs-2406-17565 streams/journals/corr

Cunchen Hu Chenxi Wang 0005 Sa Wang Ninghui Sun Yungang Bao Jieru Zhao Sanidhya Kashyap Pengfei Zuo Xusheng Chen Liangliang Xu Qin Zhang Hao Feng Yizhou Shan Skadi: Building a Distributed Runtime for Data Systems in Disaggregated Data Centers. 94-102 2023 HotOS https://doi.org/10.1145/3593856.3595897 https://www.wikidata.org/entity/Q130857342 conf/hotos/2023 db/conf/hotos/hotos2023.html#HuWWSBZKZCXZFS23

Zhiqiang Zou Cunchen Hu Fei Zhang Hao Zhao Shu Shen WSNs Data Acquisition by Combining Hierarchical Routing Method and Compressive Sensing. 16766-16784 2014 14 Sensors 9 https://doi.org/10.3390/s140916766 https://www.wikidata.org/entity/Q30849788 db/journals/sensors/sensors14.html#ZouHZZS14

Zhiqiang Zou Ze-ting Li Hao Zhao Cunchen Hu Fei Zhang Compressed Sensing Data Fusion of Monitoring Cyanobacteria Bloom-Forming. 744-752 2012 CWSN https://doi.org/10.1007/978-3-642-36252-1_70 conf/cwsn/2012 db/conf/cwsn/cwsn2012.html#ZouLZHZ12 Yungang Bao Hongyang Chen 0001 Shuang Chen Xusheng Chen Hao Feng Ziyuan Gao Dengke Han Junhao Hu Heyang Huang Sanidhya Kashyap Wenming Li Ze-ting Li Yizhou Shan Shu Shen Guangyu Sun Ninghui Sun Chenxi Wang 0005 Duo Wang Haonan Wang Sa Wang Xuxin Xiao Tao Xie 0001 Jiang Xu Liangliang Xu Mingyu Yan Xiaochun Ye Fei Zhang Qin Zhang Tianwei Zhang 0004 Hao Zhao Jieru Zhao Jiaqi Zhu Zhuoyuan Zhu Zhiqiang Zou Pengfei Zuo