Dynamic Compressing Prompts for Efficient Inference of Large Language Models.

Tue, 01 Apr 2025 01:00:00 +0200

Jinwu Hu, Wei Zhang, Yufeng Wang, Yu Hu, Bin Xiao, Mingkui Tan, Qing Du:
Dynamic Compressing Prompts for Efficient Inference of Large Language Models. CoRR abs/2504.11004 (2025)