RankAdaptor: Hierarchical Dynamic Low-Rank Adaptation for Structural Pruned LLMs.

Mon, 01 Jan 2024 00:00:00 +0100

Changhai Zhou, Shijie Han, Shiyang Zhang, Shichao Weng, Zekai Liu, Cheng Jin:
RankAdaptor: Hierarchical Dynamic Low-Rank Adaptation for Structural Pruned LLMs. CoRR abs/2406.15734 (2024)