GSQ-Tuning: Group-Shared Exponents Integer in Fully Quantized Training for LLMs On-Device Fine-tuning

Resource preserving tuning with shared Integer quantization.

Recommended citation: GSQ-Tuning: Group-Shared Exponents Integer in Fully Quantized Training for LLMs On-Device Fine-tuning. Arxiv. S. Zhou*, S. Wang*, Z. Yuan*, M. Shi, Y. Shang, D. Yang.
Download Paper