Flora: Low-Rank Adapters Are Secretly Gradient Compressors
Yongchang HaoYanshuai CaoLili Mou
article2024ICML106 citations
Yongchang HaoYanshuai CaoLili Mou
@misc{https://doi.org/10.48550/arxiv.2402.03293,
doi = {10.48550/ARXIV.2402.03293},
url = {https://arxiv.org/abs/2402.03293},
author = {Hao, Yongchang and Cao, Yanshuai and Mou, Lili},
keywords = {Machine Learning (cs.LG), Artificial Intelligence (cs.AI), Machine Learning (stat.ML), FOS: Computer and information sciences, FOS: Computer and information sciences},
title = {Flora: Low-Rank Adapters Are Secretly Gradient Compressors},
publisher = {arXiv},
year = {2024},
copyright = {Creative Commons Attribution Non Commercial Share Alike 4.0 International}
}This paper is available from its original source. Click below to access the PDF.
Open PDF