Flora: Low-Rank Adapters Are Secretly Gradient Compressors

Yongchang HaoYanshuai CaoLili Mou

article2024ICML106 citations
Hao et al (2024).pdf

Citation

MLA
Hao, Y., et al. “Flora: Low-Rank Adapters Are Secretly Gradient Compressors”. arXiv, 2024, https://doi.org/10.48550/arxiv.2402.03293.
APA
Hao, Y., Cao, Y., & Mou, L. (2024). Flora: Low-Rank Adapters Are Secretly Gradient Compressors. arXiv. https://doi.org/10.48550/arxiv.2402.03293
Chicago
Hao, Y., Y. Cao, and L. Mou. 2024. “Flora: Low-Rank Adapters Are Secretly Gradient Compressors”. Preprint, ArXiv. https://doi.org/10.48550/arxiv.2402.03293.
Harvard
Hao, Y., Cao, Y. and Mou, L. (2024) “Flora: Low-Rank Adapters Are Secretly Gradient Compressors”. arXiv. Available at: https://doi.org/10.48550/arxiv.2402.03293.
Vancouver
1. Hao Y, Cao Y, Mou L (2024) Flora: Low-Rank Adapters Are Secretly Gradient Compressors. https://doi.org/10.48550/arxiv.2402.03293

BibTeX

@misc{https://doi.org/10.48550/arxiv.2402.03293,
  doi = {10.48550/ARXIV.2402.03293},
  url = {https://arxiv.org/abs/2402.03293},
  author = {Hao, Yongchang and Cao, Yanshuai and Mou, Lili},
  keywords = {Machine Learning (cs.LG), Artificial Intelligence (cs.AI), Machine Learning (stat.ML), FOS: Computer and information sciences, FOS: Computer and information sciences},
  title = {Flora: Low-Rank Adapters Are Secretly Gradient Compressors},
  publisher = {arXiv},
  year = {2024},
  copyright = {Creative Commons Attribution Non Commercial Share Alike 4.0 International}
}
Metadata:DOI registry

Access the Paper

This paper is available from its original source. Click below to access the PDF.

Open PDF
License: https://creativecommons.org/licenses/by/4.0/