Puzzle: Distillation-Based NAS for Inference-Optimized LLMs

Bibliographic Details

Published in:	arXiv.org (Dec 8, 2024), p. n/a
Main Author:	Akhiad Bercovich
Other Authors:	Ronen, Tomer, Abramovich, Talor, Ailon, Nir, Nave Assaf, Dabbah, Mohammad, Galil, Ido, Geifman, Amnon, Geifman, Yonatan, Golan, Izhak, Haber, Netanel, Karpas, Ehud, Koren, Roi, Levy, Itay, Molchanov, Pavlo, Mor, Shahar, Zach, Moshe, Nabwani, Najeeb, Puny, Omri, Rubin, Ran, Schen, Itamar, Shahaf, Ido, Tropp, Oren, Omer Ullman Argov, Zilberstein, Ran, El-Yaniv, Ran
Published:	Cornell University Library, arXiv.org
Subjects:	Computing costs Integer programming Mixed integer Computer architecture Large language models Graphics processing units Hardware Constraints Parameters Inference
Online Access:	Citation/Abstract Full text outside of ProQuest
Tags:	Add Tag No Tags, Be the first to tag this record!