大语言模型推理优化技术综述（The Art of LLM Inference）
"推测解码" 相关文章
苹果正在与英伟达合作，想让AI的响应速度更快
Researchers from Snowflake and CMU Introduce SuffixDecoding: A Novel Model-Free Approach to Accelerating Large Language Model (LLM) Inference through Speculative Decoding
Transformer inference tricks
AMD发布首个AI小语言模型：6900亿token、推测解码提速3.88倍
This AI Paper from KAIST AI Introduces a Novel Approach to Improving LLM Inference Efficiency in Multilingual Settings
AMD 推出自家首款小语言 AI 模型“Llama-135m ”，主打“推测解码”能力可减少 RAM 占用
Together AI Optimizing High-Throughput Long-Context Inference with Speculative Decoding: Enhancing Model Performance through MagicDec and Adaptive Sequoia Trees
3天把Llama训成Mamba，性能不降，推理更快！
3天把Llama训成Mamba，性能不降，推理更快
