The Best Way to Align an LLM: Inner Alignment is Now a Solved Problem?
"LLM训练" 相关文章
Revelo’s LatAm talent network sees strong demand from US companies, thanks to AI
历时6个月，Hugging Face开源LLM「超大规模实战手册」！200页3万字4000次训练
历时6个月，Hugging Face开源LLM「超大规模实战手册」！200页3万字4000次训练
Elevating AI Reasoning: The Art of Sampling for Learnability in LLM Training
LeCun力荐！进化算法淘汰77%低质数据：RIP方法让模型性能狂飙60%
LeCun力荐！进化算法淘汰77%低质数据：RIP方法让模型性能狂飙60%
Andrej Karpathy：我们需要让大模型“上学”，强化学习才刚开始
田渊栋：2024年年终总结
Frenzy: A Memory-Aware Serverless Computing Method for Heterogeneous GPU Clusters
Hugging Face Releases Picotron: A Tiny Framework that Solves LLM Training 4D Parallelization
An introduction to preparing your own dataset for LLM training
How Fastweb fine-tuned the Mistral model using Amazon SageMaker HyperPod as a first step to build an Italian large language model
LASER: An Adaptive Method for Selecting Reward Models RMs and Iteratively Training LLMs Using Multiple Reward Models RMs
Revisiting Weight Decay: Beyond Regularization in Modern Deep Learning
instruction tuning and autoregressive distribution shift
Why GPU Utilization Falls Short: Understanding Streaming Multiprocessor (SM) Efficiency for Better LLM Performance
从裸机到700亿参数大模型，这里有份教程，还有现成可用的脚本
Spectrum: An AI Method that Accelerates LLM Training by Selectively Targeting Layer Modules based on their Signal-to-Noise Ratio (SNR)
Yandex Introduces YaFSDP: An Open-Source AI Tool that Promises to Revolutionize LLM Training by Cutting GPU Usage by 20%
