Supervised Fine-tuning Trainer (SFTTrainer) Note

Last Updated on 2024-08-02 by Clay Introduction Supervised Fine-Tuning (SFT) is one of the most well-known methods for training Large Language Models (LLM). Essentially, it is similar to traditional language modeling, where the model learns certain knowledge through training data. The only difference is that traditional language modeling may involve learning entire texts, which is … Continue reading Supervised Fine-tuning Trainer (SFTTrainer) Note