[Solved] Mistral Cannot Generate eos_token `<|im_end|>` After SFTTrainer Fine-tuning
Last Updated on 2024-01-02 by Clay
Problem
HuggingFace has published an article stating that the current LLM is best trained according to the ChatML format. In normal case, it will be generated according to three different roles of system, user and assistant. The format is as follows:
Read More »[Solved] Mistral Cannot Generate eos_token `<|im_end|>` After SFTTrainer Fine-tuning