Base Models vs Instruct Models: Which to Start From
For most projects, start from the instruct (chat) version of a model. It already follows instructions and has a chat template, so a small dataset is enough. Start from the base version when you want full control over behaviour, plan to use a lot of data, or ar...