Fine-Tuning vs Prompting vs RAG: How to Choose
Use prompting first, add retrieval when the model needs facts it does not have, and fine-tune when you need a consistent behaviour, format or cost profile that prompting cannot deliver. The three techniques solve different problems, and many production systems...