The Ultimate LLM Fine-Tuning Guide

I was looking for a "spot-on" fine-tuning guide since quite a while, but couldn't find one. So i thought: Let's write it myself. https://preview.redd.it/tqqpw8snuwyg1.jpg?width=1672&format=pjpg&auto=webp&s=6fc418aa3bbd809f982c688b3a343d206522d520 It covers Full-SFT as well as LoRA and QLoRA. This one is for NVIDIA and Single-GPU, but if you guys like i will later add Multi-GPU Training, AMD and Pre-training, too. I describe the process from installing the correct drivers and libs, preparing t