INT4 LoRA fine-tuning vs QLoRA: A user inquired about the differences between INT4 LoRA high-quality-tuning and QLoRA in terms of precision and speed. A different member explained that QLoRA with HQQ includes frozen quantized weights, isn't going to use tinnygemm, and utilizes dequantizing together with torch.matmul Right place sizing allows