SVDQuant: 4-Bit Quantization Powers 12B Flux on a 16GB 4090 GPU with 3x Speeduphanlab.mit.edu179 pointslmxyy2 years ago