Add QuIP# support by oobabooga · Pull Request #4803 · oobabooga/text-generation-webui
github.com
QuIP# is a novel quantization method. Its 2-bit performance is better than anything previously available. Repository: https://github.com/Cornell-RelaxML/quip-sharp Blog post: https://cornell-relaxm...