GGUF Quantised variants of https://huggingface.co/abacusai/Smaug-Mixtral-v0.1
3-bit
4-bit