4bit and 8bit
#11
by
BBLL3456
- opened
Hi,
Thanks for this fantastic model. Will you be releasing the 4bit and 8 bit versions too?
Hi BBLL3456,
We will not. GGUF seems to be more popular as of now, and the conversion is easy with many community works.
For AWQ and GPTQ, Modelscope community has provided a version using their SWIFT framework, check here: https://www.modelscope.cn/models/AI-ModelScope/Yi-1.5-34B-Chat-AWQ/summary
Bests,
DevRel
lorinma
changed discussion status to
closed