GGUF quants version?
#1
by
celsowm
- opened
Hi !
Any chances of GGUF quants version of Jamba 1.5 to run it on llama cpp ?
Thanks in advance !
Support is getting worked on since the first Jamba, you'll have to be patient:
https://github.com/ggerganov/llama.cpp/pull/7531