Any Idea When This Will Be Supported in TGI?
#3
by
pr1me
- opened
I just tried loading this up with Text Generation Inference and it doesn't look like the new model is supported. Is this currently in the works?
Yes it is! In maybe 1, 2 weeks maximum, it should surely be done.