AWQ working for minitron
#1
by
Suparious
- opened
@vaclavkosar this is your fault, that I figured out this minitron stuff...
It is working well, seems like a cool model-strategy to fuck with.
Suparious
changed discussion status to
closed
Haha! I am ready to take responsibility! Haha! Are you referring to the solidrust/Mistral-NeMo-Minitron-8B-Base-AWQ?
Regardless, you are the master quantizer! Thanks!