bnb-4 bit
Collection
A 4-bit quantized version models designed for fine-tuning. Demo: https://colab.research.google.com/drive/19UpFUjtbJoLua-4DMb1JKKwJAcvMyMHb
•
21 items
•
Updated
gemma-2-9b - bnb 4bit
- Model creator: Google
- Original model: gemma-2-9b
Description
This model is 4bit quantized version of gemma-2-9b using bitsandbytes. It's designed for fine-tuning! The PAD token is set as "".
- Downloads last month
- 2
Inference API (serverless) is not available, repository is disabled.
Model tree for leliuga/gemma-2-9b-bnb-4bit
Base model
google/gemma-2-9b
Quantized
this model