Spaces:

NyxKrage

/

LLM-Model-VRAM-Calculator

like 246

Running

As above, it adds rough bpw numbers for the new IQ quants. (without the error)
IQ1_S (1.56 BPW)

IQ2_XXS (2.06 BPW)

IQ2_XS (2.31 BPW)

IQ2_S (2.5 BPW)

IQ2_M (2.7 BPW)

IQ3_XXS (3.06 BPW)

IQ3_XS (3.3 BPW)

IQ3_S (3.5 BPW)

IQ3_M (3.7 BPW)

IQ4_XS (4.25 BPW)

IQ4_NL (4.5 BPW)