jxtngx
/

mamba-2.8b-hf-Q4_K_S-GGUF

Model card Files Files and versions Community

Edit model card

jxtngx/mamba-2.8b-hf-Q4_K_S-GGUF

This model was converted to GGUF format from state-spaces/mamba-2.8b-hf using llama.cpp via the ggml.ai's GGUF-my-repo space. Refer to the original model card for more details on the model.

Downloads last month: 10

GGUF

Model size

2.77B params

Architecture

mamba

4-bit

Inference API

Unable to determine this model's library. Check the docs .

Model tree for jxtngx/mamba-2.8b-hf-Q4_K_S-GGUF

Base model

state-spaces/mamba-2.8b-hf

Quantized

this model

Collection including jxtngx/mamba-2.8b-hf-Q4_K_S-GGUF

GGUF small language models

LMs of 8B parameters or less. Quantized in 8bit and 4bit representations, and converted to GGUF. • 29 items • Updated 4 days ago