reach-vb
/

Meta-Llama-3.1-8B-Instruct-AWQ-INT4-fix

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

Meta-Llama-3.1-8B-Instruct-AWQ-INT4-fix

2 contributors

History: 1 commit

reach-vb's picture

reach-vb HF staff

alvarobartt's picture

alvarobartt HF staff

Duplicate from hugging-quants/Meta-Llama-3.1-8B-Instruct-AWQ-INT4

f01df9e verified about 1 month ago

.gitattributes

1.52 kB

Duplicate from hugging-quants/Meta-Llama-3.1-8B-Instruct-AWQ-INT4 about 1 month ago
LICENSE

7.63 kB

Duplicate from hugging-quants/Meta-Llama-3.1-8B-Instruct-AWQ-INT4 about 1 month ago
README.md

9.92 kB

Duplicate from hugging-quants/Meta-Llama-3.1-8B-Instruct-AWQ-INT4 about 1 month ago
USE_POLICY.md

4.69 kB

Duplicate from hugging-quants/Meta-Llama-3.1-8B-Instruct-AWQ-INT4 about 1 month ago
config.json

1.04 kB

Duplicate from hugging-quants/Meta-Llama-3.1-8B-Instruct-AWQ-INT4 about 1 month ago
generation_config.json

189 Bytes

Duplicate from hugging-quants/Meta-Llama-3.1-8B-Instruct-AWQ-INT4 about 1 month ago
model-00001-of-00002.safetensors
4.68 GB
LFS

Duplicate from hugging-quants/Meta-Llama-3.1-8B-Instruct-AWQ-INT4 about 1 month ago
model-00002-of-00002.safetensors

1.05 GB
LFS

Duplicate from hugging-quants/Meta-Llama-3.1-8B-Instruct-AWQ-INT4 about 1 month ago
model.safetensors.index.json

63.5 kB

Duplicate from hugging-quants/Meta-Llama-3.1-8B-Instruct-AWQ-INT4 about 1 month ago
special_tokens_map.json

295 Bytes

Duplicate from hugging-quants/Meta-Llama-3.1-8B-Instruct-AWQ-INT4 about 1 month ago
tokenizer.json

9.09 MB

Duplicate from hugging-quants/Meta-Llama-3.1-8B-Instruct-AWQ-INT4 about 1 month ago
tokenizer_config.json

55.4 kB

Duplicate from hugging-quants/Meta-Llama-3.1-8B-Instruct-AWQ-INT4 about 1 month ago