Edit Models filters

Inference status

Misc

arxiv: 2210.17323

text-generation-inference

AutoTrain Compatible

Inference Endpoints

4-bit precision

8-bit precision

Carbon Emissions

Misc with no match

text-embeddings-inference

Mixture of Experts

Models

100

Full-text search

Active filters: 2210.17323

Honkware/Manticore-13b-Landmark-GPTQ

Text Generation • Updated Jun 14, 2023 • 9 • 2

malhajar/Platypus2-70B-instruct-4bit-gptq

Text Generation • Updated Jan 29 • 700

clibrain/Llama-2-13b-ft-instruct-es-gptq-4bit

Text Generation • Updated Sep 4, 2023 • 17 • 3

malhajar/Uni-TianYan-4bit-gptq

Text Generation • Updated Sep 7, 2023 • 6

daedalus314/Griffin-3B-GPTQ

Text Generation • Updated Sep 8, 2023 • 15

daedalus314/Marx-3B-V2-GPTQ

Text Generation • Updated Oct 12, 2023 • 17

TRAC-MTRY/traclm-v2-7b-instruct-GPTQ

Text Generation • Updated Dec 22, 2023

iproskurina/bloom-1b7-gptq-4bit

Text Generation • Updated Jan 21 • 12

iproskurina/bloom-3b-gptq-4bit

Text Generation • Updated Jan 21 • 18

iproskurina/bloom-560m-gptq-4bit

Text Generation • Updated Jan 21 • 17

iproskurina/bloom-1b1-gptq-4bit

Text Generation • Updated Jan 27 • 14

iproskurina/bloom-7b1-gptq-4bit

Text Generation • Updated Jan 21 • 26 • 2

iproskurina/opt-125m-gptq-4bit

Text Generation • Updated Jan 27 • 4

iproskurina/opt-350m-gptq-4bit

Text Generation • Updated Jan 27 • 5

iproskurina/opt-1.3b-gptq-4bit

Text Generation • Updated Jan 27 • 6

iproskurina/opt-2.7b-gptq-4bit

Text Generation • Updated Jan 27 • 81

iproskurina/opt-6.7b-gptq-4bit

Text Generation • Updated Jan 27 • 89

iproskurina/opt-13b-gptq-4bit

Text Generation • Updated Jan 27 • 6

iproskurina/Mistral-7B-gptq-4bit

Text Generation • Updated Jan 22 • 280

neuralmagic/zephyr-7b-beta-marlin

Text Generation • Updated Mar 6 • 8.39k • 1

neuralmagic/TinyLlama-1.1B-Chat-v1.0-marlin

Text Generation • Updated Mar 6 • 4.78k • 1

neuralmagic/OpenHermes-2.5-Mistral-7B-marlin

Text Generation • Updated Mar 6 • 384 • 2

neuralmagic/Nous-Hermes-2-Yi-34B-marlin

Text Generation • Updated Mar 6 • 5 • 5

softmax/Llama-2-70b-chat-hf-marlin

Text Generation • Updated Mar 17 • 2.74k

softmax/falcon-180B-chat-marlin

Text Generation • Updated Mar 21 • 6

smpanaro/Llama-2-7b-NuGPTQ

Text Generation • Updated Mar 27 • 10 • 1

TRAC-MTRY/traclm-v3-7b-instruct-GPTQ

Text Generation • Updated May 2

astronomer/Llama-3-8B-Instruct-GPTQ-4-Bit

Text Generation • Updated Apr 22 • 3.53k • 24

astronomer/Llama-3-8B-GPTQ-8-Bit

Text Generation • Updated Apr 22 • 36 • 2

astronomer/Llama-3-8B-GPTQ-4-Bit

Text Generation • Updated Apr 22 • 38 • 6