Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
Edit Models filters
Tasks
Libraries
Datasets
Languages
Licenses
Other
1
Inference status
Reset Inference status
Warm
Cold
Frozen
Misc
Reset Misc
arxiv:
2210.17323
text-generation-inference
AutoTrain Compatible
Inference Endpoints
4-bit precision
custom_code
Eval Results
8-bit precision
Carbon Emissions
Misc with no match
Merge
text-embeddings-inference
Mixture of Experts
Apply filters
Models
100
Full-text search
Edit filters
Sort: Trending
Active filters:
2210.17323
Clear all
LegendNNT/vllm_ui_new
Updated
Aug 16
neuralmagic/SmolLM-1.7B-Instruct-quantized.w8a16
Text Generation
•
Updated
28 days ago
•
18
neuralmagic/gemma-2-2b-it-quantized.w8a8
Text Generation
•
Updated
Aug 16
•
23
neuralmagic/SmolLM-360M-Instruct-quantized.w8a8
Text Generation
•
Updated
27 days ago
•
12
neuralmagic/SmolLM-135M-Instruct-quantized.w8a8
Text Generation
•
Updated
27 days ago
•
19
nm-testing/SmolLM-135M-Instruct-quantized.w4a16
Text Generation
•
Updated
27 days ago
•
5
nm-testing/SmolLM-1.7B-Instruct-quantized.w4a16
Text Generation
•
Updated
27 days ago
•
5
neuralmagic/SmolLM-1.7B-Instruct-quantized.w8a8
Text Generation
•
Updated
27 days ago
•
18
zzzmahesh/Meta-Llama-3-8B-Instruct-quantized.w8a8
Text Generation
•
Updated
12 days ago
•
33
zzzmahesh/Meta-Llama-3-8B-Instruct-quantized.w4a4
Text Generation
•
Updated
17 days ago
•
47
Previous
1
2
3
4
Next