Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
13.5
TFLOPS
37
35
64
Marc Sun
marcsun13
Follow
BrigitteTousi's profile picture
echarlaix's profile picture
mehdi-elion's profile picture
87 followers
·
129 following
_marcsun
SunMarc
AI & ML interests
LLM, Quantization, Training, Inference
Articles
Fine-tuning LLMs to 1.58bit: extreme quantization made easy
1 day ago
•
93
Accelerate 1.0.0
7 days ago
•
31
Llama 3.1 - 405B, 70B & 8B with multilinguality and long context
Jul 23
•
193
quanto: a pytorch quantization toolkit
Mar 18
•
28
Overview of natively supported quantization schemes in 🤗 Transformers
Sep 12, 2023
•
10
Making LLMs lighter with AutoGPTQ and transformers
Aug 23, 2023
•
25
Organizations
models
13
Sort:Â Recently updated
marcsun13/sft_openassistant-guanaco
Text Generation
•
Updated
Jul 5
•
4
marcsun13/gemma-2-27b-it-bnb-colab
Text Generation
•
Updated
Jul 4
•
5
marcsun13/gemma-2-9b-it-GPTQ
Text Generation
•
Updated
Jul 3
•
84
•
2
marcsun13/test_push_checkpoint
Fill-Mask
•
Updated
Jun 28
•
4
marcsun13/Mixtral-8x7B-v0.1-GPTQ
Text Generation
•
Updated
Dec 11, 2023
•
9
marcsun13/Mixtral-tiny-GPTQ
Text Generation
•
Updated
Dec 11, 2023
•
10
marcsun13/Llama-2-13B-AWQ
Text Generation
•
Updated
Nov 6, 2023
•
12
marcsun13/opt-125m-awq
Text Generation
•
Updated
Oct 30, 2023
•
10
marcsun13/opt-350m-gptq-4bit
Text Generation
•
Updated
Jul 31, 2023
•
571
marcsun13/gpt2-xl-linear-sharded
Updated
Jun 30, 2023
Expand 13 models
datasets
None public yet