Hugging Face's logo

mesolitica
/
Qwen2-0.5B-8192-fpf

Text Generation
Transformers
Safetensors
Malay
qwen2
conversational
text-generation-inference
Inference Endpoints
Model card Files Community
Edit model card

Full Parameter Finetuning 0.5B 8192 context length Qwen 2 on Malaysian text 12.86B tokens

Continue pretraining https://huggingface.co/Qwen/Qwen2-0.5B on 12.86B tokens Malaysian dataset using 8192 context length.

WanDB at https://wandb.ai/huseinzol05/Qwen2-0.5B-fpf/workspace?nw=nwuserhuseinzol05

Downloads last month
5
Safetensors
Model size
494M params
Tensor type
BF16
·
Inference Examples
Text Generation
Inference API (serverless) is not available, repository is disabled.

Collection including mesolitica/Qwen2-0.5B-8192-fpf