DeepSeek Prover V1.5 RL - GGUF

Description

This repo contains GGUF format model files for DeepSeek Prover V1.5 RL.

Name	Quant method	Bits
DeepSeek-Prover-V1.5-RL-GGUF.Q4_K_M.gguf	Q4_K_M	4
DeepSeek-Prover-V1.5-RL-GGUF.Q5_K_M.gguf	Q5_K_M	5
DeepSeek-Prover-V1.5-RL-GGUF.Q6_K.gguf	Q6_K	6
DeepSeek-Prover-V1.5-RL-GGUF.Q8_0.gguf	Q8_0	8

GGUF

Model size

6.91B params

Architecture

llama

4-bit

5-bit

6-bit

8-bit

Inference API

Inference API (serverless) has been turned off for this model.

Base model

Finetuned

Finetuned

Quantized

this model