FrankC0st1e pi314ever-intel commited on
Commit
6fcf8b4
1 Parent(s): 75f9f10

Add `model_type` to config (#17)

Browse files

- Add `model_type` to config (5b3a3755c38b0b34f7fc515496abfded12f24103)


Co-authored-by: Daniel Huang <[email protected]>

Files changed (1) hide show
  1. config.json +1 -0
config.json CHANGED
@@ -18,6 +18,7 @@
18
  "num_hidden_layers": 62,
19
  "intermediate_size": 6400,
20
  "max_position_embeddings": 32768,
 
21
  "num_attention_heads": 40,
22
  "num_key_value_heads": 40,
23
  "qk_nope_head_dim": 64,
 
18
  "num_hidden_layers": 62,
19
  "intermediate_size": 6400,
20
  "max_position_embeddings": 32768,
21
+ "model_type": "minicpm3",
22
  "num_attention_heads": 40,
23
  "num_key_value_heads": 40,
24
  "qk_nope_head_dim": 64,