Edit model card
YAML Metadata Warning: empty or missing yaml metadata in repo card (https://huggingface.co/docs/hub/model-cards#model-card-metadata)

base model : upstage/SOLAR-10.7B-v1.0

base vocab : yanolja/KoSOLAR-10.7B-v0.1

Introduction

I didn't train it enough.

This model is not instruction model.

base model + vocab expand and then, Only finetune LMHead and Embedding Layer.

Instruction Test

Yes vocab expand

<s> ### ์งˆ๋ฌธ: ๊ฑด๊ฐ•ํ•˜๊ฒŒ ์‚ด๊ธฐ ์œ„ํ•œ ์„ธ ๊ฐ€์ง€ ๋ฐฉ๋ฒ•์€?

### ๋‹ต๋ณ€: ์•ˆ๋…•ํ•˜์„ธ์š”, ๊ฑด๊ฐ•ํ•˜๊ฒŒ ์‚ด๊ธฐ ์œ„ํ•œ ์„ธ ๊ฐ€์ง€ ๋ฐฉ๋ฒ•์€ ์‚ฌ๊ณ , ์˜์š•, ์šด๋™์ž…๋‹ˆ๋‹ค.
๋จผ์ € ์‚ฌ๊ณ ๋Š” ์ค‘์š”ํ•œ ๋ถ€๋ถ„์ž…๋‹ˆ๋‹ค.
๊ฑด๊ฐ•ํ•œ ์‚ฌ๊ณ ๋Š” ๋ฌผ๊ฑด๊ณผ ์‚ฌ๋žŒ๋“ค์ด ์šฐ๋ฆฌ์—๊ฒŒ ํ•„์š”ํ•œ ์ด๋ฅผ ์‚ฌ๋กœ์žก์€ ํ–‰๋™์„ ํ•˜๊ฒŒ ํ•ฉ๋‹ˆ๋‹ค.
์šฐ๋ฆฌ์ด์•ผ๋ง๋‹ค์— ๋Œ€ํ•œ ์‚ฌ๊ณ ๋ฅผ ์ž˜๋ชปํ•˜๋ฉด ๊ฑด๊ฐ•ํ•œ ์ƒํ™œ์„ ํ•˜๋Š” ๋ฐ ์ข‹์€ ๊ฒฐ๊ณผ๋ฅผ ์–ป์„ ์ˆ˜ ์—†์Šต๋‹ˆ๋‹ค.
๊ทธ๋ž˜์„œ ๊ฑด๊ฐ•์— ๋Œ€ํ•œ ์‚ฌ๊ณ ๊ฐ€ ์ค‘์š”ํ•ฉ๋‹ˆ๋‹ค.
๋˜ํ•œ ์šฐ๋ฆฌ๋Š” ๊ฑด๊ฐ•ํ•œ ๋จน์Œ์ด ์ค‘์š”ํ•ฉ๋‹ˆ๋‹ค.
๊ฑด๊ฐ•ํ•œ ๋จน์Œ์„ ๋งŽ์ด ์„ญ์ทจํ•˜๋Š” ๊ฒƒ์œผ๋กœ ๊ฑด๊ฐ•ํ•œ ์‚ฌ๋žŒ์„ ๋งŒ๋“ญ๋‹ˆ๋‹ค.
๊ฑด๊ฐ•ํ•œ ์ƒํ™œ์„ ํ•˜๋ ค๋ฉด ๊ฑด๊ฐ•ํ•œ ๋จน์ž„์„ 

No expand

<s> ### ์งˆ๋ฌธ: ๊ฑด๊ฐ•ํ•˜๊ฒŒ ์‚ด๊ธฐ ์œ„ํ•œ ์„ธ ๊ฐ€์ง€ ๋ฐฉ๋ฒ•์€?

### ๋‹ต๋ณ€: ์ผ์ƒ์ƒํ™œ์— ๋”ฐ๋ฅผ๊ฒŒ๋กœ ์„ญ์ทจํ•˜๋Š” ์„ธ ์‚ฌ์›์— ๋Œ€ํ•œ ๋งต์นก์ด ์žˆ์Šต๋‹ˆ๋‹ค.
์‚ฌ์›์— ๋”ฐ๋ฅด๋ฉด, ์„ธ ๊ฐ€์ง€ ๊น”๋ ˆ๋ผ, ๊ท ์†Œ, ํด์†Œ๋ฅผ ์ถฉ๋ถ„ํžˆ ์„ญ์ทจํ•˜์—ฌ ์ฒด๊ฒฉ์„ ๋จน๊ฑฐ๋‚˜, ๊ท ์†Œ๋ฅผ ์„ญ์ทจํ•˜์—ฌ ์‹œ๋ ฅ์ด ์ข‹์•„์ ธ์š”.
๊ท ์†Œ๋ฅผ ์„ญ์ทจํ•˜์—ฌ๋„ ํดํŒด์ด ์ƒ๊ธฐ๋ฉด ๋ณ‘์— ์ทจ์œ ๋˜๋Š” ์ด์œ ๋Š” ํดํŒด์ด ๋งŽ์ด ์ถฉ์ง„ํ•˜์—ฌ ๊ท ์†Œ์˜ ํšจ๋Šฅ์„ ํ–‡์ณ์ค€๋‹ค๋Š” ๊ฑฐ์˜ˆ์š”.
๊ทธ๋Ÿฌ๋‹ˆ ๋จผ์ € ์ฒด์งˆ์— ๋”ฐ๋ฅธ ์‹๋‹จ์„ ์งœ์„œ ๊ท ์†Œ๋ฅผ ์„ญ์ทจํ•˜๋Š” ๊ฒƒ์ด ์ข‹์œผ๋ฉฐ, ๏ฟฝ๏ฟฝ๏ฟฝ๏ฟฝ๏ฟฝ
Downloads last month
6
Safetensors
Model size
10.9B params
Tensor type
F32
ยท
Inference Examples
Inference API (serverless) is not available, repository is disabled.

Collection including dev7halo/KoSOLAR-10.7B-v0.1