shi3z/mlx-Borea-Phi-3.5-mini-Instruct-Jp-4bit

shi3z/Borea-Phi-3.5-mini-Instruct-Jp

The Model shi3z/Borea-Phi-3.5-mini-Instruct-Jp was converted to MLX format from HODACHI/Borea-Phi-3.5-mini-Instruct-Jp using mlx-lm version 0.17.0.

Use with mlx

pip install mlx-lm

from mlx_lm import load, generate

model, tokenizer = load("shi3z/Borea-Phi-3.5-mini-Instruct-Jp")
response = generate(model, tokenizer, prompt="hello", verbose=True)