It works well with long system prompts.

It isn't generic in a sense that it shouldn't be used for story telling, for example, but only for reasoning and text comprehension.

This model is trained on a private dataset. The high GSM8K score is NOT because of the MetaMath dataset.

Prompt Format:

SYSTEM: <ANY SYSTEM CONTEXT>
USER: 
ASSISTANT:

Inference Examples

Inference API (serverless) is not available, repository is disabled.

Model tree for LoneStriker/Metis-0.5-8.0bpw-h8-exl2

Base model

Finetuned

this model