Tokenizer files

#1
by vaclavkosar - opened

Hello, this looks great. But are the tokenizer files missing?
See for example here: https://huggingface.co/ISTA-DASLab/Phi-3-medium-4k-instruct-AQLM-PV-1Bit-1x16-hf/tree/main

IST Austria Distributed Algorithms and Systems Lab org

Thank you for noticing! I'll look into it

IST Austria Distributed Algorithms and Systems Lab org

Just updated the repo. Can you, please, confirm the problem is fixed?

IST Austria Distributed Algorithms and Systems Lab org

It works!

By the way. There was an update from Microsoft of Phi-3-mini model and about a month ago. The model has the same name but the files changed and perf is better.

Which version is this one fine-tuned from?

Sign up or log in to comment