importlib.metadata.PackageNotFoundError: No package metadata was found for auto-gptq

#1
by Darrenzengyf - opened

When we loaded the model, we encountered this problem. I would like to ask if anyone has encountered the same problem.

pip install auto-gptq

This comment has been hidden

what python version required to install auto-gptq?

Qwen org

what python version required to install auto-gptq?

you should probably ask auto-gptq's maintainers for this: https://github.com/AutoGPTQ/AutoGPTQ

but we found pip install auto-gptq works with Python 3.11 and torch 2.2.1+cu121.

on PyPI, there are precompiled wheels for cp38 to cp311.

jklj077 changed discussion status to closed

Sign up or log in to comment