Unable to implement onnxruntime_genai in Android project
#9
by
davesoma
- opened
Environment
- Android Studio
- Gradle
- Target SDK: 34
- Min SDK: 28
Issue
Failed to resolve: com.microsoft.onnxruntime:onnxruntime_genai-android:latest.release
Working Configuration
implementation 'com.microsoft.onnxruntime:onnxruntime-android:latest.release'
This imports correctly.
Attempted for GenAI
implementation 'com.microsoft.onnxruntime:onnxruntime-genai:0.3.0'
This fails to resolve.
Hi, the following is what I found:
- Based on information here, version 0.3.0 does not support Android or Qwen.
- Based on information here, the main branch supports Android but
Requires build from sourceand Qwen is supported. But I cannot find build instructions for Andorid on its website. - We currently do not provide ONNX weights. You will need to export the weight on your own.
Since I'm not very familiar with these issues, I would suggest seeking advice from the ONNX Runtime GenAI team, as I don't think there is much that we can do to resolve them.
Ok, thank so much!
you have to update to higher version, once you convert don' forget to update version of lib in android app as well.