Checkpoint seems not be loaded

#8
by Yulong-W - opened

Dears, I am trying to calculate bleurt score and it seems that I always got the same score for the same inputs regardless of the checkpoint I loaded through specifying the parameter "checkpoint". Could you please kindly provide any suggestions? Thanks!

hello, I encounter a similar issue.
evaluate = 0.4.0
bleurt = 0.0.2

Traceback (most recent call last):
File "/data/home/tingchenfu/LLMT/./metric/metric.py", line 48, in
bleurt=huggingface_bleurt(hypothesis,reference)
File "/data/home/tingchenfu/LLMT/./metric/metric.py", line 12, in huggingface_bleurt
scores = bleurt.compute(predictions=hypothesis, references=reference,checkpoint='BLEURT-20')['scores']
File "/data/home/tingchenfu/anaconda3/envs/dode/lib/python3.9/site-packages/evaluate/module.py", line 444, in compute
output = self._compute(**inputs, **compute_kwargs)
TypeError: _compute() got an unexpected keyword argument 'checkpoint'

Use the checkpoint argument for load not compute.

Sign up or log in to comment