Hello, could someone please share and example for perform batch inference with mistral_inference framework?
P.S. please include prompts with different lengths
· Sign up or log in to comment
