You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Update autoawq to >=0.2.5,<0.3.0, as it now doesn't have a dependency clash with transformers.
Update vllm to >=0.4.2,<0.5.0, to support new models (such as Phi-3).
Update torch to >=2.3.0,<3.0.0, as this is required by vllm.
Fixed
When overriding benchmark configuration parameters in Benchmarker.benchmark then
these overridden parameters are now correctly used when building datasets.
When a generative model was benchmarked on a NER task followed by another task, the
structured generation wasn't set up correctly, as we're not re-initialising the model
since v12.8.0. We now ensure that the logits processors are re-built for every
dataset.