Skip to content

v12.10.0

Compare
Choose a tag to compare
@saattrupdan saattrupdan released this 08 May 11:38
· 36 commits to main since this release
c1932e6

Changed

  • Update autoawq to >=0.2.5,<0.3.0, as it now doesn't have a dependency clash with
    transformers.
  • Update vllm to >=0.4.2,<0.5.0, to support new models (such as Phi-3).
  • Update torch to >=2.3.0,<3.0.0, as this is required by vllm.

Fixed

  • When overriding benchmark configuration parameters in Benchmarker.benchmark then
    these overridden parameters are now correctly used when building datasets.
  • When a generative model was benchmarked on a NER task followed by another task, the
    structured generation wasn't set up correctly, as we're not re-initialising the model
    since v12.8.0. We now ensure that the logits processors are re-built for every
    dataset.