Skip to content

Jiwer deprecation for compute_measures #684

@Sekinal

Description

@Sekinal

jitsi/jiwer@4113e3f#diff-07c485c09e8e877349b9b23380f2e87055efaf6a8e2f7e8dafe23658a3959972

As of February 2nd of 2025 the compute_measures method from jiwer has been deprecated, as such, using evaluate's "wer" will throw an error like this:

Traceback (most recent call last):
  File "/home/user/whisper/main.py", line 101, in <module>
    metric = evaluate.load("wer")
             ^^^^^^^^^^^^^^^^^^^^
  File "/home/user/whisper/.venv/lib/python3.12/site-packages/evaluate/loading.py", line 751, in load
    evaluation_cls = import_main_class(evaluation_module.module_path)
                     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/user/whisper/.venv/lib/python3.12/site-packages/evaluate/loading.py", line 76, in import_main_class
    module = importlib.import_module(module_path)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3.12/importlib/__init__.py", line 90, in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "<frozen importlib._bootstrap>", line 1387, in _gcd_import
  File "<frozen importlib._bootstrap>", line 1360, in _find_and_load
  File "<frozen importlib._bootstrap>", line 1331, in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 935, in _load_unlocked
  File "<frozen importlib._bootstrap_external>", line 995, in exec_module
  File "<frozen importlib._bootstrap>", line 488, in _call_with_frames_removed
  File "/home/user/.cache/huggingface/modules/evaluate_modules/metrics/evaluate-metric--wer/85bee9e4216a78bb09b2d0d500f6af5c23da58f9210e661add540f5df6630fcd/wer.py", line 17, in <module>
    from jiwer import compute_measures
ImportError: cannot import name 'compute_measures' from 'jiwer' (/home/user/whisper/.venv/lib/python3.12/site-packages/jiwer/__init__.py)

Related PRs: #661, #683

In short, a quick-solution for anyone that gets the same error is to install an older version of jiwer, e.g. jiwer < 4.0.0

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions