Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add F1 score, precision, and recall metrics as MultilabelSegmentation default metrics #1336

Open
wants to merge 40 commits into
base: develop
Choose a base branch
from
Open

Add F1 score, precision, and recall metrics as MultilabelSegmentation default metrics #1336

wants to merge 40 commits into from

Commits on Apr 20, 2023

  1. add f1,precision,recall metrics for multilabel task

    @FrenchKrab
    FrenchKrab committed Apr 20, 2023
    Configuration menu
    Copy the full SHA
    e4680c2 View commit details
    Browse the repository at this point in the history

  2. black formatting

    @FrenchKrab
    FrenchKrab committed Apr 20, 2023
    Configuration menu
    Copy the full SHA
    d771729 View commit details
    Browse the repository at this point in the history

  3. simplify MultilabelSegmentation's default_metric logic

    @FrenchKrab
    FrenchKrab committed Apr 20, 2023
    Configuration menu
    Copy the full SHA
    458bebe View commit details
    Browse the repository at this point in the history

  4. better shape for tensors passed to MultilabelSegmentation metrics

    @FrenchKrab
    FrenchKrab committed Apr 20, 2023
    Configuration menu
    Copy the full SHA
    cd47969 View commit details
    Browse the repository at this point in the history

  5. use macro avg for default MultilabelSegmentation metrics

    @FrenchKrab
    FrenchKrab committed Apr 20, 2023
    Configuration menu
    Copy the full SHA
    2d97b0b View commit details
    Browse the repository at this point in the history

  6. black format

    @FrenchKrab
    FrenchKrab committed Apr 20, 2023
    Configuration menu
    Copy the full SHA
    53e676d View commit details
    Browse the repository at this point in the history

  7. add support for "per class" metric for MultilabelSegmentation 

    Still support "global" metrics, BUT they have to be of a binary type.
    @FrenchKrab
    FrenchKrab committed Apr 20, 2023
    Configuration menu
    Copy the full SHA
    999252e View commit details
    Browse the repository at this point in the history

Commits on Apr 21, 2023

  1. fix logic in multilabel setup_validation_metric

    @FrenchKrab
    FrenchKrab committed Apr 21, 2023
    Configuration menu
    Copy the full SHA
    e698bb3 View commit details
    Browse the repository at this point in the history

  2. rename "_per_metric" -> "_classwise"

    @FrenchKrab
    FrenchKrab committed Apr 21, 2023
    Configuration menu
    Copy the full SHA
    b7cf6f5 View commit details
    Browse the repository at this point in the history

  3. add Loggable and LoggableHistogram classes

    @FrenchKrab
    FrenchKrab committed Apr 21, 2023
    Configuration menu
    Copy the full SHA
    a890ef6 View commit details
    Browse the repository at this point in the history

Commits on Apr 24, 2023

  1. Revert "add Loggable and LoggableHistogram classes" (oops, wrong branch) 

    This reverts commit a890ef6.
    @FrenchKrab
    FrenchKrab committed Apr 24, 2023
    Configuration menu
    Copy the full SHA
    7ac8209 View commit details
    Browse the repository at this point in the history

Commits on Apr 25, 2023

  1. fix wrong default_metric return value

    @FrenchKrab
    FrenchKrab committed Apr 25, 2023
    Configuration menu
    Copy the full SHA
    68a4d47 View commit details
    Browse the repository at this point in the history

Commits on May 2, 2023

  1. make MultilabelSegmentation global metric actually be multilabel 

    (uses ignore_index for that, which ignores all targets of that index for
computations, in pyannote's case : -1)
    @FrenchKrab
    FrenchKrab committed May 2, 2023
    Configuration menu
    Copy the full SHA
    7e06f4b View commit details
    Browse the repository at this point in the history

  2. update comments

    @FrenchKrab
    FrenchKrab committed May 2, 2023
    Configuration menu
    Copy the full SHA
    e008ad6 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'develop' into multilabel_default_metrics

    @FrenchKrab
    FrenchKrab committed May 2, 2023
    Configuration menu
    Copy the full SHA
    1c1674b View commit details
    Browse the repository at this point in the history

  4. small fix

    @FrenchKrab
    FrenchKrab committed May 2, 2023
    Configuration menu
    Copy the full SHA
    9b43f41 View commit details
    Browse the repository at this point in the history

  5. Merge branch 'multilabel_default_metrics' of github.com:FrenchKrab/py… 

    …annote-audio into multilabel_default_metrics
    @FrenchKrab
    FrenchKrab committed May 2, 2023
    Configuration menu
    Copy the full SHA
    3f0bf90 View commit details
    Browse the repository at this point in the history

Commits on May 10, 2023

  1. Merge branch 'develop' into multilabel_default_metrics

    @hbredin
    hbredin committed May 10, 2023
    Configuration menu
    Copy the full SHA
    05638c7 View commit details
    Browse the repository at this point in the history

Commits on May 11, 2023

  1. add ignore_index to default_metric_classwise

    @FrenchKrab
    FrenchKrab committed May 11, 2023
    Configuration menu
    Copy the full SHA
    5f51b50 View commit details
    Browse the repository at this point in the history

  2. Revert "add ignore_index to default_metric_classwise" 

    This reverts commit 5f51b50.
    @FrenchKrab
    FrenchKrab committed May 11, 2023
    Configuration menu
    Copy the full SHA
    3107105 View commit details
    Browse the repository at this point in the history

Commits on Jun 8, 2023

  1. fix: raise TypeError on wrong device type in Pipeline.to and Inferenc… 

    …e.to

Fixes 1397
    @chai3
    chai3 committed Jun 8, 2023
    Configuration menu
    Copy the full SHA
    0551070 View commit details
    Browse the repository at this point in the history

Commits on Jun 12, 2023

  1. feat(task): add support for multi-task models (pyannote#1374) 

    BREAKING(model): get rid of (flaky) `Model.introspection`
    @hbredin
    hbredin committed Jun 12, 2023
    Configuration menu
    Copy the full SHA
    30ddb0b View commit details
    Browse the repository at this point in the history

  2. fix(inference): fix multi-task inference

    @hbredin
    hbredin committed Jun 12, 2023
    Configuration menu
    Copy the full SHA
    4eb7190 View commit details
    Browse the repository at this point in the history

Commits on Jun 15, 2023

  1. feat: update FAQtory default answer

    @hbredin
    hbredin committed Jun 15, 2023
    Configuration menu
    Copy the full SHA
    dcdfc15 View commit details
    Browse the repository at this point in the history

Commits on Jun 22, 2023

  1. improve(test): use pyannote.database.registry (pyannote#1413)

    @hbredin
    hbredin committed Jun 22, 2023
    Configuration menu
    Copy the full SHA
    3363be6 View commit details
    Browse the repository at this point in the history

Commits on Jun 23, 2023

  1. feat(pipeline): add return_embeddings option to `SpeakerDiarization… 

    …` pipeline

Co-authored-by: Hervé BREDIN <hbredin@users.noreply.github.com>
    @flyingleafe @hbredin
    flyingleafe and hbredin committed Jun 23, 2023
    Configuration menu
    Copy the full SHA
    017c910 View commit details
    Browse the repository at this point in the history

Commits on Jun 27, 2023

  1. fix: fix missed speech at the very beginning/end

    @hbredin
    hbredin committed Jun 27, 2023
    Configuration menu
    Copy the full SHA
    cf0e3b3 View commit details
    Browse the repository at this point in the history

Commits on Jun 28, 2023

  1. doc: add note to self regarding cluster reassignment (pyannote#1419)

    @hbredin
    hbredin committed Jun 28, 2023
    Configuration menu
    Copy the full SHA
    f393546 View commit details
    Browse the repository at this point in the history

Commits on Jul 9, 2023

  1. fix(doc): fix typo in diarization docstring

    @DiaaAj
    DiaaAj committed Jul 9, 2023
    Configuration menu
    Copy the full SHA
    35be745 View commit details
    Browse the repository at this point in the history

Commits on Jul 16, 2023

  1. ci: update suggest.md (pyannote#1435)

    @hbredin
    hbredin committed Jul 16, 2023
    Configuration menu
    Copy the full SHA
    bc0920f View commit details
    Browse the repository at this point in the history

Commits on Aug 2, 2023

  1. feat: add support for WeSpeaker embeddings (pyannote#1444)

    @hbredin
    hbredin committed Aug 2, 2023
    Configuration menu
    Copy the full SHA
    7194929 View commit details
    Browse the repository at this point in the history

Commits on Aug 7, 2023

  1. fix: fix security issue in FAQtory bot

    @aashish-19
    aashish-19 committed Aug 7, 2023
    Configuration menu
    Copy the full SHA
    37b39b0 View commit details
    Browse the repository at this point in the history

Commits on Aug 30, 2023

  1. Update README.md

    @hbredin
    hbredin committed Aug 30, 2023
    Configuration menu
    Copy the full SHA
    5a7df38 View commit details
    Browse the repository at this point in the history

  2. Update README.md

    @hbredin
    hbredin committed Aug 30, 2023
    Configuration menu
    Copy the full SHA
    2af703d View commit details
    Browse the repository at this point in the history

Commits on Sep 15, 2023

  1. fix(task): fix MultiLabelSegmentation.val_monitor

    @FrenchKrab
    FrenchKrab committed Sep 15, 2023
    Configuration menu
    Copy the full SHA
    b660b1e View commit details
    Browse the repository at this point in the history

  2. Merge branch 'develop' into multilabel_default_metrics

    @hbredin
    hbredin committed Sep 15, 2023
    Configuration menu
    Copy the full SHA
    11e8e6c View commit details
    Browse the repository at this point in the history

Commits on Sep 16, 2023

  1. fix(core): fix Model.example_output for embedding models

    @hbredin
    hbredin committed Sep 16, 2023
    Configuration menu
    Copy the full SHA
    9df6944 View commit details
    Browse the repository at this point in the history

Commits on Sep 18, 2023

  1. update multilabel classwise metrics naming

    @FrenchKrab
    FrenchKrab committed Sep 18, 2023
    Configuration menu
    Copy the full SHA
    4be15a4 View commit details
    Browse the repository at this point in the history

  2. update multilabel default metric + docstring + black formatting

    @FrenchKrab
    FrenchKrab committed Sep 18, 2023
    Configuration menu
    Copy the full SHA
    9b9c966 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'develop' into multilabel_default_metrics

    @hbredin
    hbredin committed Sep 18, 2023
    Configuration menu
    Copy the full SHA
    10a51f9 View commit details
    Browse the repository at this point in the history