-
-
Notifications
You must be signed in to change notification settings - Fork 705
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add F1 score, precision, and recall metrics as MultilabelSegmentation default metrics #1336
Open
FrenchKrab
wants to merge
40
commits into
pyannote:develop
Choose a base branch
from
FrenchKrab:multilabel_default_metrics
base: develop
Could not load branches
Branch not found: {{ refName }}
Could not load tags
Nothing to show
Are you sure you want to change the base?
Some commits from the old base branch may be removed from the timeline,
and old review comments may become outdated.
Open
Changes from 6 commits
Commits
Show all changes
40 commits
Select commit
Hold shift + click to select a range
e4680c2
add f1,precision,recall metrics for multilabel task
FrenchKrab d771729
black formatting
FrenchKrab 458bebe
simplify MultilabelSegmentation's default_metric logic
FrenchKrab cd47969
better shape for tensors passed to MultilabelSegmentation metrics
FrenchKrab 2d97b0b
use macro avg for default MultilabelSegmentation metrics
FrenchKrab 53e676d
black format
FrenchKrab 999252e
add support for "per class" metric for MultilabelSegmentation
FrenchKrab e698bb3
fix logic in multilabel setup_validation_metric
FrenchKrab b7cf6f5
rename "_per_metric" -> "_classwise"
FrenchKrab a890ef6
add Loggable and LoggableHistogram classes
FrenchKrab 7ac8209
Revert "add Loggable and LoggableHistogram classes" (oops, wrong branch)
FrenchKrab 68a4d47
fix wrong default_metric return value
FrenchKrab 7e06f4b
make MultilabelSegmentation global metric actually be multilabel
FrenchKrab e008ad6
update comments
FrenchKrab 1c1674b
Merge branch 'develop' into multilabel_default_metrics
FrenchKrab 9b43f41
small fix
FrenchKrab 3f0bf90
Merge branch 'multilabel_default_metrics' of github.com:FrenchKrab/py…
FrenchKrab 05638c7
Merge branch 'develop' into multilabel_default_metrics
hbredin 5f51b50
add ignore_index to default_metric_classwise
FrenchKrab 3107105
Revert "add ignore_index to default_metric_classwise"
FrenchKrab 0551070
fix: raise TypeError on wrong device type in Pipeline.to and Inferenc…
chai3 30ddb0b
feat(task): add support for multi-task models (#1374)
hbredin 4eb7190
fix(inference): fix multi-task inference
hbredin dcdfc15
feat: update FAQtory default answer
hbredin 3363be6
improve(test): use pyannote.database.registry (#1413)
hbredin 017c910
feat(pipeline): add `return_embeddings` option to `SpeakerDiarization…
flyingleafe cf0e3b3
fix: fix missed speech at the very beginning/end
hbredin f393546
doc: add note to self regarding cluster reassignment (#1419)
hbredin 35be745
fix(doc): fix typo in diarization docstring
DiaaAj bc0920f
ci: update suggest.md (#1435)
hbredin 7194929
feat: add support for WeSpeaker embeddings (#1444)
hbredin 37b39b0
fix: fix security issue in FAQtory bot
aashish-19 5a7df38
Update README.md
hbredin 2af703d
Update README.md
hbredin b660b1e
fix(task): fix MultiLabelSegmentation.val_monitor
FrenchKrab 11e8e6c
Merge branch 'develop' into multilabel_default_metrics
hbredin 9df6944
fix(core): fix Model.example_output for embedding models
hbredin 4be15a4
update multilabel classwise metrics naming
FrenchKrab 9b9c966
update multilabel default metric + docstring + black formatting
FrenchKrab 10a51f9
Merge branch 'develop' into multilabel_default_metrics
hbredin File filter
Filter by extension
Conversations
Failed to load comments.
Jump to
Jump to file
Failed to load files.
Diff view
Diff view
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Oops, something went wrong.
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
This will break as soon as
mask
contains at least one-1
because the overall size ofy_pred
will then be smaller thanshape
.