Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[joss] Need locations of benchmarking data! #175

Open
3 of 4 tasks
sneakers-the-rat opened this issue Oct 4, 2023 · 2 comments
Open
3 of 4 tasks

[joss] Need locations of benchmarking data! #175

sneakers-the-rat opened this issue Oct 4, 2023 · 2 comments
Labels
documentation Improvements or additions to documentation
Milestone
Version 0.10

Comments

@sneakers-the-rat
Copy link
Contributor

sneakers-the-rat commented Oct 4, 2023 •
edited by juanmc2005

Trying to find the data to run the benchmarks, and I can't find all the source data:

  • VoxConverse - found it!
  • AMI - found the download page https://groups.inf.ed.ac.uk/ami/download/ but I can't tell what files I need for the benchmark
  • *DIHARD III - can't find download
  • *DIHARD II - can't find download

this should all be in the docs!

part of openjournals/joss-reviews#5266
@sneakers-the-rat sneakers-the-rat mentioned this issue Oct 4, 2023
Open
@sneakers-the-rat
Copy link
Contributor Author

Forgot to say - I also couldnt tell easily from the text of the repo paper which samples I should use from voxconverse, might be nice to have a link to a source and a little script for loading them - making reproducing like 1 step if you have a spare half hour or so

@juanmc2005 juanmc2005 added the documentation Improvements or additions to documentation label Oct 6, 2023
@juanmc2005
Copy link
Owner

@sneakers-the-rat good idea! However, the two DIHARD datasets are private. One has to ask for permission to use them.
For AMI we used Mix-Headset (downloadable here)

@juanmc2005 juanmc2005 added this to the Version 0.9 milestone Oct 11, 2023
@juanmc2005 juanmc2005 mentioned this issue Nov 14, 2023
Open
9 tasks
@juanmc2005 juanmc2005 modified the milestones: Version 0.9, Version 0.10 Nov 14, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
documentation Improvements or additions to documentation
Projects
None yet
Milestone
Version 0.10
Development

No branches or pull requests
2 participants
@juanmc2005 @sneakers-the-rat