Same speaker in multiple files

[ClayShoaf]

Is there any way to identify the same speaker in a different file? How about adding a label?

For example, let's say I have James who is speaking in audio1.wav and audio2.wav. Pyannote identifies him as SPEAKER_07 in audio1.wav. Is there any way to force pyannote to recocnize him as SPEAKER_07 when I run it on audio2.wav?

[hbredin]

Not out of the box, no.

One straightforward solution would be to concatenate audio1.wav and audio2.wav into a longer audio1+2.wav file -- but that won't scale well with more audio files.

A more involved solution would be to

• run diarization on each file separately
• extract one speaker embedding for each speaker in each file
• do some kind of clustering on top of those embeddings to match speakers across files

[ClayShoaf]

How would you extract a speaker embedding?

[PhantomSpike]

Hey,

I am having the same issue.

@ClayShoaf were you able to find a solution? Did anything work for you?

Do you want to maybe have a quick chat about this on DM or something?

[ClayShoaf]

I was not able to figure it out and I'm working on other stuff now. Sorry

[bghorvath]

Hey,

I am having the same issue.

@ClayShoaf were you able to find a solution? Did anything work for you?

Do you want to maybe have a quick chat about this on DM or something?

You can extract the embeddings using this module: https://huggingface.co/pyannote/embedding

[SrinivasKalagotla]

Just take a 10 seconds clip of James and add it to the audio2 file. Now perform SD on the file and you will get James as Speaker 0.

[ClayShoaf]

This would probably be the easiest solution for my purposes, for now, but it's not exaclty elegant, nor is it a great solution for working with a lot of files.