Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Speech marks duration possible issue when I use break between two sentences #2318

Open
coder-kl opened this issue Mar 27, 2024 · 9 comments
Open
Assignees

Comments

@coder-kl
Copy link

coder-kl commented Mar 27, 2024

I am experiencing an interesting issue.

My text highlighting feature with speech mark created using word boundary method work perfectly for one or more sentences. However, when I add between two sentences to increase pause between two sentences, the same logic work correctly for the first sentence correctly, however it throws off audio and text highlighting.

Has anyone encountered such issue?

This tag generates correct speech marks for text highlighting:

<speak xmlns="http://www.w3.org/2001/10/synthesis" xmlns:mstts="http://www.w3.org/2001/mstts" xmlns:emo="http://www.w3.org/2009/10/emotionml" version="1.0" xml:lang="en-US"><voice name="hi-IN-SwaraNeural"><prosody rate='-30%'>My name is Ramesh. My name is Ramesh.</prosody><mstts:silence type="Tailing" value="0"/></voice></speak>

This tag produce correct speech marks for only the first sentence, and speech marks seems off for the second sentence.
<speak xmlns="http://www.w3.org/2001/10/synthesis" xmlns:mstts="http://www.w3.org/2001/mstts" xmlns:emo="http://www.w3.org/2009/10/emotionml" version="1.0" xml:lang="en-US"><voice name="hi-IN-SwaraNeural"><prosody rate='-30%'>My name is Ramesh.<break time='1s'/>My name is Ramesh.<break time='1s'/></prosody><mstts:silence type="Tailing" value="0"/></voice></speak>

Any feedback would be helpful.

@yulin-li
Copy link
Contributor

@Kerry-LinZhang could you help to triage?

@Kerry-LinZhang
Copy link

Hi @coder-kl thanks and well received for the feedback, let me track it and keep you updated for the progress.

@Kerry-LinZhang
Copy link

Under investigation for it

@Kerry-LinZhang
Copy link

Investigation ongoing

Copy link

github-actions bot commented May 9, 2024

This item has been open without activity for 19 days. Provide a comment on status and remove "update needed" label.

@github-actions github-actions bot added the update needed For items that are in progress but have not been updated label May 9, 2024
@coder-kl
Copy link
Author

coder-kl commented May 9, 2024

@Kerry-LinZhang - Another behavior I have noticed recently with the latest SDK is that the speech marks do not generate sometimes. Alternatively, sometimes it returns a partial list. However, if we run the same function multiple times, it eventually returns all speech marks correctly. Do you aware of such issue? It is a random behavior, so I cannot pint point exact issue. Just sharing it if anyone has noticed similar issue.

@github-actions github-actions bot removed the update needed For items that are in progress but have not been updated label May 10, 2024
@Kerry-LinZhang
Copy link

Hi @coder-kl thanks for your feedback, we are under investigation for it. I will continue tracking this feedback.

@coder-kl
Copy link
Author

Thank you @Kerry-LinZhang

@coder-kl coder-kl reopened this May 15, 2024
@coder-kl
Copy link
Author

I accidentally clicked on the wrong button.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

4 participants