Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

enh: better voice interactions #2241

Open
2 tasks
tjbck opened this issue May 13, 2024 · 1 comment
Open
2 tasks

enh: better voice interactions #2241

tjbck opened this issue May 13, 2024 · 1 comment
Assignees
Labels
core core feature enhancement New feature or request
Milestone

Comments

@tjbck
Copy link
Contributor

tjbck commented May 13, 2024

  • voice message recording like imessage
  • siri-esque real time voice interaction
@tjbck tjbck self-assigned this May 19, 2024
@tjbck tjbck changed the title enhancement: better voice interactions enh: better voice interactions May 19, 2024
@tjbck tjbck added this to the v1.0 milestone May 19, 2024
@tjbck tjbck added enhancement New feature or request core core feature labels May 19, 2024
@tjbck tjbck modified the milestones: v1.0, v0.2.0 May 26, 2024
@IIPedro
Copy link

IIPedro commented May 31, 2024

Hello! I'm unaware if work has been done about this topic yet, but it would be interesting to see better voice interactions as part of pipelines. Of course, it should be the front-end's job to provide an easy to use and comfortable interface, but I believe both siri-esque interaction and voice calls can be tackled in one go with a new pipeline function. Just like there's a pipe def in pipelines, it would be very useful to have a voice def that takes an audio buffer as input in a previously determined rate and returns another audio buffer, which would be the assistant's voice in the call. That would make voice interactions as versatile as current chat pipelines and would allow for the support of various libraries and APIs in a standardized manner. Thanks!

@tjbck tjbck modified the milestones: v0.2.0, v0.3.0 May 31, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
core core feature enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants