You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Both com/google/mediapipe/tasks/genai/llminference/LlmInference#generateResponse and com/google/mediapipe/tasks/genai/llminference/LlmInference#generateResponseAsync methods freeze the Main Thread if the prompt provided is very long (1000 Tokens).
Wrapping the call in a async thread doesn't seem to work:
Both
com/google/mediapipe/tasks/genai/llminference/LlmInference#generateResponse
andcom/google/mediapipe/tasks/genai/llminference/LlmInference#generateResponseAsync
methods freeze the Main Thread if the prompt provided is very long (1000 Tokens).Wrapping the call in a async thread doesn't seem to work:
The text was updated successfully, but these errors were encountered: