We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Working well in Xcode simulator but getting following error for Device:
Failed to initialize LlmInference session: ; RET_CHECK failure (external/odml/odml/infra/genai/inference/ml_drift/llm/llm_metal_runner.mm:87) llm_runner->model_->Init(llm_config, num_output_heads, std::move(tensor_loader), create_info, sampler_params, &llm_runner->metal_device_) returned INTERNAL: ; RET_CHECK failure (external/odml/odml/infra/genai/inference/utils/llm_utils/memory_mapped_file_posix.cc:86) (data)!=(((void *)-1))Failed to map, error: Cannot allocate memory
Device is having sufficient memory and the model size is 1.35 GB.
The text was updated successfully, but these errors were encountered:
No branches or pull requests
Working well in Xcode simulator but getting following error for Device:
Failed to initialize LlmInference session: ; RET_CHECK failure (external/odml/odml/infra/genai/inference/ml_drift/llm/llm_metal_runner.mm:87) llm_runner->model_->Init(llm_config, num_output_heads, std::move(tensor_loader), create_info, sampler_params, &llm_runner->metal_device_) returned INTERNAL: ; RET_CHECK failure (external/odml/odml/infra/genai/inference/utils/llm_utils/memory_mapped_file_posix.cc:86) (data)!=(((void *)-1))Failed to map, error: Cannot allocate memory
Device is having sufficient memory and the model size is 1.35 GB.
The text was updated successfully, but these errors were encountered: