WasmEdge-plugin-wasi_nn-ggml-0.13.5-darwin_arm64.tar.gz is built outside the CI?

[AkihiroSuda]

https://github.com/WasmEdge/WasmEdge/releases/download/0.13.5/WasmEdge-plugin-wasi_nn-ggml-0.13.5-darwin_arm64.tar.gz (sha256:a22b8a19fe43243dc7f4eb716f45e4ae95bf9375f2e0984df7720c007f9d14b5) doesn't seem built in the CI:

WasmEdge/.github/workflows/release.yml

Lines 541 to 658 in c62e0bb

	build_and_upload_plugin_macos:
	strategy:
	matrix:
	include:
	- name: Plugins_MacOS_12
	system: MacOS 12
	host_runner: macos-12
	darwin_version: darwin_21
	arch: x86_64
	- name: Plugins_MacOS_arm64
	system: MacOS 13 (arm64)
	host_runner: mac-arm64
	darwin_version: darwin_22
	arch: arm64
	name: Build and upload plugins on ${{ matrix.system }}
	runs-on: ${{ matrix.host_runner }}
	env:
	output_prefix: build/plugins
	build_options: -DWASMEDGE_PLUGIN_WASI_CRYPTO=ON -DWASMEDGE_PLUGIN_WASI_LOGGING=ON -DWASMEDGE_PLUGIN_RUSTLS=ON -DWASMEDGE_PLUGIN_TENSORFLOW=ON -DWASMEDGE_PLUGIN_TENSORFLOWLITE=ON -DWASMEDGE_PLUGIN_IMAGE=ON -DWASMEDGE_PLUGIN_OPENCVMINI=ON -DWASMEDGE_PLUGIN_ZLIB=ON
	tar_names: wasi_crypto wasi_logging wasmedge_rustls wasmedge_tensorflow wasmedge_tensorflowlite wasmedge_image wasmedge_opencvmini wasmedge_zlib
	output_bins: libwasmedgePluginWasiCrypto.dylib libwasmedgePluginWasiLogging.dylib libwasmedge_rustls.dylib libwasmedgePluginWasmEdgeTensorflow.dylib libwasmedgePluginWasmEdgeTensorflowLite.dylib libwasmedgePluginWasmEdgeImage.dylib libwasmedgePluginWasmEdgeOpenCVMini.dylib libwasmedgePluginWasmEdgeZlib.dylib
	needs: create_release
	steps:
	- name: Checkout code
	uses: actions/checkout@v3
	with:
	fetch-depth: 0
	- name: Grant the safe directory for git
	run: |
	git config --global --add safe.directory $(pwd)
	- name: Install dependencies
	run: |
	eval $(/opt/homebrew/bin/brew shellenv)
	brew install llvm@16 ninja cmake openssl wabt opencv rust gh
	- name: Build plugins
	shell: bash
	run: |
	eval $(/opt/homebrew/bin/brew shellenv)
	outbin_array=(${output_bins})
	export LLVM_DIR="$(brew --prefix)/opt/llvm@16/lib/cmake"
	export CC=clang
	export CXX=clang++
	cmake -Bbuild -GNinja -DCMAKE_BUILD_TYPE=Release -DWASMEDGE_BUILD_AOT_RUNTIME=OFF -DWASMEDGE_BUILD_TOOLS=OFF -DOPENSSL_ROOT_DIR=$(brew --prefix)/opt/openssl ${build_options}
	for (( i=0; i<${#outbin_array[@]}; i++ ));
	do
	echo "Building ${outbin_array[$i]} :"
	outtarget=${outbin_array[$i]}
	outtarget=${outtarget%.*}
	outtarget=${outtarget#lib}
	cmake --build build --target ${outtarget}
	done
	- name: Prepare the WasmEdge plugins tar.gz package
	shell: bash
	run: |
	plugin_array=(${tar_names})
	outbin_array=(${output_bins})
	for (( i=0; i<${#plugin_array[@]}; i++ ));
	do
	echo "Copying ${plugin_array[$i]} :"
	cp ${output_prefix}/${plugin_array[$i]}/${outbin_array[$i]} ${outbin_array[$i]}
	tar -zcvf plugin_${plugin_array[$i]}.tar.gz ${outbin_array[$i]}
	done
	- name: Upload wasi_crypto plugin tar.gz package
	env:
	GITHUB_TOKEN: ${{ secrets.GITHUB_TOKEN }}
	run: |
	eval $(/opt/homebrew/bin/brew shellenv)
	mv plugin_wasi_crypto.tar.gz WasmEdge-plugin-wasi_crypto-${{ needs.create_release.outputs.version }}-darwin_${{ matrix.arch }}.tar.gz
	gh release upload ${{ needs.create_release.outputs.version }} WasmEdge-plugin-wasi_crypto-${{ needs.create_release.outputs.version }}-darwin_${{ matrix.arch }}.tar.gz --clobber
	- name: Upload wasi_logging plugin tar.gz package
	env:
	GITHUB_TOKEN: ${{ secrets.GITHUB_TOKEN }}
	run: |
	eval $(/opt/homebrew/bin/brew shellenv)
	mv plugin_wasi_logging.tar.gz WasmEdge-plugin-wasi_logging-${{ needs.create_release.outputs.version }}-darwin_${{ matrix.arch }}.tar.gz
	gh release upload ${{ needs.create_release.outputs.version }} WasmEdge-plugin-wasi_logging-${{ needs.create_release.outputs.version }}-darwin_${{ matrix.arch }}.tar.gz --clobber
	- name: Upload wasmedge_rustls plugin tar.gz package
	env:
	GITHUB_TOKEN: ${{ secrets.GITHUB_TOKEN }}
	run: |
	eval $(/opt/homebrew/bin/brew shellenv)
	mv plugin_wasmedge_rustls.tar.gz WasmEdge-plugin-wasmedge_rustls-${{ needs.create_release.outputs.version }}-darwin_${{ matrix.arch }}.tar.gz
	gh release upload ${{ needs.create_release.outputs.version }} WasmEdge-plugin-wasmedge_rustls-${{ needs.create_release.outputs.version }}-darwin_${{ matrix.arch }}.tar.gz --clobber
	- name: Upload wasmedge_tensorflow plugin tar.gz package
	env:
	GITHUB_TOKEN: ${{ secrets.GITHUB_TOKEN }}
	run: |
	eval $(/opt/homebrew/bin/brew shellenv)
	mv plugin_wasmedge_tensorflow.tar.gz WasmEdge-plugin-wasmedge_tensorflow-${{ needs.create_release.outputs.version }}-darwin_${{ matrix.arch }}.tar.gz
	gh release upload ${{ needs.create_release.outputs.version }} WasmEdge-plugin-wasmedge_tensorflow-${{ needs.create_release.outputs.version }}-darwin_${{ matrix.arch }}.tar.gz --clobber
	- name: Upload wasmedge_tensorflowlite plugin tar.gz package
	env:
	GITHUB_TOKEN: ${{ secrets.GITHUB_TOKEN }}
	run: |
	eval $(/opt/homebrew/bin/brew shellenv)
	mv plugin_wasmedge_tensorflowlite.tar.gz WasmEdge-plugin-wasmedge_tensorflowlite-${{ needs.create_release.outputs.version }}-darwin_${{ matrix.arch }}.tar.gz
	gh release upload ${{ needs.create_release.outputs.version }} WasmEdge-plugin-wasmedge_tensorflowlite-${{ needs.create_release.outputs.version }}-darwin_${{ matrix.arch }}.tar.gz --clobber
	- name: Upload wasmedge_image plugin tar.gz package
	env:
	GITHUB_TOKEN: ${{ secrets.GITHUB_TOKEN }}
	run: |
	eval $(/opt/homebrew/bin/brew shellenv)
	mv plugin_wasmedge_image.tar.gz WasmEdge-plugin-wasmedge_image-${{ needs.create_release.outputs.version }}-darwin_${{ matrix.arch }}.tar.gz
	gh release upload ${{ needs.create_release.outputs.version }} WasmEdge-plugin-wasmedge_image-${{ needs.create_release.outputs.version }}-darwin_${{ matrix.arch }}.tar.gz --clobber
	- name: Upload wasmedge_opencvmini plugin tar.gz package
	env:
	GITHUB_TOKEN: ${{ secrets.GITHUB_TOKEN }}
	run: |
	eval $(/opt/homebrew/bin/brew shellenv)
	mv plugin_wasmedge_opencvmini.tar.gz WasmEdge-plugin-wasmedge_opencvmini-${{ needs.create_release.outputs.version }}-darwin_${{ matrix.arch }}.tar.gz
	gh release upload ${{ needs.create_release.outputs.version }} WasmEdge-plugin-wasmedge_opencvmini-${{ needs.create_release.outputs.version }}-darwin_${{ matrix.arch }}.tar.gz --clobber
	- name: Upload wasmedge_zlib plugin tar.gz package
	env:
	GITHUB_TOKEN: ${{ secrets.GITHUB_TOKEN }}
	run: |
	eval $(/opt/homebrew/bin/brew shellenv)
	mv plugin_wasmedge_zlib.tar.gz WasmEdge-plugin-wasmedge_zlib-${{ needs.create_release.outputs.version }}-darwin_${{ matrix.arch }}.tar.gz
	gh release upload ${{ needs.create_release.outputs.version }} WasmEdge-plugin-wasmedge_zlib-${{ needs.create_release.outputs.version }}-darwin_${{ matrix.arch }}.tar.gz --clobber

From the result of the strings, it seems built in /Users/hydai/workspace/WasmEdge/build_0.13.5_lts_b1656.

Is there any reason for this?

[hydai]

All of the ggml plugins are built locally.

Its dependency, llama.cpp, updates quickly and is in active development. It may support more model types in just a week or less time. It's hard for us to release the WasmEdge with the same frequency.
To provide the latest llama.cpp support, we have a branch called hydai/0.13.5_ggml_lts, which will cherry-pick the llama.cpp related features. And we use this branch to build the ggml plugins for the various platforms.

Not only the Apple Silicon with Metal enabled built outside the CI, but also the following assets do:

1. x86_64 with CUDA support: We don't have a machine with a built-in GPU as a CI runner. Even if we build on CI, it is impossible to test and verify it.
2. aarch64 with CUDA support: the same reason as 1.

If you have any suggestions, feel free to let me know. We have already suffered from this problem for a pretty long time, and since we decided to support GPU-related features.

[AkihiroSuda]

Thanks for explanation.

Even if we build on CI, it is impossible to test and verify it.

Would it be possible to build the binaries on GitHub Actions, upload them as GitHub Artifacts, and verify them locally before making a release?
That will help determining the origin and the compilation flags of the plugin binaries.

[juntao]

Yeah. I think to build in CI and then to test and release manually could be a way to go.

[hydai]

Sounds good. I would like to separate the ggml plugin from other extensions/wasi-nn plugins. The reason is that we may have more and more options that only apply to the ggml plugin. Said the CUDA-related dependencies, the Metal-related dependencies, and so on. Will have the new workflow soon. Thanks for your suggestion.