Does the Docker Engine support running wasm containers

[Avey777]

Can the Docker Engine build and manage wasm containers like Docker Desktop

[thaJeztah]

With the containerd image-store integration enabled (https://docs.docker.com/storage/containerd/), I think that would be possible, but it would require additional components to be installed on the machine (which in the Docker Desktop case is handled mostly automatically).

Perhaps @jprendes or @rumpl have pointers to where to find more information on that.

[rumpl]

@Avey777 Jorge answered your question in the Docker roadmap repository but I'm going to put the link to the docs here for others that would happen to pass by here with the same question: https://docs.docker.com/engine/alternative-runtimes/#wasmtime

[thaJeztah]

Ah, thanks! Looked in the wrong place in the docs

[Avey777]

I tried to compile 'containerd ship wasmtime v1' but it didn't work. Do you have any compiled files available for use

792.7 error[E0599]: no method named `get_notify_fd` found for struct `ScmpFilterContext` in the current scope
792.7    --> /usr/local/cargo/registry/src/index.crates.io-6f17d22bba15001f/libcontainer-0.2.0/src/seccomp/mod.rs:270:17
792.7     |
792.7 270 |             ctx.get_notify_fd()
792.7     |                 ^^^^^^^^^^^^^ method not found in `ScmpFilterContext`
792.7 
793.1 For more information about this error, try `rustc --explain E0599`.
793.1 error: could not compile `libcontainer` (lib) due to previous error
796.0 error: failed to compile `containerd-shim-wasmtime v0.2.0 (https://github.com/containerd/runwasi.git#ba5ab5ad)`, intermediate artifacts can be found at `/tmp/cargo-installSR4QG7`.
796.0 To reuse those artifacts with a future compilation, set the environment variable `CARGO_TARGET_DIR` to that path.
------
Dockerfile:2
--------------------
   1 |     FROM rust:latest as build
   2 | >>> RUN cargo install     --git https://github.com/containerd/runwasi.git     --bin containerd-shim-wasmtime-v1     --root /out     containerd-shim-wasmtime
   3 |     FROM scratch
   4 |     COPY --from=build /out/bin /
--------------------
ERROR: failed to solve: process "/bin/sh -c cargo install     --git https://github.com/containerd/runwasi.git     --bin containerd-shim-wasmtime-v1     --root /out     containerd-shim-wasmtime" did not complete successfully: exit code: 101
root@racknerd:~# ```

[jprendes]

You can download a pre built binary from the upstream repo's release page: https://github.com/containerd/runwasi/releases/tag/containerd-shim-wasmtime%2Fv0.1.1

[Avey777]

This Good： https://docs.docker.com/storage/containerd/

[Avey777]

But I don’t know how to install the runtime plug-in of wasmedge or wasmtime

root@Jengro:/usr/local/bin# docker run \
    --runtime=io.containerd.wasmedge.v1 \
    --platform=wasi/wasm \
    avey777/main
docker: Error response from daemon: failed to create task for container: failed to start shim: failed to resolve runtime path: runtime "io.containerd.wasmedge.v1" binary not installed "containerd-shim-wasmedge-v1": file does not exist: unknown.
ERRO[0000] error waiting for container: context canceled 
root@Jengro:/usr/local/bin# 

[jprendes]

Have you tried the instructions in https://docs.docker.com/engine/alternative-runtimes/#wasmtime ?
Did you hit any issue following them?

[Avey777]

(base) root@Jengro:~# docker build --output . - <<EOF
FROM rust:latest as build
RUN cargo install \
    --git https://github.com/containerd/runwasi.git \
    --bin containerd-shim-wasmtime-v1 \
    --root /out \
    containerd-shim-wasmtime
FROM scratch
COPY --from=build /out/bin /
EOF
[+] Building 13.3s (5/6)                                                                                                                                                                                                                                             docker:default
 => [internal] load build definition from Dockerfile                                                                                                                                                                                                                           0.0s
 => => transferring dockerfile: 260B                                                                                                                                                                                                                                           0.0s
 => [internal] load metadata for docker.io/library/rust:latest                                                                                                                                                                                                                 1.6s
 => [internal] load .dockerignore                                                                                                                                                                                                                                              0.0s
 => => transferring context: 2B                                                                                                                                                                                                                                                0.0s
 => CACHED [build 1/2] FROM docker.io/library/rust:latest@sha256:e1730890f6646c5d896cc6867c064fc986b6160f362f3cac7fe425c94ccbd8f2                                                                                                                                              0.0s
 => => resolve docker.io/library/rust:latest@sha256:e1730890f6646c5d896cc6867c064fc986b6160f362f3cac7fe425c94ccbd8f2                                                                                                                                                           0.0s
 => ERROR [build 2/2] RUN cargo install     --git https://github.com/containerd/runwasi.git     --bin containerd-shim-wasmtime-v1     --root /out     containerd-shim-wasmtime                                                                                                11.6s
------                                                                                                                                                                                                                                                                              
 > [build 2/2] RUN cargo install     --git https://github.com/containerd/runwasi.git     --bin containerd-shim-wasmtime-v1     --root /out     containerd-shim-wasmtime:                                                                                                            
0.511     Updating git repository `https://github.com/containerd/runwasi.git`                                                                                                                                                                                                       
0.515 warning: spurious network error (3 tries remaining): failed to resolve address for github.com: Temporary failure in name resolution; class=Net (12)                                                                                                                           
1.557 warning: spurious network error (2 tries remaining): failed to resolve address for github.com: Temporary failure in name resolution; class=Net (12)                                                                                                                           
5.058 warning: spurious network error (1 tries remaining): failed to resolve address for github.com: Temporary failure in name resolution; class=Net (12)                                                                                                                           
11.56 error: failed to clone into: /usr/local/cargo/git/db/runwasi-4eb1beb44bcb91f6
11.56 
11.56 Caused by:
11.56   network failure seems to have happened
11.56   if a proxy or similar is necessary `net.git-fetch-with-cli` may help here
11.56   https://doc.rust-lang.org/cargo/reference/config.html#netgit-fetch-with-cli
11.56 
11.56 Caused by:
11.56   failed to resolve address for github.com: Temporary failure in name resolution; class=Net (12)
------
Dockerfile:2
--------------------
   1 |     FROM rust:latest as build
   2 | >>> RUN cargo install     --git https://github.com/containerd/runwasi.git     --bin containerd-shim-wasmtime-v1     --root /out     containerd-shim-wasmtime
   3 |     FROM scratch
   4 |     COPY --from=build /out/bin /
--------------------
ERROR: failed to solve: process "/bin/sh -c cargo install     --git https://github.com/containerd/runwasi.git     --bin containerd-shim-wasmtime-v1     --root /out     containerd-shim-wasmtime" did not complete successfully: exit code: 101
(base) root@Jengro:~# 

[Avey777]

(base) root@Jengro:~# docker run --rm \
 --runtime io.containerd.wasmtime.v1 \
 --platform wasi/wasm32 \
 michaelirwin244/wasm-examplea
Unable to find image 'michaelirwin244/wasm-example:latest' locally
latest: Pulling from michaelirwin244/wasm-example
aca36496ce67: Download complete 
Digest: sha256:1b0714a5af55eed51641792b734115b1db80ccf67d0c8e459aa22c471119f6ef
Status: Downloaded newer image for michaelirwin244/wasm-example:latest
docker: Error response from daemon: failed to create task for container: failed to start shim: failed to resolve runtime path: runtime "io.containerd.wasmtime.v1" binary not installed "containerd-shim-wasmtime-v1": file does not exist: unknown.
(base) root@Jengro:~# 

[jprendes]

Based on this

warning: spurious network error (1 tries remaining): failed to resolve address for github.com: Temporary failure in name resolution; class=Net (12)

it looks like there was a network issue, so the shim was never built.

Also, you should place the shim binary where the engine process can find them, like /usr/local/bin. I wouldn't expect placing it in $HOME to work.

[Avey777]

I think

1. Default integration of commonly used runtimes such as wasmtime and wasedge
2. There is a place where users can directly download the runtime, which is better

[Avey777]

I want to get the following files, but I don’t know where to download them

io.containerd.slight.v1
io.containerd.spin.v2
io.containerd.wasmedge.v1
io.containerd.wasmtime.v1
io.containerd.lunatic.v1
io.containerd.wws.v1
io.containerd.wasmer.v1

[jprendes]

You should be able to find precompiled binaries in the GitHub releases for each project.
They are not the bleeding edge, but should be enough to get you started.

From the containerd/runwasi project (wasmtime, wasmedge, and wasmer):

• https://github.com/containerd/runwasi/releases/tag/containerd-shim-wasmtime%2Fv0.3.0
• https://github.com/containerd/runwasi/releases/tag/containerd-shim-wasmedge%2Fv0.3.0
• https://github.com/containerd/runwasi/releases/tag/containerd-shim-wasmer%2Fv0.3.0

From the deislabs/containerd-wasm-shims project (spin, slight, lunatic, and wws):

• https://github.com/deislabs/containerd-wasm-shims/releases/tag/v0.10.0

[Avey777]

(base) root@Jengro:/opt/wasm# docker run --runtime=io.containerd.wasmtime.v1 --platform=wasi/wasm32 --name=avey777 avey777/v
docker: Error response from daemon: failed to create task for container: failed to start shim: failed to resolve runtime path: runtime "io.containerd.wasmtime.v1" binary not installed "containerd-shim-wasmtime-v1": file does not exist: unknown.
ERRO[0000] error waiting for container: context canceled 
(base) root@Jengro:/opt/wasm# 

---

I did this, but when running the container I got an error

I am very sure that the image itself is normal

[jprendes]

Where did you get the binary from?
From what I can see, that binary is not marked as executable.
Doing chmod a+x /usr/local/bin/containerd-shim-wasmtime-v1 should do the trick.

[Avey777]

Great. It's working. Thank you very much for your help

Also hope it can help more people

[Avey777]

@thaJeztah
When can this feature be officially released

[thaJeztah]

@Avey777 you mean the "containerd image store" integration? Functionally it's almost complete, but there's still various UX, usability, and some performance issues to look into before we make it the default, but while it's still "opt-in", it's ok already to start using it, but as with anything; make sure to test and verify before rolling out such changes to any production / critical setups.

Or are you wondering about providing WASM shims as part of our packages? (And have those installed / available by default?); for the latter part; we have check-boxes to enable these in Docker Desktop; the WASM ecosystem is still evolving rapidly, so we still need to decide at what moment we consider it "stable enough" to move that feature out of beta.

@jprendes may be able to fill in more details on that aspect though, as he's closer "in the loop" on the WASM ecosystem.

[jprendes]

For Docker Desktop there's https://github.com/jprendes/docker-desktop-shim-manager
I shouldn't be too hard to adapt that to run outside Docker Desktop in a linux host.