@rugwirobaker we do plan to support more deployment options and kubernetes is at the top of the list and, to the best of my knowledge, it will be coming before openBalena goes out of beta.

@dfunckt So are there any technical limitations to this, or just someone needs to make a yaml?

I don’t think there are technical issues — an openBalena deployment can already be described with a docker-compose file, so I expect k8s support to be straightforward. We’ll be revamping the deployment workflow of openBalena in the coming weeks though, and k8s needs to fit into that, hence the delay.

@dfunckt I am a bit worried about that because currently OpenBalena is using systemd and all the services are being run in privileged mode. K8s supports privileged containers, however it does not seem to be a good idea. Is it possible to run Open Balena without systemd, unprivileged?

@IonBazan we'll soon not require the services to run as privileged. Regarding systemd, I don't think we're currently willing to migrate away but might worth to reconsider. What issues do you have in mind with systemd and k8s?

@dfunckt it seems a couple of months since the thread started. Is there any update on this topic?

We're making progress but nothing concrete yet @ArkeologeN. We're working on a new tool to handle platform deployment which will support different targets, and k8s (as well as docker-compose) is one of them, but it's taking a while.

@dfunckt I got enlightened about the progress on the deployment part via this thread. Since our whole infrastructure runs on k8 so we need this open-balena deployment to be in k8 as well.

We tried using kompose convert to convert docker-compose into k8 deployment files. Our ingress was able to redirect the traffic but looks like ingress is unable to locate upstream server for open-balena

Your help would be greatly appreciated

should be a lot easier to write the k8s manifest yourself than use kompose convert :)

@rusenask I did try that too and the service didn't even come up online. With kompose the service even come up online.

@dfunckt is there any more progress on the k8s deployment option?

I've been busy with creating a Kubernetes version of openBalena for the last week now, but with the current setup, it's (nearly) impossible. I've posted my progress on the forums, where I had some success, but some configurations (like VPN over 443) are as good as impossible to implement in Kubernetes using Ingress.

Any help would be appreciated from other Kubernetes developers. So feel free to contact me.

@bartversluijs great effort, indeed. I was wondering whether it's possible to use WireGuard for tunneling in balena. It's much simpler.

Just to let everyone that's interested in this know, I've created a working version of open-balena on Kubernetes. I've posted this on the forum. It works without much effort, but it isn't 100% done yet.

And @mehdisadeghi, I'm not a Balena team member, so I don't know if that's possible at all. I'm not familiar with WireGuard. But because open-balena is open-source, you should try it for yourself!

As I'm finishing my Helm chart for Kubernetes for the newest release of openBalena, is there a way we can make this an official supported Kubernetes deployment option and merged into this repository?

Would be great to talk about an official release of it and discuss this with the openBalena maintainers!

I'll create a PR once it's finished and maybe this issue can then be closed.

Any updates on this?