BOOT FAILED - cannot_create_db_dir

[sirrutyna]

Name and Version
docker.io/bitnami/rabbitmq:3.12.12-debian-11-r7

What architecture are you using?
amd64

What steps will reproduce the bug?

@sirrutyna PLEASE ATTACH FILES HERE, DO NOT PASTE THEM

helm install my-rabbitmq bitnami/rabbitmq -f rabbitmq-values.yaml

kubectl patch pvc data-my-rabbitmq-0 -p '{"spec":{"volumeName":"rabbit-pv"}}'

What is the expected behavior?
No response

What do you see instead?

kubectl logs my-rabbitmq-0 -n default
rabbitmq 14:48:52.05 INFO ==>
rabbitmq 14:48:52.05 INFO ==> Welcome to the Bitnami rabbitmq container
rabbitmq 14:48:52.05 INFO ==> Subscribe to project updates by watching https://github.com/bitnami/containers
rabbitmq 14:48:52.05 INFO ==> Submit issues and feature requests at https://github.com/bitnami/containers/issues
rabbitmq 14:48:52.06 INFO ==>
rabbitmq 14:48:52.06 INFO ==> ** Starting RabbitMQ setup **
rabbitmq 14:48:52.08 INFO ==> Validating settings in RABBITMQ_* env vars..
rabbitmq 14:48:52.10 INFO ==> Initializing RabbitMQ...
rabbitmq 14:48:52.15 INFO ==> Starting RabbitMQ in background...
rabbitmq 14:50:44.08 ERROR ==> Couldn't start RabbitMQ in background.

Warning Unhealthy 2m41s (x44 over 27m) kubelet Readiness probe failed: % Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0
curl: (7) Failed to connect to 127.0.0.1 port 15672: Connection refused

kubectl exec -it my-rabbitmq-0 -- /bin/bash

rabbitmq-server

I have no name!@my-rabbitmq-0:/$ rabbitmq-server
2024-02-12 14:26:36.960355+00:00 [notice] <0.44.0> Application syslog exited with reason: stopped
2024-02-12 14:26:36.966464+00:00 [notice] <0.235.0> Logging: switching to configured handler(s); following messages may not be visible in this log output
2024-02-12 14:26:36.967441+00:00 [notice] <0.235.0> Logging: configured log handlers are now ACTIVE
2024-02-12 14:26:37.019488+00:00 [error] <0.235.0>
2024-02-12 14:26:37.019488+00:00 [error] <0.235.0> BOOT FAILED
2024-02-12 14:26:37.019488+00:00 [error] <0.235.0> ===========
2024-02-12 14:26:37.019488+00:00 [error] <0.235.0> Error during startup: {error,
2024-02-12 14:26:37.019488+00:00 [error] <0.235.0> {cannot_create_db_dir,
2024-02-12 14:26:37.019488+00:00 [error] <0.235.0> "/bitnami/rabbitmq/mnesia/[rabbit@my-rabbitmq-0.my-rabbitmq-headless.default.svc.cluster.local](mailto:rabbit@my-rabbitmq-0.my-rabbitmq-headless.default.svc.cluster.local)/",
2024-02-12 14:26:37.019488+00:00 [error] <0.235.0> eacces}}
2024-02-12 14:26:37.019488+00:00 [error] <0.235.0>

BOOT FAILED
Error during startup: {error,
{cannot_create_db_dir,
"/bitnami/rabbitmq/mnesia/[rabbit@my-rabbitmq-0.my-rabbitmq-headless.default.svc.cluster.local](mailto:rabbit@my-rabbitmq-0.my-rabbitmq-headless.default.svc.cluster.local)/",
eacces}}

2024-02-12 14:26:38.020657+00:00 [error] <0.234.0> crasher:
2024-02-12 14:26:38.020657+00:00 [error] <0.234.0> initial call: application_master:init/4
2024-02-12 14:26:38.020657+00:00 [error] <0.234.0> pid: <0.234.0>
2024-02-12 14:26:38.020657+00:00 [error] <0.234.0> registered_name: []
2024-02-12 14:26:38.020657+00:00 [error] <0.234.0> exception exit: {{cannot_create_db_dir,
2024-02-12 14:26:38.020657+00:00 [error] <0.234.0> "/bitnami/rabbitmq/mnesia/[rabbit@my-rabbitmq-0.my-rabbitmq-headless.default.svc.cluster.local](mailto:rabbit@my-rabbitmq-0.my-rabbitmq-headless.default.svc.cluster.local)/",
2024-02-12 14:26:38.020657+00:00 [error] <0.234.0> eacces},
2024-02-12 14:26:38.020657+00:00 [error] <0.234.0> {rabbit,start,[normal,[]]}}
2024-02-12 14:26:38.020657+00:00 [error] <0.234.0> in function application_master:init/4 (application_master.erl, line 142)
2024-02-12 14:26:38.020657+00:00 [error] <0.234.0> ancestors: [<0.233.0>]
2024-02-12 14:26:38.020657+00:00 [error] <0.234.0> message_queue_len: 1
2024-02-12 14:26:38.020657+00:00 [error] <0.234.0> messages: [{'EXIT',<0.235.0>,normal}]
2024-02-12 14:26:38.020657+00:00 [error] <0.234.0> links: [<0.233.0>,<0.44.0>]
2024-02-12 14:26:38.020657+00:00 [error] <0.234.0> dictionary: []
2024-02-12 14:26:38.020657+00:00 [error] <0.234.0> trap_exit: true
2024-02-12 14:26:38.020657+00:00 [error] <0.234.0> status: running
2024-02-12 14:26:38.020657+00:00 [error] <0.234.0> heap_size: 987
2024-02-12 14:26:38.020657+00:00 [error] <0.234.0> stack_size: 28
2024-02-12 14:26:38.020657+00:00 [error] <0.234.0> reductions: 179
2024-02-12 14:26:38.020657+00:00 [error] <0.234.0> neighbours:
2024-02-12 14:26:38.020657+00:00 [error] <0.234.0>
2024-02-12 14:26:38.037538+00:00 [notice] <0.44.0> Application rabbit exited with reason: {{cannot_create_db_dir,"/bitnami/rabbitmq/mnesia/[rabbit@my-rabbitmq-0.my-rabbitmq-headless.default.svc.cluster.local](mailto:rabbit@my-rabbitmq-0.my-rabbitmq-headless.default.svc.cluster.local)/",eacces},{rabbit,start,[normal,[]]}}
Kernel pid terminated (application_controller) ("{application_start_failure,rabbit,{{cannot_create_db_dir,"/bitnami/rabbitmq/mnesia/[rabbit@my-rabbitmq-0.my-rabbitmq-headless.default.svc.cluster.local](mailto:rabbit@my-rabbitmq-0.my-rabbitmq-headless.default.svc.cluster.local)/",eacces},{rabbit,start,[normal,[]]}}}")

Crash dump is being written to: /opt/bitnami/rabbitmq/var/log/rabbitmq/erl_crash.dump...done

id
uid=1001 gid=0(root) groups=0(root),1001

chmod 777 /bitnami/rabbitmq/mnesia/
chmod: changing permissions of '/bitnami/rabbitmq/mnesia/': Operation not permitted

Is there any good reason why rabbitmq is not starting up on my kubernetes cluster? Why he cant create file any helpers? Im stuck...

Kubernetes RKE2 1.24

[lukebakken]

@sirrutyna Please ATTACH your configuration files to this discussion, do NOT paste them.

It appears to me that your persistent volume does not have the correct permissions when attached to your container. This is probably an environment issue.

[sirrutyna]

@lukebakken
Hey ofc apoligize for that. Steps that I did to deploy:

kubectl apply -f pv .yaml
kubectl aplly -f pvc.yaml
kubectl apply -f manual-storageclass.yaml
helm install my-rabbitmq bitnami/rabbitmq -f rabbitmq-values.yaml
kubectl patch pvc data-my-rabbitmq-0 -p '{"spec":{"volumeName":"rabbit-pv"}}'

config files attached - needed to add *.txt - *.yaml files was not supported to attach
manual-storageclass.yaml.txt
pvc.yaml.txt
rabbitmq-values.yaml.txt
pv.yaml.txt

You referring that my pv does not have permissions it might be it config is really basic can you elaborate what I need to change in yaml files?

[sirrutyna]

Ok problem solved. Issue was with storageclass. Changed pv to local-path and worked as charm.

[lukebakken]

Thank you for following up!