Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

No traces when pulling images from ACK containerd #3052

Open
sigboom opened this issue Jan 27, 2024 · 5 comments
Open

No traces when pulling images from ACK containerd #3052

sigboom opened this issue Jan 27, 2024 · 5 comments
Labels

Comments

@sigboom
Copy link

sigboom commented Jan 27, 2024

Bug report:

k8s version is 1.26, containerd version is 1.6.20, dragonfly helm package verison is 1.1.29

  1. The Dragonfly has been deployed on Alibaba Cloud ACK and two registries have been set up
  containerd:
    enable: true
    injectConfigPath: true
    registries:
      - "https://ghcr.io"
      - "https://lthub-registry.cn-beijing.cr.aliyuncs.com"
  1. All services have started logging normally, referencing dfdaemon.
dfdaemon:
  enable: true
  config:
    console: true
    verbose: true
    pprofPort: 18066
    jaeger: ""
jaeger:
  enable: true
  1. The storage is configured with 20Gi to comply with the minimum quota requirement of Alibaba Cloud's cloud disk.
  2. Confirm that all local services have been successfully started.
    image
  3. Look at backend services, Confirm All Are Accessible Normally
    image
    image
  4. Based on official use cases for testing, corresponding links https://d7y.io/docs/getting-started/quick-start/kubernetes/#containerd-pull-image-back-to-source-for-the-first-time-through-dragonfly
    image
  5. Check that the configuration for containerd on the instance is generated correctly
    image
  6. The correct request records for the official website use case were not found on Jaeger.
    image

Expected behavior:

image

How to reproduce it:

Using Helm to Deploy on ACK Cluster

Environment:

  • Dragonfly version: 2.1.30
  • OS: 1.26.3-aliyun.1
  • Kernel (e.g. uname -a): Linux testompub-pub-172.17.29.36static 5.10.112-11.2.al8.x86_64 [WIP] Implement df daemon #1 SMP Mon Aug 1 20:06:08 CST 2022 x86_64 x86_64 x86_64 GNU/Linux
  • Others:
    • containerd: 1.6.20
    • kubelet: Kubernetes v1.26.3-aliyun.1
@sigboom sigboom added the bug label Jan 27, 2024
@sigboom
Copy link
Author

sigboom commented Jan 27, 2024

one dfdaemon console log file
dfdaemon.log
What logs do I need to provide?

@sigboom sigboom changed the title 从 containerd 拉取镜像时未发现日志 No traces when pulling images from containerd Jan 27, 2024
@gaius-qi
Copy link
Member

Check whether the config_path in the containerd configuration is correct, refer to https://github.com/containerd/containerd/blob/main/docs/cri/config.md#registry-configuration.

If correct, please check the containerd log. Why is mirror not used?

@sigboom
Copy link
Author

sigboom commented Jan 29, 2024

Check whether the config_path in the containerd configuration is correct, refer to https://github.com/containerd/containerd/blob/main/docs/cri/config.md#registry-configuration.

If correct, please check the containerd log. Why is mirror not used?

I found it!This is default config in ACK /etc/containerd/config.toml.
image
The default configuration of ACK is missing an "s"

@sigboom
Copy link
Author

sigboom commented Jan 29, 2024

What happens next is up to the community to handle the situation.
dragonfly/templates/dfdaemon/dfdaemon-daemonset.yaml
It is recommended to read config_path from the current node and not hardcode it in the deployment script.

@gaius-qi
Copy link
Member

What happens next is up to the community to handle the situation. dragonfly/templates/dfdaemon/dfdaemon-daemonset.yaml It is recommended to read config_path from the current node and not hardcode it in the deployment script.

@sigboom Agree!

@sigboom sigboom changed the title No traces when pulling images from containerd No traces when pulling images from ACK containerd Jan 30, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

2 participants