Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Best Practice to improve the Noobaa Performance of downloading files with size less than 100 MB #1226

Open
schwienbier opened this issue Oct 12, 2023 · 0 comments

Comments

@schwienbier
Copy link

schwienbier commented Oct 12, 2023

Dear Noobaa Support,

Environment info

  • NooBaa Operator Version: 5.13.0
  • Platform: Kubernetes v1.25.8

The noobaa is configured as follows in our k8s cluster. It is deployed on 6 tainted k8s nodes with 16 cpus and 128 GB memory. When downloading small files, whose size is less than 100MB, e.g. 20MB, noobaa takes 0.29s, minio takes 0.23s, and swift object storage takes 0.14s.

May I ask, what is the best practice to improve the noobaa's performance of downloading files, especially for files whose size is less than 100 MB, except the approach of increasing the number of endpoints, and resource limits? Thank you.

apiVersion: noobaa.io/v1alpha1
kind: NooBaa
metadata:
  labels:
    app: noobaa
  name: noobaa
  namespace: noobaa
spec:
  cleanupPolicy: {}
  coreResources:
    limits:
      cpu: '10'
      memory: 80Gi
    requests:
      cpu: '1'
      memory: 2Gi
  dbImage: centos/postgresql-12-centos7
  dbResources:
    limits:
      cpu: '4'
      memory: 8Gi
    requests:
      cpu: '4'
      memory: 8Gi
  dbType: postgres
  disableLoadBalancerService: true
  endpoints:
    maxCount: 8
    minCount: 8
    resources:
      limits:
        cpu: '3'
        memory: 5Gi
      requests:
        cpu: '1'
        memory: 2Gi
  image: noobaa/noobaa-core:master-20230123
  loadBalancerSourceSubnets: {}
  security:
    kms: {}

Best regards

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant