Unable to add a Cloud backend

[rajesh1084]

Issue/Feature Description:
Deployed Soda multi-cloud as per the instructions in the documentation. Enabled all the required projects and parameters in the yaml files.
However, in the UI, when I try to register a new cloud backend, the drop-down doesn't show up any values. Refer to the screenshot.

Why this issue to fixed / feature is needed(give scenarios or use cases):

How to reproduce, in case of a bug:

Other Notes / Environment Information: (Please give the env information, log link or any useful information for this issue)
Soda was deployed on a single VM (Ubuntu 20.04.4 LTS)

[anvithks]

@rajesh1084 seems like all the strato (multicloud) docker containers have not come up properly. The Backend types API call seems to be failing.

Could you try the following and post the screenshots here:

1. docker ps -a
2. Enable the developer console in the browser (usually F12 should bring it up) and screenshot the error that is shown when you click on the Register Backend button.

If the installation was interrupted in between, or if you have shutdown the system and restarted this issue may arise.
In these cases you can run the ansible clean playbook and run the installation again.

[rajesh1084]

Sure @anvithks , I will post those details in a while.

If the installation was interrupted in between
No, it wasn't.

you can run the ansible clean playbook and run the installation again
Done that twice.

[anvithks]

typo: seems like all the strato (multicloud) docker containers have not come up properly

[rajesh1084]

Looks like mongodb container is restarting with the warning -
WARNING: MongoDB 5.0+ requires a CPU with AVX support, and your current system does not appear to have that!

My base system does have avx/avx2 supported CPU, but the VirtualBox VM doesn't have it.

[rajesh1084]

Closing this issue as I am able to bring up strato on a different setup and able to see the cloud backends.

[anvithks]

Closing this issue as I am able to bring up strato on a different setup and able to see the cloud backends.

That's great @rajesh1084. Let me know if you face any other issues.

[rajesh1084]

While it lists a set of cloud backends, when we try to register an AWS S3 bucket, it's failing -

caused by: Put "http://sample22fc6593-de0f-4c85-be2b-9c3d56982f4c.persoanl-soda-test-bucket/": dial tcp: lookup sample22fc6593-de0f-4c85-be2b-9c3d56982f4c.persoanl-soda-test-bucket: no such host
[2023-03-14T11:19:49Z] [ERROR] [/home/root1/multi-cloud-new/multi-cloud/s3/pkg/datastore/aws/aws.go] [aws.(*AwsAdapter).BackendCheck():438] [PID:9] failed to create sample bucket :RequestError: send request failed
caused by: Put "http://sample22fc6593-de0f-4c85-be2b-9c3d56982f4c.persoanl-soda-test-bucket/": dial tcp: lookup sample22fc6593-de0f-4c85-be2b-9c3d56982f4c.persoanl-soda-test-bucket: no such host
[2023-03-14T11:19:49Z] [ERROR] [/home/root1/multi-cloud-new/multi-cloud/s3/pkg/service/service.go] [service.(*s3Service).BackendCheck():580] [PID:9] failed due to wrong backend details, err:RequestError: send request failed
caused by: Put "http://sample22fc6593-de0f-4c85-be2b-9c3d56982f4c.persoanl-soda-test-bucket/": dial tcp: lookup sample22fc6593-de0f-4c85-be2b-9c3d56982f4c.persoanl-soda-test-bucket: no such host

[2023-03-14T11:19:49Z] [INFO] [/home/root1/multi-cloud-new/multi-cloud/s3/pkg/service/service.go] [service.(*s3Service).BackendCheck():562] [PID:9] BackendCheck is called in s3 service.
[2023-03-14T11:19:49Z] [INFO] [/home/root1/multi-cloud-new/multi-cloud/s3/pkg/datastore/aws/aws.go] [aws.(*AwsAdapter).BucketCreate():71] [PID:9] Bucket create is called in aws service and input request is:name:"sample0364791d-5ab8-42eb-bc20-f12dcd8e621a"
[2023-03-14T11:19:49Z] [ERROR] [/home/root1/multi-cloud-new/multi-cloud/s3/pkg/datastore/aws/aws.go] [aws.(*AwsAdapter).BucketCreate():80] [PID:9] the create bucket failed in aws-s3 service with err:%sRequestError: send request failed
caused by: Put "http://sample0364791d-5ab8-42eb-bc20-f12dcd8e621a.persoanl-soda-test-bucket/": dial tcp: lookup sample0364791d-5ab8-42eb-bc20-f12dcd8e621a.persoanl-soda-test-bucket: no such host
[2023-03-14T11:19:49Z] [ERROR] [/home/root1/multi-cloud-new/multi-cloud/s3/pkg/datastore/aws/aws.go] [aws.(*AwsAdapter).BackendCheck():438] [PID:9] failed to create sample bucket :RequestError: send request failed
caused by: Put "http://sample0364791d-5ab8-42eb-bc20-f12dcd8e621a.persoanl-soda-test-bucket/": dial tcp: lookup sample0364791d-5ab8-42eb-bc20-f12dcd8e621a.persoanl-soda-test-bucket: no such host
[2023-03-14T11:19:49Z] [ERROR] [/home/root1/multi-cloud-new/multi-cloud/s3/pkg/service/service.go] [service.(*s3Service).BackendCheck():580] [PID:9] failed due to wrong backend details, err:RequestError: send request failed
caused by: Put "http://sample0364791d-5ab8-42eb-bc20-f12dcd8e621a.persoanl-soda-test-bucket/": dial tcp: lookup sample0364791d-5ab8-42eb-bc20-f12dcd8e621a.persoanl-soda-test-bucket: no such host

[2023-03-14T11:21:21Z] [INFO] [/home/root1/multi-cloud-new/multi-cloud/s3/pkg/service/service.go] [service.(*s3Service).BackendCheck():562] [PID:9] BackendCheck is called in s3 service.
[2023-03-14T11:21:21Z] [INFO] [/home/root1/multi-cloud-new/multi-cloud/s3/pkg/datastore/aws/aws.go] [aws.(*AwsAdapter).BucketCreate():71] [PID:9] Bucket create is called in aws service and input request is:name:"sampled9007664-1c5b-43d9-b558-67dc3ecea2f2"
[2023-03-14T11:21:22Z] [ERROR] [/home/root1/multi-cloud-new/multi-cloud/s3/pkg/datastore/aws/aws.go] [aws.(*AwsAdapter).BucketCreate():80] [PID:9] the create bucket failed in aws-s3 service with err:%sRequestError: send request failed
caused by: Put "http://sampled9007664-1c5b-43d9-b558-67dc3ecea2f2.soda-123-bucket/": dial tcp: lookup sampled9007664-1c5b-43d9-b558-67dc3ecea2f2.soda-123-bucket: no such host
[2023-03-14T11:21:22Z] [ERROR] [/home/root1/multi-cloud-new/multi-cloud/s3/pkg/datastore/aws/aws.go] [aws.(*AwsAdapter).BackendCheck():438] [PID:9] failed to create sample bucket :RequestError: send request failed
caused by: Put "http://sampled9007664-1c5b-43d9-b558-67dc3ecea2f2.soda-123-bucket/": dial tcp: lookup sampled9007664-1c5b-43d9-b558-67dc3ecea2f2.soda-123-bucket: no such host
[2023-03-14T11:21:22Z] [ERROR] [/home/root1/multi-cloud-new/multi-cloud/s3/pkg/service/service.go] [service.(*s3Service).BackendCheck():580] [PID:9] failed due to wrong backend details, err:RequestError: send request failed
caused by: Put "http://sampled9007664-1c5b-43d9-b558-67dc3ecea2f2.soda-123-bucket/": dial tcp: lookup sampled9007664-1c5b-43d9-b558-67dc3ecea2f2.soda-123-bucket: no such host

[2023-03-14T11:21:22Z] [INFO] [/home/root1/multi-cloud-new/multi-cloud/s3/pkg/service/service.go] [service.(*s3Service).BackendCheck():562] [PID:9] BackendCheck is called in s3 service.
[2023-03-14T11:21:22Z] [INFO] [/home/root1/multi-cloud-new/multi-cloud/s3/pkg/datastore/aws/aws.go] [aws.(*AwsAdapter).BucketCreate():71] [PID:9] Bucket create is called in aws service and input request is:name:"sample8db4ac74-90ed-48fb-99c6-afff6f66b19a"
[2023-03-14T11:21:22Z] [ERROR] [/home/root1/multi-cloud-new/multi-cloud/s3/pkg/datastore/aws/aws.go] [aws.(*AwsAdapter).BucketCreate():80] [PID:9] the create bucket failed in aws-s3 service with err:%sRequestError: send request failed
caused by: Put "http://sample8db4ac74-90ed-48fb-99c6-afff6f66b19a.soda-123-bucket/": dial tcp: lookup sample8db4ac74-90ed-48fb-99c6-afff6f66b19a.soda-123-bucket: no such host
[2023-03-14T11:21:22Z] [ERROR] [/home/root1/multi-cloud-new/multi-cloud/s3/pkg/datastore/aws/aws.go] [aws.(*AwsAdapter).BackendCheck():438] [PID:9] failed to create sample bucket :RequestError: send request failed
caused by: Put "http://sample8db4ac74-90ed-48fb-99c6-afff6f66b19a.soda-123-bucket/": dial tcp: lookup sample8db4ac74-90ed-48fb-99c6-afff6f66b19a.soda-123-bucket: no such host
[2023-03-14T11:21:22Z] [ERROR] [/home/root1/multi-cloud-new/multi-cloud/s3/pkg/service/service.go] [service.(*s3Service).BackendCheck():580] [PID:9] failed due to wrong backend details, err:RequestError: send request failed
caused by: Put "http://sample8db4ac74-90ed-48fb-99c6-afff6f66b19a.soda-123-bucket/": dial tcp: lookup sample8db4ac74-90ed-48fb-99c6-afff6f66b19a.soda-123-bucket: no such host

[anvithks]

[PID:9] failed due to wrong backend details,

@rajesh1084 Seems like the backend information provided may be incorrect.

Have you generated the AK/SK in SODA Dashboard?
Did you enable storage service plans and use it to create a bucket?

[rajesh1084]

Have you generated the AK/SK in SODA Dashboard?

No, we haven't generated AK/SK in the dashboard; but using the AK/SK of our AWS a/c.
I believe, AK/SK in SODA is required after we register the backend (to access the S3 bucket from SODA UI). Is that a wrong understanding?

Did you enable storage service plans and use it to create a bucket?

Yes. We did set enable_storage_service_plans: true in group_vars/common.yml.

Following this documentation trying with the following values:
Endpoint: s3.us-west-2.amazonaws.com // My a/c is in us-west-2 region
AK/SK: generated from AWS console

Any pointers?