Update bugout token #163
nvoxland-aldeeplake-benchmark.yaml
on: push
Start benchmarks ec2
2s
Remove run-benchmarks label
0s
Matrix: Run Benchmarks
Annotations
53 errors
|
test_deepmemory.test_deepmemory_train_and_cancel:
deeplake/core/vectorstore/deep_memory/test_deepmemory.py#L130
deeplake.util.exceptions.DatasetHandlerError: Path hub://testingacc2/tmpabe5_test_deepmemory_test_deepmemory_train_and_cancel_copy is empty or does not exist. Cannot delete.
|
|
test_api.test_hub_dataset_suffix_bug:
deeplake/api/tests/test_api.py#L750
deeplake.util.exceptions.BadRequestException: Invalid Request. One or more request parameters is incorrect.
object generator can't be used in 'await' expression
|
|
test_api.test_dataset_rename[True-hub_cloud_ds_generator-hub_cloud_path-hub_cloud_dev_token]:
deeplake/api/tests/test_api.py#L976
deeplake.util.exceptions.BadRequestException: Invalid Request. One or more request parameters is incorrect.
object generator can't be used in 'await' expression
|
|
test_api.test_dataset_rename[False-hub_cloud_ds_generator-hub_cloud_path-hub_cloud_dev_token]:
deeplake/api/tests/test_api.py#L976
deeplake.util.exceptions.BadRequestException: Invalid Request. One or more request parameters is incorrect.
object generator can't be used in 'await' expression
|
|
test_api.test_dataset_deepcopy[True-2-hub_cloud_path-hub_cloud_dev_token]:
deeplake/api/tests/test_api.py#L1036
deeplake.util.exceptions.BadRequestException: Invalid Request. One or more request parameters is incorrect.
object generator can't be used in 'await' expression
|
|
test_views.test_view_token_only:
deeplake/api/tests/test_views.py#L52
deeplake.util.exceptions.BadRequestException: Invalid Request. One or more request parameters is incorrect.
object generator can't be used in 'await' expression
|
|
test_deeplake_vectorstore.test_update_embedding[embedding_fn3-hub_cloud_ds-None-None-None-None-vector_store_query-hub_cloud_dev_token]:
deeplake/core/vectorstore/test_deeplake_vectorstore.py#L1063
deeplake.util.exceptions.BadRequestException: Invalid Request. One or more request parameters is incorrect.
object generator can't be used in 'await' expression
|
|
test_deeplake_vectorstore.test_update_embedding[None-hub_cloud_ds-None-None-None-None-vector_store_query-hub_cloud_dev_token]:
deeplake/core/vectorstore/test_deeplake_vectorstore.py#L1063
deeplake.util.exceptions.BadRequestException: Invalid Request. One or more request parameters is incorrect.
object generator can't be used in 'await' expression
|
|
test_api.test_hub_dataset_suffix_bug:
deeplake/api/tests/test_api.py#L750
deeplake.util.exceptions.BadRequestException: Invalid Request. One or more request parameters is incorrect.
object generator can't be used in 'await' expression
|
|
test_api.test_dataset_rename[True-hub_cloud_ds_generator-hub_cloud_path-hub_cloud_dev_token]:
deeplake/api/tests/test_api.py#L976
deeplake.util.exceptions.BadRequestException: Invalid Request. One or more request parameters is incorrect.
object generator can't be used in 'await' expression
|
|
test_api.test_dataset_rename[False-hub_cloud_ds_generator-hub_cloud_path-hub_cloud_dev_token]:
deeplake/api/tests/test_api.py#L976
deeplake.util.exceptions.BadRequestException: Invalid Request. One or more request parameters is incorrect.
object generator can't be used in 'await' expression
|
|
test_api.test_dataset_deepcopy[True-2-hub_cloud_path-hub_cloud_dev_token]:
deeplake/api/tests/test_api.py#L1036
deeplake.util.exceptions.BadRequestException: Invalid Request. One or more request parameters is incorrect.
object generator can't be used in 'await' expression
|
|
test_views.test_view_token_only:
deeplake/api/tests/test_views.py#L52
deeplake.util.exceptions.BadRequestException: Invalid Request. One or more request parameters is incorrect.
object generator can't be used in 'await' expression
|
|
test_deeplake_vectorstore.test_update_embedding[embedding_fn3-hub_cloud_ds-None-None-None-None-vector_store_query-hub_cloud_dev_token]:
deeplake/core/vectorstore/test_deeplake_vectorstore.py#L1063
deeplake.util.exceptions.BadRequestException: Invalid Request. One or more request parameters is incorrect.
object generator can't be used in 'await' expression
|
|
test_deeplake_vectorstore.test_update_embedding[None-hub_cloud_ds-None-None-None-None-vector_store_query-hub_cloud_dev_token]:
deeplake/core/vectorstore/test_deeplake_vectorstore.py#L1063
deeplake.util.exceptions.BadRequestException: Invalid Request. One or more request parameters is incorrect.
object generator can't be used in 'await' expression
|
|
test_api.test_hub_dataset_suffix_bug:
deeplake/api/tests/test_api.py#L750
deeplake.util.exceptions.BadRequestException: Invalid Request. One or more request parameters is incorrect.
object generator can't be used in 'await' expression
|
|
test_api.test_dataset_rename[True-hub_cloud_ds_generator-hub_cloud_path-hub_cloud_dev_token]:
deeplake/api/tests/test_api.py#L976
deeplake.util.exceptions.BadRequestException: Invalid Request. One or more request parameters is incorrect.
object generator can't be used in 'await' expression
|
|
test_api.test_dataset_rename[False-hub_cloud_ds_generator-hub_cloud_path-hub_cloud_dev_token]:
deeplake/api/tests/test_api.py#L976
deeplake.util.exceptions.BadRequestException: Invalid Request. One or more request parameters is incorrect.
object generator can't be used in 'await' expression
|
|
test_api.test_dataset_deepcopy[True-2-hub_cloud_path-hub_cloud_dev_token]:
deeplake/api/tests/test_api.py#L1036
deeplake.util.exceptions.BadRequestException: Invalid Request. One or more request parameters is incorrect.
object generator can't be used in 'await' expression
|
|
test_views.test_view_token_only:
deeplake/api/tests/test_views.py#L52
deeplake.util.exceptions.BadRequestException: Invalid Request. One or more request parameters is incorrect.
object generator can't be used in 'await' expression
|
|
test_api.test_hub_dataset_suffix_bug:
deeplake/api/tests/test_api.py#L750
deeplake.util.exceptions.BadRequestException: Invalid Request. One or more request parameters is incorrect.
object generator can't be used in 'await' expression
|
|
test_api.test_dataset_rename[True-hub_cloud_ds_generator-hub_cloud_path-hub_cloud_dev_token]:
deeplake/api/tests/test_api.py#L976
deeplake.util.exceptions.BadRequestException: Invalid Request. One or more request parameters is incorrect.
object generator can't be used in 'await' expression
|
|
test_api.test_dataset_rename[False-hub_cloud_ds_generator-hub_cloud_path-hub_cloud_dev_token]:
deeplake/api/tests/test_api.py#L976
deeplake.util.exceptions.BadRequestException: Invalid Request. One or more request parameters is incorrect.
object generator can't be used in 'await' expression
|
|
test_api.test_dataset_deepcopy[True-2-hub_cloud_path-hub_cloud_dev_token]:
deeplake/api/tests/test_api.py#L1036
deeplake.util.exceptions.BadRequestException: Invalid Request. One or more request parameters is incorrect.
object generator can't be used in 'await' expression
|
|
test_views.test_view_token_only:
deeplake/api/tests/test_views.py#L52
deeplake.util.exceptions.BadRequestException: Invalid Request. One or more request parameters is incorrect.
object generator can't be used in 'await' expression
|
|
test_deeplake_vectorstore.test_update_embedding[embedding_fn3-hub_cloud_ds-None-None-None-None-vector_store_query-hub_cloud_dev_token]:
deeplake/core/vectorstore/test_deeplake_vectorstore.py#L1063
deeplake.util.exceptions.BadRequestException: Invalid Request. One or more request parameters is incorrect.
object generator can't be used in 'await' expression
|
|
test_deeplake_vectorstore.test_update_embedding[None-hub_cloud_ds-None-None-None-None-vector_store_query-hub_cloud_dev_token]:
deeplake/core/vectorstore/test_deeplake_vectorstore.py#L1063
deeplake.util.exceptions.BadRequestException: Invalid Request. One or more request parameters is incorrect.
object generator can't be used in 'await' expression
|
|
test_deepmemory.test_deepmemory_evaluate:
deeplake/core/vectorstore/deep_memory/test_deepmemory.py#L189
AssertionError: assert {'recall@1': ...@3': 0.4, ...} == {'recall@1': ...@3': 0.6, ...}
Differing items:
{'recall@5': 0.5} != {'recall@5': 0.6}
{'recall@10': 0.5} != {'recall@10': 0.6}
{'recall@100': 0.8} != {'recall@100': 0.9}
{'recall@1': 0.1} != {'recall@1': 0.4}
{'recall@3': 0.4} != {'recall@3': 0.6}
{'recall@50': 0.6} != {'recall@50': 0.7}
Full diff:
{
- 'recall@1': 0.4,
? ^
+ 'recall@1': 0.1,
? ^
- 'recall@10': 0.6,
? ^
+ 'recall@10': 0.5,
? ^
- 'recall@100': 0.9,
? ^
+ 'recall@100': 0.8,
? ^
- 'recall@3': 0.6,
? ^
+ 'recall@3': 0.4,
? ^
+ 'recall@5': 0.5,
- 'recall@5': 0.6,
+ 'recall@50': 0.6,
? +
- 'recall@50': 0.7,
}
|
|
test_api.test_hub_dataset_suffix_bug:
deeplake/api/tests/test_api.py#L750
deeplake.util.exceptions.BadRequestException: Invalid Request. One or more request parameters is incorrect.
object generator can't be used in 'await' expression
|
|
test_api.test_dataset_rename[True-hub_cloud_ds_generator-hub_cloud_path-hub_cloud_dev_token]:
deeplake/api/tests/test_api.py#L976
deeplake.util.exceptions.BadRequestException: Invalid Request. One or more request parameters is incorrect.
object generator can't be used in 'await' expression
|
|
test_api.test_dataset_rename[False-hub_cloud_ds_generator-hub_cloud_path-hub_cloud_dev_token]:
deeplake/api/tests/test_api.py#L976
deeplake.util.exceptions.BadRequestException: Invalid Request. One or more request parameters is incorrect.
object generator can't be used in 'await' expression
|
|
test_api.test_dataset_deepcopy[True-2-hub_cloud_path-hub_cloud_dev_token]:
deeplake/api/tests/test_api.py#L1036
deeplake.util.exceptions.BadRequestException: Invalid Request. One or more request parameters is incorrect.
object generator can't be used in 'await' expression
|
|
test_link.test_complex_creds:
deeplake/api/tests/test_link.py#L414
deeplake.util.exceptions.SampleReadError: Unable to read sample from https://picsum.photos/200/300
|
|
test_views.test_view_token_only:
deeplake/api/tests/test_views.py#L52
deeplake.util.exceptions.BadRequestException: Invalid Request. One or more request parameters is incorrect.
object generator can't be used in 'await' expression
|
|
test_deeplake_vectorstore.test_update_embedding[embedding_fn3-hub_cloud_ds-None-None-None-None-vector_store_query-hub_cloud_dev_token]:
deeplake/core/vectorstore/test_deeplake_vectorstore.py#L1063
deeplake.util.exceptions.BadRequestException: Invalid Request. One or more request parameters is incorrect.
object generator can't be used in 'await' expression
|
|
test_deeplake_vectorstore.test_update_embedding[None-hub_cloud_ds-None-None-None-None-vector_store_query-hub_cloud_dev_token]:
deeplake/core/vectorstore/test_deeplake_vectorstore.py#L1063
deeplake.util.exceptions.BadRequestException: Invalid Request. One or more request parameters is incorrect.
object generator can't be used in 'await' expression
|
|
test_api.test_hub_dataset_suffix_bug:
deeplake/api/tests/test_api.py#L750
deeplake.util.exceptions.BadRequestException: Invalid Request. One or more request parameters is incorrect.
object generator can't be used in 'await' expression
|
|
test_api.test_dataset_rename[True-hub_cloud_ds_generator-hub_cloud_path-hub_cloud_dev_token]:
deeplake/api/tests/test_api.py#L976
deeplake.util.exceptions.BadRequestException: Invalid Request. One or more request parameters is incorrect.
object generator can't be used in 'await' expression
|
|
test_api.test_dataset_rename[False-hub_cloud_ds_generator-hub_cloud_path-hub_cloud_dev_token]:
deeplake/api/tests/test_api.py#L976
deeplake.util.exceptions.BadRequestException: Invalid Request. One or more request parameters is incorrect.
object generator can't be used in 'await' expression
|
|
test_api.test_dataset_deepcopy[True-2-hub_cloud_path-hub_cloud_dev_token]:
deeplake/api/tests/test_api.py#L1036
deeplake.util.exceptions.InvalidTokenException: Token is invalid. Make sure the full token string is included and try again.
|
|
test_views.test_view_token_only:
deeplake/api/tests/test_views.py#L52
deeplake.util.exceptions.BadRequestException: Invalid Request. One or more request parameters is incorrect.
object generator can't be used in 'await' expression
|
|
test_api.test_hub_dataset_suffix_bug:
deeplake/api/tests/test_api.py#L750
deeplake.util.exceptions.BadRequestException: Invalid Request. One or more request parameters is incorrect.
object generator can't be used in 'await' expression
|
|
test_api.test_dataset_rename[True-hub_cloud_ds_generator-hub_cloud_path-hub_cloud_dev_token]:
deeplake/api/tests/test_api.py#L976
deeplake.util.exceptions.BadRequestException: Invalid Request. One or more request parameters is incorrect.
object generator can't be used in 'await' expression
|
|
test_api.test_dataset_rename[False-hub_cloud_ds_generator-hub_cloud_path-hub_cloud_dev_token]:
deeplake/api/tests/test_api.py#L976
deeplake.util.exceptions.BadRequestException: Invalid Request. One or more request parameters is incorrect.
object generator can't be used in 'await' expression
|
|
test_api.test_dataset_deepcopy[True-2-hub_cloud_path-hub_cloud_dev_token]:
deeplake/api/tests/test_api.py#L1036
deeplake.util.exceptions.BadRequestException: Invalid Request. One or more request parameters is incorrect.
object generator can't be used in 'await' expression
|
|
test_views.test_view_token_only:
deeplake/api/tests/test_views.py#L52
deeplake.util.exceptions.BadRequestException: Invalid Request. One or more request parameters is incorrect.
object generator can't be used in 'await' expression
|
|
test_query.test_inplace_dataset_view_save[True-0-False-False-function-False-True-hub_cloud_ds_generator]:
deeplake/core/query/test/test_query.py#L268
deeplake.util.exceptions.InvalidTokenException: Token is invalid. Make sure the full token string is included and try again.
|
|
test_deeplake_vectorstore.test_update_embedding[embedding_fn3-hub_cloud_ds-None-None-None-None-vector_store_query-hub_cloud_dev_token]:
deeplake/core/vectorstore/test_deeplake_vectorstore.py#L1063
deeplake.util.exceptions.BadRequestException: Invalid Request. One or more request parameters is incorrect.
object generator can't be used in 'await' expression
|
|
test_deeplake_vectorstore.test_update_embedding[None-hub_cloud_ds-None-None-None-None-vector_store_query-hub_cloud_dev_token]:
deeplake/core/vectorstore/test_deeplake_vectorstore.py#L1063
deeplake.util.exceptions.BadRequestException: Invalid Request. One or more request parameters is incorrect.
object generator can't be used in 'await' expression
|
|
test_deepmemory.test_deepmemory_evaluate:
deeplake/core/vectorstore/deep_memory/test_deepmemory.py#L189
AssertionError: assert {'recall@1': ...@3': 0.5, ...} == {'recall@1': ...@3': 0.6, ...}
Omitting 4 identical items, use -vv to show
Differing items:
{'recall@1': 0.3} != {'recall@1': 0.4}
{'recall@3': 0.5} != {'recall@3': 0.6}
Full diff:
{
- 'recall@1': 0.4,
? ^
+ 'recall@1': 0.3,
? ^
'recall@10': 0.6,
'recall@100': 0.9,
- 'recall@3': 0.6,
? ^
+ 'recall@3': 0.5,
? ^
'recall@5': 0.6,
'recall@50': 0.7,
}
|
|
Run Benchmarks (linux_gpu)
This request was automatically failed because there were no enabled runners online to process the request for more than 1 days.
|
|
Run Benchmarks (linux_cpu)
This request was automatically failed because there were no enabled runners online to process the request for more than 1 days.
|
|
Run Benchmarks (macos_intel)
This request was automatically failed because there were no enabled runners online to process the request for more than 1 days.
|