Update bugout token #169
nvoxland-aluse-cases-benchmark.yaml
on: push
Start benchmarks ec2
12s
Run Benchmarks
0s
Annotations
16 errors and 1 warning
|
Start benchmarks ec2
Process completed with exit code 1.
|
|
test_pytorch.test_pytorch_data_decode:
deeplake/enterprise/test_pytorch.py#L948
UnicodeDecodeError: 'utf-8' codec can't decode byte 0x90 in position 0: invalid start byte
|
|
test_storage_provider.test_cache[memory_storage,local_storage,hub_cloud_storage]:
deeplake/core/storage/tests/test_storage_provider.py#L1
failed on setup with "deeplake.util.exceptions.GatewayTimeoutException: Activeloop server took too long to respond."
|
|
test_deeplake_vectorstore.test_search_quantitative[MAX]:
deeplake/core/vectorstore/test_deeplake_vectorstore.py#L637
deeplake.util.exceptions.DatasetCorruptError: Exception occurred (see Traceback). The dataset maybe corrupted. Try using `reset=True` to reset HEAD changes and load the previous commit. This will delete all uncommitted changes on the branch you are trying to load.
|
|
test_deepmemory.test_deepmemory_evaluate:
deeplake/core/vectorstore/deep_memory/test_deepmemory.py#L189
AssertionError: assert {'recall@1': ...@3': 0.3, ...} == {'recall@1': ...@3': 0.6, ...}
Omitting 2 identical items, use -vv to show
Differing items:
{'recall@1': 0.1} != {'recall@1': 0.4}
{'recall@50': 0.6} != {'recall@50': 0.7}
{'recall@3': 0.3} != {'recall@3': 0.6}
{'recall@100': 0.7} != {'recall@100': 0.9}
Full diff:
{
- 'recall@1': 0.4,
? ^
+ 'recall@1': 0.1,
? ^
'recall@10': 0.6,
- 'recall@100': 0.9,
? ^
+ 'recall@100': 0.7,
? ^
- 'recall@3': 0.6,
? ^
+ 'recall@3': 0.3,
? ^
'recall@5': 0.6,
- 'recall@50': 0.7,
? ^
+ 'recall@50': 0.6,
? ^
}
|
|
test_storage_provider.test_cache[memory_storage,hub_cloud_storage]:
deeplake/core/storage/tests/test_storage_provider.py#L131
deeplake.util.exceptions.InvalidTokenException: Token is invalid. Make sure the full token string is included and try again.
|
|
test_version_control.test_reset_bug[hub_cloud_ds_generator]:
deeplake/core/version_control/test_version_control.py#L1
failed on setup with "deeplake.util.exceptions.GatewayTimeoutException: Activeloop server took too long to respond."
|
|
test_deepmemory.test_deepmemory_evaluate:
deeplake/core/vectorstore/deep_memory/test_deepmemory.py#L189
AssertionError: assert {'recall@1': ...@3': 0.5, ...} == {'recall@1': ...@3': 0.6, ...}
Omitting 2 identical items, use -vv to show
Differing items:
{'recall@10': 0.5} != {'recall@10': 0.6}
{'recall@1': 0.3} != {'recall@1': 0.4}
{'recall@5': 0.5} != {'recall@5': 0.6}
{'recall@3': 0.5} != {'recall@3': 0.6}
Full diff:
{
- 'recall@1': 0.4,
? ^
+ 'recall@1': 0.3,
? ^
- 'recall@10': 0.6,
? ^
+ 'recall@10': 0.5,
? ^
'recall@100': 0.9,
- 'recall@3': 0.6,
? ^
+ 'recall@3': 0.5,
? ^
- 'recall@5': 0.6,
? ^
+ 'recall@5': 0.5,
? ^
'recall@50': 0.7,
}
|
|
test_json.test_json_transform[lz4-gdrive_ds]:
deeplake/api/tests/test_json.py#L222
deeplake.util.exceptions.TransformError: Transform failed. See traceback for more details.
|
|
test_deepmemory.test_deepmemory_evaluate:
deeplake/core/vectorstore/deep_memory/test_deepmemory.py#L189
AssertionError: assert {'recall@1': ...@3': 0.5, ...} == {'recall@1': ...@3': 0.6, ...}
Differing items:
{'recall@100': 0.8} != {'recall@100': 0.9}
{'recall@5': 0.5} != {'recall@5': 0.6}
{'recall@3': 0.5} != {'recall@3': 0.6}
{'recall@10': 0.5} != {'recall@10': 0.6}
{'recall@50': 0.6} != {'recall@50': 0.7}
{'recall@1': 0.2} != {'recall@1': 0.4}
Full diff:
{
- 'recall@1': 0.4,
? ^
+ 'recall@1': 0.2,
? ^
- 'recall@10': 0.6,
? ^
+ 'recall@10': 0.5,
? ^
- 'recall@100': 0.9,
? ^
+ 'recall@100': 0.8,
? ^
- 'recall@3': 0.6,
? ^
+ 'recall@3': 0.5,
? ^
+ 'recall@5': 0.5,
- 'recall@5': 0.6,
+ 'recall@50': 0.6,
? +
- 'recall@50': 0.7,
}
|
|
test_storage_provider.test_storage_provider[gdrive_storage]:
deeplake/core/storage/tests/test_storage_provider.py#L47
googleapiclient.errors.HttpError: <HttpError 500 when requesting https://www.googleapis.com/upload/drive/v3/files/1uKZSpkzbe2W4-hs9HlPr_B1pmdNFtmbW?alt=json&uploadType=media returned "Internal Error". Details: "[{'message': 'Internal Error', 'domain': 'global', 'reason': 'internalError'}]">
|
|
test_views.test_vds_read_only:
deeplake/api/tests/test_views.py#L103
deeplake.util.exceptions.DatasetCorruptError: Exception occurred (see Traceback). The dataset maybe corrupted. Try using `reset=True` to reset HEAD changes and load the previous commit. This will delete all uncommitted changes on the branch you are trying to load.
|
|
test_views.test_vds_read_only:
deeplake/api/tests/test_views.py#L95
deeplake.util.exceptions.InvalidTokenException: Token is invalid. Make sure the full token string is included and try again.
|
|
test_client.test_deepmemory_delete:
deeplake/client/test_client.py#L1
failed on setup with "deeplake.util.exceptions.GatewayTimeoutException: Activeloop server took too long to respond."
|
|
test_deepmemory.test_deepmemory_evaluate:
deeplake/core/vectorstore/deep_memory/test_deepmemory.py#L189
AssertionError: assert {'recall@1': ...@3': 0.4, ...} == {'recall@1': ...@3': 0.6, ...}
Omitting 1 identical items, use -vv to show
Differing items:
{'recall@100': 0.7} != {'recall@100': 0.9}
{'recall@3': 0.4} != {'recall@3': 0.6}
{'recall@10': 0.5} != {'recall@10': 0.6}
{'recall@5': 0.5} != {'recall@5': 0.6}
{'recall@50': 0.5} != {'recall@50': 0.7}
Full diff:
{
'recall@1': 0.4,
- 'recall@10': 0.6,
? ^
+ 'recall@10': 0.5,
? ^
- 'recall@100': 0.9,
? ^
+ 'recall@100': 0.7,
? ^
- 'recall@3': 0.6,
? ^
+ 'recall@3': 0.4,
? ^
- 'recall@5': 0.6,
? ^
+ 'recall@5': 0.5,
? ^
- 'recall@50': 0.7,
? ^
+ 'recall@50': 0.5,
? ^
}
|
|
test_views.test_view_token_only:
deeplake/api/tests/test_views.py#L1
failed on setup with "deeplake.util.exceptions.InvalidTokenException: Token is invalid. Make sure the full token string is included and try again."
|
|
Start benchmarks ec2
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/checkout@v3, aws-actions/configure-aws-credentials@v1-node16. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
|