Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

tfds.data_source errors #5100

Open
fengyang0317 opened this issue Sep 30, 2023 · 1 comment
Open

tfds.data_source errors #5100

fengyang0317 opened this issue Sep 30, 2023 · 1 comment
Labels
bug Something isn't working

Comments

@fengyang0317
Copy link

fengyang0317 commented Sep 30, 2023

/!\ PLEASE INCLUDE THE FULL STACKTRACE AND CODE SNIPPET

Short description
tfds.data_source does not work as intended.

Environment information

  • Operating System: google colab

  • Python version: google colab

  • tensorflow-datasets/tfds-nightly version: 4.9.3.dev202309300044

  • tensorflow/tf-nightly version: 2.15.0.dev20230929

  • Does the issue still exists with the last tfds-nightly package (pip install --upgrade tfds-nightly) ?
    Yes

Reproduction instructions
There are 5 errors in the colab.
https://colab.research.google.com/drive/1QoIYKYUeM00VeVTElCfnSrQdQL0vfAyQ?usp=sharing

Expected behavior
run the colab without error

Additional context

@fengyang0317 fengyang0317 added the bug Something isn't working label Sep 30, 2023
@marcenacp
Copy link
Collaborator

marcenacp commented Oct 2, 2023

Hi @fengyang0317, thanks for your interest in tfds.data_source. This API is meant to use random access (see the tutorial). There is currently no implementation of random access for GCS. If you have an efficient C++ implementation, please feel free to contribute to array_record.

We should provide a clearer error message, so I'll work on this.

In the meantime, you would have to first prepare the data locally before using tfds.data_source.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

2 participants