Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

huggingface数据进度 #30

Open
guozhiyao opened this issue Jul 26, 2023 · 3 comments
Open

huggingface数据进度 #30

guozhiyao opened this issue Jul 26, 2023 · 3 comments

Comments

@guozhiyao
Copy link

请问下,我看7月19日已处理了5357GB的数据,那huggingface上目前上传了多少数据呢?

@silverriver
Copy link

huggingface上已经上传的数据可以在数据集首页上查看到,具体的数据量可以看一下已经上传的数据文件。在huggingface上上传的文件是经过进一步清洗之后的数据。

@esbatmop
Copy link
Owner

esbatmop commented Aug 4, 2023

我们目前只有silverriver一位同学负责huggingface的数据上传,因为huggingface的水管太小,且即便开了vpn,传输仍然容易中断,所以往huggingface上放数据的进度有点慢。

@Byshev333
Copy link

我们目前只有silverriver一位同学负责huggingface的数据上传,因为huggingface的水管太小,且即便开了vpn,传输仍然容易中断,所以往huggingface上放数据的进度有点慢。

我下载了huggingface上的所有数据,一共有376G,这正常的数据量级吗?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants