Skip to content

Issues: togethercomputer/RedPajama-Data

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

39 Open 47 Closed
39 Open 47 Closed
Author
Filter by author
Label
Filter by label
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Milestones
Filter by milestone
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

slow transfer speeds from URL sources
#113 opened Mar 29, 2024 by axelmagn
5
Difference between RedPajama-Data-1T, RedPajama-Data-V2, RedPajama-Data-V1
#112 opened Mar 27, 2024 by konradipipan
1
Inconsistent IDs lead to distributed computing woes.
#111 opened Mar 20, 2024 by axelmagn
1
Spanish artifact building error
#110 opened Mar 20, 2024 by hicotton02
2
Potential Language Contamination Inquiry
#108 opened Mar 13, 2024 by iBibek
1
Step 2) "Invalid option: ---input_base_uri"
#107 opened Mar 5, 2024 by timpal0l
1
What purpose cutoff.csv used in the cc_net pipeline?
#106 opened Feb 26, 2024 by kemalbastak
2
About the final result
#105 opened Feb 22, 2024 by Jdemon233
2
Running the pipeline on cloud or a big data platform
#104 opened Feb 21, 2024 by zllai
1
Running full pipeline on a small part of CC
#103 opened Feb 5, 2024 by zhentingqi
Unavailable Parameters
#102 opened Feb 5, 2024 by zhentingqi
Recommended way to load wget-downloaded data using HF datasets API?
#100 opened Jan 16, 2024 by zijwang
1
what's the specific meaning of dsir?
#99 opened Jan 16, 2024 by BBetteroff
4
Other language data
#93 opened Dec 22, 2023 by Dzg0309
4
Thresholds for all quality signals
#92 opened Dec 19, 2023 by torshie
2
Token counts
#88 opened Nov 22, 2023 by timsueberkrueb
2
regarding to quality classifier
#86 opened Nov 20, 2023 by kimcando
@mauriceweber
2
Invalid argument when running cc_net
#82 opened Nov 7, 2023 by Practicinginhell
2
Executing V2 issues
#80 opened Nov 1, 2023 by hicotton02
6
regarding to deduplication
#79 opened Nov 1, 2023 by kimcando
5
New Features enhancement New feature or request
#76 opened Oct 31, 2023 by zhangce
@mauriceweber
Issue on book datasets download
#74 opened Oct 30, 2023 by beccabai
2
Specifying arxiv dates
#71 opened Aug 24, 2023 by matthieumeeus
1
What does "default" do in load_dataset('togethercomputer/RedPajama-Data-1T', "default")?
#70 opened Aug 21, 2023 by brando90
3
Q: Why does RePajama exist? what problem are you solving?
#69 opened Aug 21, 2023 by brando90
1
ProTip! Type g i on any issue or pull request to go back to the issue listing page.