Skip to content

Issues: mosaicml/streaming

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

38 Open 87 Closed
38 Open 87 Closed
Author
Filter by author
Label
Filter by label
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Milestones
Filter by milestone
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

clean_stale_shared_memory duplicating the master process when called in a train.py script bug Something isn't working
#663 opened Apr 26, 2024 by antoinedandi
Support large size index.json (20GB +) enhancement New feature or request
#662 opened Apr 25, 2024 by andreamad8
1
Integer overflow and data corruption (uncompressed mds file size is larger than 2^32) bug Something isn't working
#659 opened Apr 22, 2024 by jarnoseppanen-sc
4
Does it support Preference data (for training Reward / DPO)? enhancement New feature or request
#656 opened Apr 17, 2024 by ericxsun
2
Azure Databricks MDS write ops in error: MapInPandas write_mds gives message Spark higher-order functions are not supported in Unity Catalog bug Something isn't working
#655 opened Apr 15, 2024 by wolliq
2
Out of Memory when using Streaming Dataloader bug Something isn't working
#652 opened Apr 13, 2024 by VikaasVarma
9
Augment existing dataset enhancement New feature or request
#646 opened Apr 3, 2024 by LWprogramming
3
GPU utilisation drop between epochs bug Something isn't working
#643 opened Mar 29, 2024 by rishabhm12
20
Integrating MDS Streaming with HF Dataset Streaming enhancement New feature or request
#633 opened Mar 19, 2024 by siddk
8
Reuse S3 session enhancement New feature or request
#622 opened Mar 6, 2024 by wouterzwerink
4
Unexpected mds format data for json encoding / how to encode list of strings bug Something isn't working
#613 opened Feb 28, 2024 by ssharpe42
2
Add support for registering custom Cloud Uploaders enhancement New feature or request
#612 opened Feb 28, 2024 by JAEarly
3
On the fly sample filtering and limiting of datasets enhancement New feature or request
#578 opened Jan 26, 2024 by ssharpe42
3
Making Streaming Dataset framework agnostic: Removing PyTorch dependency enhancement New feature or request
#551 opened Dec 26, 2023 by Abhijit-2592
5
Make caching location optional.
#546 opened Dec 22, 2023 by PengWenChen
9
Advice Needed: handling significant amount of streams
#545 opened Dec 20, 2023 by suessmann
3
Distributed Key Value Tensor Store enhancement New feature or request
#539 opened Dec 16, 2023 by OrenLeung
2
ValueError: cannot reshape array of size 24 into shape (8,newaxis,8) in Dataloader
#535 opened Dec 15, 2023 by germanjke
16
Allow Stream's repeat option to cycle through entire dataset before repeating, when shuffle=True enhancement New feature or request
#521 opened Dec 6, 2023 by m-harmonic
5
merge_index doesn't show path with subfolders
#516 opened Dec 1, 2023 by germanjke
2
option to host files via https/remote being a https url enhancement New feature or request
#511 opened Nov 24, 2023 by felix-red-panda
3
Is StreamingDataset compatible with Ray distributed training?
#503 opened Nov 7, 2023 by genesis-jamin
1
Support for sub-sampling long videos enhancement New feature or request
#489 opened Oct 28, 2023 by con-bren
3
Best strategy to do joint image/video training
#464 opened Oct 9, 2023 by universome
1
How to handle broken samples?
#447 opened Sep 25, 2023 by universome
6
ProTip! Adding no:label will show everything without a label.