Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Pickling error running CytoselfFullTrainer #33

Open
sheryllin111 opened this issue Nov 14, 2023 · 2 comments
Open

Pickling error running CytoselfFullTrainer #33

sheryllin111 opened this issue Nov 14, 2023 · 2 comments

Comments

@sheryllin111
Copy link

Hi, I've installed cytoself via cloning from this repo / dev instructions and tried running the example scripts but ran into this error.
Screenshot 2023-11-14 151158
Screenshot 2023-11-14 151215

@gitclipp
Copy link

The error can be avoided by removing parallel processing from the dataloader like shown in the example below:

from cytoself.datamanager.opencell import DataManagerOpenCell

data_ch = ['pro', 'nuc']
datapath = 'Testdata' # path to download sample data
DataManagerOpenCell.download_sample_data(datapath) # donwload data
datamanager = DataManagerOpenCell(datapath, data_ch, fov_col=None)
datamanager.const_dataloader(batch_size=32, num_workers=1, label_name_position=1)
datamanager.train_loader.num_workers=0
datamanager.val_loader.num_workers=0
datamanager.test_loader.num_workers=0

@li-li-github
Copy link
Collaborator

Thank you @gitclipp for finding a solution. This seems a specific problem on windows. I have no problem running it on Ubuntu, and I do have problem of Can't pickle on windows. I've also seen issues on multiprocessing when running pytorch on windows. There might be some compatibility issues between recent python's multiprocessing and windows.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants