Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

bug: large MFS breaks files screen #2118

Open
warboy77 opened this issue Jun 8, 2023 · 11 comments
Open

bug: large MFS breaks files screen #2118

warboy77 opened this issue Jun 8, 2023 · 11 comments
Labels
area/screen/files Issues related to Files screen effort/weeks Estimated to take multiple weeks kind/bug A bug in existing code (including security flaws) need/analysis Needs further analysis before proceeding P2 Medium: Good to have, but can wait until someone steps up status/blocked Unable to be worked further until needs are met topic/windows Windows specific

Comments

@warboy77
Copy link

warboy77 commented Jun 8, 2023

My "file " is not opening . I have been uploading my nft on my ipfs desktop . So far I have uploaded 60gb but it started getting slower to load , then eventually it stopped loading .

To Reproduce
Steps to reproduce the behavior:

  1. Go to 'File'
  2. Click on it
  3. See error 404

Expected behavior
It is meant to load my folders I have stored .

Screenshots
If applicable, add screenshots to help explain your problem.

Desktop (please complete the following information):

  • OS: [WINDOWS]
  • Version [LATEST]

IPFS ISSUE

@warboy77 warboy77 added the need/triage Needs initial labeling and prioritization label Jun 8, 2023
@welcome
Copy link

welcome bot commented Jun 8, 2023

Thank you for submitting your first issue to this repository! A maintainer will be here shortly to triage and review.
In the meantime, please double-check that you have provided all the necessary information to make this process easy! Any information that can help save additional round trips is useful! We currently aim to give initial feedback within two business days. If this does not happen, feel free to leave a comment.
Please keep an eye on how this issue will be labeled, as labels give an overview of priorities, assignments and additional actions requested by the maintainers:

  • "Priority" labels will show how urgent this is for the team.
  • "Status" labels will show if this is ready to be worked on, blocked, or in progress.
  • "Need" labels will indicate if additional input or analysis is required.

Finally, remember to use https://discuss.ipfs.io if you just need general support.

@warboy77
Copy link
Author

please can this be reviewed

@SgtPooki
Copy link
Member

@warboy77 can you upload your log files?

@warboy77
Copy link
Author

error.log
combined.log

@warboy77
Copy link
Author

@SgtPooki please can you help . I am a newbie

@SgtPooki
Copy link
Member

@warboy77 I can't see any obvious issues in the logs unfortunately.

the only thing I can think of is that there is some memory/rendering bug in files screen when rendering a large number of files, I will attempt to look at this when I can, but will be pretty busy in the next few weeks.

@SgtPooki SgtPooki added kind/bug A bug in existing code (including security flaws) P2 Medium: Good to have, but can wait until someone steps up and removed need/triage Needs initial labeling and prioritization labels Jun 14, 2023
@SgtPooki
Copy link
Member

60GB is pretty large.. but it should be working. I recently added a large portion of the wikipedia mirror to my local repo (increased total files sizes from 3gb to something like 300gb) and experienced some bugs with rendering myself, but these were resolved simply by clicking outside of the files screen and back. Does that resolve your issue?

Can you see any files? The more information you provide around what is happening, the easier it will be to figure out what is happening so we can solve the issue.

@SgtPooki SgtPooki added status/blocked Unable to be worked further until needs are met area/screen/files Issues related to Files screen need/analysis Needs further analysis before proceeding effort/weeks Estimated to take multiple weeks topic/windows Windows specific labels Jun 14, 2023
@SgtPooki SgtPooki mentioned this issue Jun 14, 2023
@warboy77
Copy link
Author

I created a folder on IPFS and was loading the NFT pictures in batches. It got slower to open and load the folder after every batch. During the last upload, I just opened folder I created. Without waiting for all the images in it to load , I began uploading. After uploading, I restarted my system like I always do after every upload ... then the file stopped loading and was giving the 404 error. Is it advisable to uninstall and wipe data .. then reinstall and upload again? I happen to be in a rush Sir @SgtPooki . Thank you .. I

@SgtPooki
Copy link
Member

you should be able to access the files in MFS via the kubo API if you're familiar with the command line terminal. (Seems like you may be since you're referencing batching)

If your goal is to just add the content to ipfs, you may want to try adding via Kubo cli and then running the daemon and visualizing via the local gateway?

If not, the quickest way forward is to clear out your .ipfs directory and start over (if you don't have anything else you need to keep).

Unfortunately, I think loading the same data again will result in the same error with ipfs-desktop.

If you do find that a certain batch of NFTS (file/cid) is at fault, or that its specifically a certain data size, please let us know.

One other option you may try is splitting the nfts your adding into separate folders, instead of all in the same folder?

@warboy77
Copy link
Author

Thank you for your reply . Please I am not familiar with the command line terminal . Can you point me to any video or steps i can take. At this point I just want to add the remaining files and copy the CID number for pinning . I did not copy it earlier. Thank you

@SgtPooki SgtPooki changed the title FILE NOT OPENING bug: large MFS breaks files screen Oct 26, 2023
@SgtPooki
Copy link
Member

@warboy77 Are you still blocked?

  1. Can you explain more about what you're doing?
  2. How are you pinning your content?

if you're not familiar or comfortable with command line tools, I'm afraid it may be a while until we can unblock you, but you may be able to find others who have run into similar situations on discuss.ipfs.tech.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/screen/files Issues related to Files screen effort/weeks Estimated to take multiple weeks kind/bug A bug in existing code (including security flaws) need/analysis Needs further analysis before proceeding P2 Medium: Good to have, but can wait until someone steps up status/blocked Unable to be worked further until needs are met topic/windows Windows specific
Projects
No open projects
Status: Planned / Backlog
Development

No branches or pull requests

2 participants