Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Failure of ipfs-cluster-ctl ipfs gc results in inconsistent storage files. #1993

Open
sdjasj opened this issue Nov 3, 2023 · 1 comment
Open
Labels
kind/bug A bug in existing code (including security flaws) need/triage Needs initial labeling and prioritization

Comments

@sdjasj
Copy link

sdjasj commented Nov 3, 2023

Additional information:

  • OS: Ubuntu 22.04.3 LTS
  • IPFS Cluster version: 1.0.7
  • Installation method: built from source

Describe the bug:

I am running 5 IPFS-CLUSTER-SERVICE nodes, and they are interconnected. I am running multiple commands simultaneously on each node using a Python script, including ipfs-cluster-ctl add, ipfs-cluster-ctl pin add, ipfs-cluster-ctl pin rm, and ipfs-cluster-ctl ipfs gc. After running the script for a while, I noticed that when multiple ipfs-cluster-ctl ipfs gc commands are running simultaneously, the ipfs-cluster-ctl ipfs gc command seems to get stuck and cannot complete.This leads to inconsistent storage files among the nodes

The logs for ipfs daemon are as follows:
output1.log

The logs for ipfs-cluster-service are as follows:
output2.zip

@sdjasj sdjasj added kind/bug A bug in existing code (including security flaws) need/triage Needs initial labeling and prioritization labels Nov 3, 2023
@hsanjuan
Copy link
Collaborator

hsanjuan commented Nov 9, 2023

This is a Kubo thing mostly. gc needs to grab a lock and cannot proceed while something is pinning , I think. Cluster is limited here wrt what it can do.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
kind/bug A bug in existing code (including security flaws) need/triage Needs initial labeling and prioritization
Projects
None yet
Development

No branches or pull requests

2 participants