Running out of disk space, how to troubleshoot?

[langri-sha]

Hi everyone! I changed my codespace's machine type to 8-core, to get 64G of disk space. I'm constantly running out of space, and this is what I get with ncdu /:

So it looks as though I should have plenty to spare, but then looking at df -h:

Filesystem      Size  Used Avail Use% Mounted on
overlay          63G   57G  3.2G  95% /
tmpfs            64M     0   64M   0% /dev
tmpfs           7.9G     0  7.9G   0% /sys/fs/cgroup
shm              64M     0   64M   0% /dev/shm
/dev/sda1        29G   15G   15G  51% /usr/sbin/docker-init
/dev/loop0       63G   57G  3.2G  95% /workspaces
/dev/sdb1        63G  192K   60G   1% /tmp

Any suggestions on what I could do? Last time I've reached this point, I destroyed the codespace and started over, but I'd like to avoid doing that this time around.

[langri-sha]

After running sudo ncdu / instead I was able to notice a lot of space taken up by dangling Docker build caches 🌞.

[Ronnie-personal]

@langri-sha Would you mind if I ask a question? How did you get 64GB space on the '/' volume? I tried to create a new codespace or change machine type for an existing codespace, however the only option for disk is 32GB.

[AndnixSH]

I believe he have access to better machines with 64 gb space. I still don't have access to better machines even I subscribed to Github PRO

[Ronnie-personal]

Same here.
I upgraded my personal GitHub account from the free to the PRO plan; however, the available machine types for Codespaces remain the same, with options for 2 or 4 cores and 32GB of disk space.

[MikeRecognex]

My workspace had jetbrains installed by default and this was taking 12 GB. Is this normal..? Also please see below issue with docker

@xxxxx ➜ /workspaces/xx (main) $ du -ah /workspaces | sort -rh | head -20
12G /workspaces/.codespaces/shared/editors/jetbrains
12G /workspaces/.codespaces/shared/editors
12G /workspaces/.codespaces/shared
12G /workspaces/.codespaces
12G /workspaces
3.6G /workspaces/.codespaces/shared/editors/jetbrains/idea-IU-231.8770.65
3.4G /workspaces/.codespaces/shared/editors/jetbrains/JetBrainsRider-2023.1
2.4G /workspaces/.codespaces/shared/editors/jetbrains/idea-IU-231.8770.65/plugins
2.3G /workspaces/.codespaces/shared/editors/jetbrains/pycharm-2023.1.1
2.1G /workspaces/.codespaces/shared/editors/jetbrains/RubyMine-2023.1.1
1.4G /workspaces/.codespaces/shared/editors/jetbrains/JetBrainsRider-2023.1/lib
1.3G /workspaces/.codespaces/shared/editors/jetbrains/JetBrainsRider-2023.1/plugins
1.1G /workspaces/.codespaces/shared/editors/jetbrains/pycharm-2023.1.1/plugins
886M /workspaces/.codespaces/shared/editors/jetbrains/RubyMine-2023.1.1/plugins
665M /workspaces/.codespaces/shared/editors/jetbrains/idea-IU-231.8770.65/lib
631M /workspaces/.codespaces/shared/editors/jetbrains/pycharm-2023.1.1/lib
605M /workspaces/.codespaces/shared/editors/jetbrains/RubyMine-2023.1.1/lib
601M /workspaces/.codespaces/shared/editors/jetbrains/JetBrainsRider-2023.1/lib/app.jar
596M /workspaces/.codespaces/shared/editors/jetbrains/JetBrainsRider-2023.1/lib/ReSharperHost
502M /workspaces/.codespaces/shared/editors/jetbrains/idea-IU-231.8770.65/lib/app.jar
@XX ➜ /workspaces/xx (main) $ find ~ -name 'jetbrains' -exec rm -rf {} +

@XX➜ /workspaces/xx (main) $
@XX ➜ /workspaces/xx (main) $ du -ah /workspaces | sort -rh | head -20
12G /workspaces/.codespaces/shared/editors/jetbrains
12G /workspaces/.codespaces/shared/editors
12G /workspaces/.codespaces/shared
12G /workspaces/.codespaces
12G /workspaces
3.6G /workspaces/.codespaces/shared/editors/jetbrains/idea-IU-231.8770.65
3.4G /workspaces/.codespaces/shared/editors/jetbrains/JetBrainsRider-2023.1
2.4G /workspaces/.codespaces/shared/editors/jetbrains/idea-IU-231.8770.65/plugins
2.3G /workspaces/.codespaces/shared/editors/jetbrains/pycharm-2023.1.1
2.1G /workspaces/.codespaces/shared/editors/jetbrains/RubyMine-2023.1.1
1.4G /workspaces/.codespaces/shared/editors/jetbrains/JetBrainsRider-2023.1/lib
1.3G /workspaces/.codespaces/shared/editors/jetbrains/JetBrainsRider-2023.1/plugins
1.1G /workspaces/.codespaces/shared/editors/jetbrains/pycharm-2023.1.1/plugins
886M /workspaces/.codespaces/shared/editors/jetbrains/RubyMine-2023.1.1/plugins
665M /workspaces/.codespaces/shared/editors/jetbrains/idea-IU-231.8770.65/lib
631M /workspaces/.codespaces/shared/editors/jetbrains/pycharm-2023.1.1/lib
605M /workspaces/.codespaces/shared/editors/jetbrains/RubyMine-2023.1.1/lib
601M /workspaces/.codespaces/shared/editors/jetbrains/JetBrainsRider-2023.1/lib/app.jar
596M /workspaces/.codespaces/shared/editors/jetbrains/JetBrainsRider-2023.1/lib/ReSharperHost
502M /workspaces/.codespaces/shared/editors/jetbrains/idea-IU-231.8770.65/lib/app.jar
@xxxxxx ➜ /workspaces/xx (main) $ rm -rf /workspaces/.codespaces/shared/editors/jetbrains
@XXXXXXX ➜ /workspaces/xx (main) $ du -ah /workspaces | sort -rh | head -20
24M /workspaces
22M /workspaces/x
21M /workspaces/xx/src/haystack-ai
21M /workspaces/xx/src
11M /workspaces/xxsrc/haystack-ai/.git/objects/pack
11M /workspaces/xx/src/haystack-ai/.git/objects
11M /workspaces/xx/src/haystack-ai/.git
5.3M /workspaces/xx/src/haystack-ai/.git/objects/pack/pack
4.3M /workspaces/xx/src/haystack-ai/.git/objects/pack/.pack
4.0M /workspaces/xx/src/haystack-ai/docs
3.9M /workspaces/xx/src/haystack-ai/docs/img
2.2M /workspaces/xx/src/haystack-ai/test
1.7M /workspaces/.codespaces
1.4M /workspaces/xx/src/haystack-ai/releasenotes/notes
1.4M /workspaces/xx/src/haystack-ai/releasenotes
1.4M /workspaces/xx/src/haystack-ai/haystack
1.3M /workspaces/.codespaces/.persistedshare
1.1M /workspaces/xx/src/haystack-ai/test/test_files
1.1M /workspaces/xx/src/haystack-ai/docs/img/main_example.gif
852K /workspaces/xx/src/haystack-ai/proposals
@xxxxxxxx ➜ /workspaces/Recostack (main) $ du -ah /workspaces | sort -rh | head -20
24M /workspaces
22M /workspaces/xx
21M /workspaces/xx/src/haystack-ai
21M /workspaces/xx/src
11M /workspaces/xx/src/haystack-ai/.git/objects/pack
11M /workspaces/xx/src/haystack-ai/.git/objects
11M /workspaces/xx/src/haystack-ai/.git
5.3M /workspaces/xx/src/haystack-ai/.git/objects/pack/pack-bad9dd3fd5b3d8ac89c7bbeb03b40158bdf1ac64.pack
4.3M /workspacesxx/src/haystack-ai/.git/objects/pack/pack-85567a276ab53de73f88e71a997f85884385ef2d.pack
4.0M /workspaces/xxx/src/haystack-ai/docs
3.9M /workspaces/xxsrc/haystack-ai/docs/img
2.2M /workspaces/xx/src/haystack-ai/test
1.7M /workspaces/.codespaces
1.4M /workspaces/xx/src/haystack-ai/releasenotes/notes
1.4M /workspaces/xx/src/haystack-ai/releasenotes
1.4M /workspaces/xxsrc/haystack-ai/haystack
1.3M /workspaces/.codespaces/.persistedshare
1.1M /workspaces/xxsrc/haystack-ai/test/test_files
1.1M /workspaces/xx/src/haystack-ai/docs/img/main_example.gif
852K /workspaces/xx/src/haystack-ai/proposals

please explain below....

@xxx ➜ /workspacesxxx(main) $ df -h /var/lib/docker
Filesystem Size Used Avail Use% Mounted on
/dev/loop3 32G 15G 16G 49% /var/lib/docker
@XX➜ /workspaces/xx(main) $ cd /var/lib/docker
bash: cd: /var/lib/docker: Permission denied
@xxx ➜ /workspaces/xx (main) $ ls /var/lib/docker
ls: cannot open directory '/var/lib/docker': Permission denied
@xxx➜ /workspaces/xx (main) $ docker images --format "table {{.Repository}}\t{{.Tag}}\t{{.Size}}"
REPOSITORY TAG SIZE
@XX ➜ /workspaces/xxx (main) $ docker images -f "dangling=true" -q
@XX➜ /workspaces/xx (main) $ docker builder prune
WARNING! This will remove all dangling build cache. Are you sure you want to continue? [y/N] y
Total: 0B
@XX➜ /workspaces/xxx(main) $ docker volume ls
DRIVER VOLUME NAME
@xxx ➜ /workspaces/xxx(main) $ docker system prune -a --volumes
WARNING! This will remove:

• all stopped containers
• all networks not used by at least one container
• all anonymous volumes not used by at least one container
• all images without at least one container associated to them
• all build cache

Are you sure you want to continue? [y/N] y
Total reclaimed space: 0B
@XX➜ /workspaces/Recostack (main) $ df -h /var/lib/docker
Filesystem Size Used Avail Use% Mounted on
/dev/loop3 32G 15G 16G 49% /var/lib/docker
@XX ➜ /workspaces/xx (main) $