Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

acd_cli mount delayed file size update #517

Open
tcf909 opened this issue Jan 19, 2017 · 2 comments
Open

acd_cli mount delayed file size update #517

tcf909 opened this issue Jan 19, 2017 · 2 comments

Comments

@tcf909
Copy link

tcf909 commented Jan 19, 2017

Hello,

I noticed that when copying data to a acd_cli fuse mount, it takes some time for the filesize to show up (seems like something is syncing in the background). This causing things like rclone copy/sync to fail -- as the "copy" actually completes, but the filesystem represents the new file as zero bytes so the tool things the copy was corrupt and attempts to remove the file and try again.

Is there a setting to adjust this / fix this?

root@plex-4061255546-ilv6u:/data/.Vault2-raw# cp /config/file.mkv ./ && ls -l
total 0
-rwxrwxrw- 1 root root          0 Jan 18 22:33 file.mkv
root@plex-4061255546-ilv6u:/data/.Vault2-raw# ls -l
total 0
-rwxrwxrw- 1 root root          0 Jan 18 22:33 file.mkv
root@plex-4061255546-ilv6u:/data/.Vault2-raw# ls -l
total 0
-rwxrwxrw- 1 root root          0 Jan 18 22:33 file.mkv
root@plex-4061255546-ilv6u:/data/.Vault2-raw# ls -l
total 0
-rwxrwxrw- 1 root root          0 Jan 18 22:33 file.mkv
root@plex-4061255546-ilv6u:/data/.Vault2-raw# ls -l
total 0
-rwxrwxrw- 1 root root          0 Jan 18 22:33 file.mkv
root@plex-4061255546-ilv6u:/data/.Vault2-raw# ls -l
total 0
-rwxrwxrw- 1 root root          0 Jan 18 22:33 file.mkv
root@plex-4061255546-ilv6u:/data/.Vault2-raw# ls -l
total 0
-rwxrwxrw- 1 root root          0 Jan 18 22:33 file.mkv
root@plex-4061255546-ilv6u:/data/.Vault2-raw# ls -l
total 0
-rwxrwxrw- 1 root root          0 Jan 18 22:33 file.mkv
root@plex-4061255546-ilv6u:/data/.Vault2-raw# ls -l
total 0
-rwxrwxrw- 1 root root          0 Jan 18 22:33 file.mkv
root@plex-4061255546-ilv6u:/data/.Vault2-raw# ls -l
total 0
-rwxrwxrw- 1 root root          0 Jan 18 22:33 file.mkv
root@plex-4061255546-ilv6u:/data/.Vault2-raw# ls -l
total 0
-rwxrwxrw- 1 root root          0 Jan 18 22:33 file.mkv
root@plex-4061255546-ilv6u:/data/.Vault2-raw# ls -l
total 0
-rwxrwxrw- 1 root root          0 Jan 18 22:33 file.mkv
root@plex-4061255546-ilv6u:/data/.Vault2-raw# ls -l
total 0
-rwxrwxrw- 1 root root          0 Jan 18 22:33 file.mkv
root@plex-4061255546-ilv6u:/data/.Vault2-raw# ls -l
total 0
-rwxrwxrw- 1 root root          0 Jan 18 22:33 file.mkv
root@plex-4061255546-ilv6u:/data/.Vault2-raw# ls -l
total 0
-rwxrwxrw- 1 root root 1509877298 Jan 18 22:34 file.mkv

acd_cli version: acd_cli 0.3.2, api 0.9.2

I'm running on an AWS cloud instance (r4.xlarge) in the US-EAST-1 data center ( 2ms or less to ACD gateway).

Hoping to get this resolve, any guidance would be much appreciated.

@bgemmill
Copy link

acdcli creates files in a two step process, a 0 byte create call followed by an overwrite call. Under normal operation, acdcli cp calls should block until completion. If your ls -al calls are coming from a different thread/terminal, that's the behavior they'd see.

#374 fixes this somewhat since it'll return the write back cache size if the file hasn't yet been uploaded to amazon.

@tcf909
Copy link
Author

tcf909 commented Jan 23, 2017

The blocking definitely isn't happening. The command

cp file.test ./mount/ && ls -l 

Will show 0 for the file. The real problem is that any program that requires a validation of file size after a copy operation (rclone or rsync) fails and continuously retries.

Definitely doesn't feel like expected behavior.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants