Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Redundant file uploads when applying delta #5148

Open
idantene opened this issue Mar 26, 2024 · 3 comments
Open

Redundant file uploads when applying delta #5148

idantene opened this issue Mar 26, 2024 · 3 comments

Comments

@idantene
Copy link

Describe the issue

(See original comment here)

In my project we have a couple of raster layers, a locked vector layer (geopackage, set to Directly access data source), and a field collection vector layer (also geopackage).
When updating anything in the field collection layer and pushing the updates to the cloud, the Delta Apply job uploads (or attempts to upload) the raster layers and the locked vector layer as well.
Looking at the python SDK and the logs, it seems that:

  • The raster layers have the exact same checksum, but are still being uploaded. Based on the SDK code, it would entail that their name attribute in the local and remote projects are not identical, which is odd.
  • The locked vector layer has a different checksum (though exact same size), even though I can confirm it has not been changed.

Since our locked vector layer is quite large, it can also exceed the 10min processing time and result in a failed job.

Reproduction steps

Steps to reproduce the behavior:

  1. Create a new project with raster layers and vector layers.
  2. Set the raster layers and all-but-the-data vector layer to Directly access data source
  3. Set the data vector layer to Offline editing
  4. Modify the data vector layer and inspect the logs output.

Expected behavior

I'd expect only the modified layer to be uploaded.

Observed behavior

It seems all raster and vector layers are, at the very least, reported to be uploading.

Screenshots and GIFs

A bit redacted, but color highlights to match the filenames.

qfield_upload_issue
@suricactus
Copy link
Collaborator

Thanks for the nice and detailed report! Highly appreciated.

We are aware of this issue and discussed this morning we should prioritize it in our development plan for the next few weeks. Will keep you updated in this issue here.

@idantene
Copy link
Author

Thanks @suricactus, looking forward for updates :)

@idantene
Copy link
Author

idantene commented May 2, 2024

Hey @suricactus,

Are there any updates on this front? I believe some of our users cannot sync the project because of this.
Specifically, the Package job fails when it attempts to upload larger files (i.e. the orange one in the image above).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants