Performance issue - batching

[jphribovsek]

We have a use case where we batch import simple objects (5-6 string attributes) in the app from a CSV.
The import loop insert objects in core data, and we save the context only once all objects have been inserted.

• If we ran another device to test syncing performance, it takes about 10 min for changes to make it through
• We also use the REST apis to count the number of objects on the server on a regular basis, and observe around the same time to complete the upload

Based on those observations, the bottleneck seems to be on the uploading side.

[chengfred]

How many objects?

[jphribovsek]

sorry, I forgot that piece: 10,000

[chengfred]

Can you give more details about the use case? (Will there be 10k objects created for every user?, how often? etc)

Some background, we aren't really optimized for the many (more than a few thousand) object case, though it should probably be faster than 10min.

[jphribovsek]

In our first implementation phase, only part of our users would have that use case of importing large number of objects at once. Eventually though, we plan on syncing numerous entities, some of which would have thousands of objects to sync.

[CapoChino]

Yup, this is the exact issue I observed and filed in #208. Jorge improved things by batching, and I think I can live with/work around the current performance, but I too would love to have uploading happen a lot faster. 👍