Self-hosted outline 0.73.0 import failed

[wangweitung]

Just updated from 0.72.2

When trying to test import from backup,it shows import failed.

More details will upload later.

[wangweitung]

backup file size : 166MB

# Maximum allowed size for the uploaded attachment.
FILE_STORAGE_UPLOAD_MAX_SIZE=2048000000

# Disable SSL for connecting to Postgres
PGSSLMODE=disable
MAXIMUM_IMPORT_SIZE=2048000000

docker log:

{"label":"task","level":"info","message":"ExportTask fetching data for a451e99f-81aa-4400-a97e-54784acd9da1"},
{"event":{"actorId":"34e0709f-0b99-4217-a4c7-257d252bd7d0","createdAt":"2023-11-14T03:59:50.777Z","data":{"collectionId":null,"createdAt":"2023-11-14T03:59:50.494Z","error":null,"format":"json","id":"a451e99f-81aa-4400-a97e-54784acd9da1","name":"Wiki-export.zip","size":"0","state":"creating","type":"export","updatedAt":"2023-11-14T03:59:50.494Z","user":{"avatarUrl":"/api/files.get?key=public/34e0709f-0b99-4217-a4c7-257d252bd7d0/ed1e6418-71c5-4b60-abff-6ee5066b43a8/mmexport1683243494318.jpg","color":"#F5BE31","createdAt":"2023-10-23T07:50:05.559Z","id":"34e0709f-0b99-4217-a4c7-257d252bd7d0","isAdmin":true,"isSuspended":false,"isViewer":false,"lastActiveAt":"2023-11-14T03:59:32.722Z","name":"root","updatedAt":"2023-11-14T03:59:32.724Z"}},"id":"b399dc9d-d089-4096-9c9b-4aa415f3b30b","modelId":"a451e99f-81aa-4400-a97e-54784acd9da1","name":"fileOperations.update","teamId":"9ff440dd-9421-47a9-a805-26d712d2ecc1"},"label":"worker","level":"info","message":"WebhookProcessor running fileOperations.update"},
{"event":{"actorId":"34e0709f-0b99-4217-a4c7-257d252bd7d0","createdAt":"2023-11-14T04:03:29.741Z","data":{"collectionId":null,"createdAt":"2023-11-14T04:02:39.617Z","error":null,"format":"outline-markdown","id":"00707ae1-36c7-4f5e-a13d-8df056eeab51","name":"Wiki-export.zip","size":174571982,"state":"complete","type":"export","updatedAt":"2023-11-14T04:03:29.672Z","user":{"avatarUrl":"/api/files.get?key=public/34e0709f-0b99-4217-a4c7-257d252bd7d0/ed1e6418-71c5-4b60-abff-6ee5066b43a8/mmexport1683243494318.jpg","color":"#F5BE31","createdAt":"2023-10-23T07:50:05.559Z","id":"34e0709f-0b99-4217-a4c7-257d252bd7d0","isAdmin":true,"isSuspended":false,"isViewer":false,"lastActiveAt":"2023-11-14T03:59:32.722Z","name":root","updatedAt":"2023-11-14T03:59:32.724Z"}},"id":"e85ede31-f649-412b-9e37-b61d509700a9","modelId":"00707ae1-36c7-4f5e-a13d-8df056eeab51","name":"fileOperations.update","teamId":"9ff440dd-9421-47a9-a805-26d712d2ecc1"},"label":"worker","level":"info","message":"WebhookProcessor running fileOperations.update"}

[tommoor]

Which storage method are you using? is AWS_S3_UPLOAD_MAX_SIZE set?

[wangweitung]

storage method is local.
AWS_S3_UPLOAD_MAX_SIZE is 2048000000 ,which means 2GB

[wangweitung]

[wangweitung]

{"event":{"actorId":"8f4b0d3a-bb34-4af7-867b-b68e9038ffff","collectionId":null,"createdAt":"2023-11-14T04:58:44.880Z","data":{"name":"Wiki-export.zip"},"documentId":null,"id":"8fa5b699-4aaf-4f07-9bb6-fd6ea56fd47c","ip":"192.168.1.1","modelId":"a64bc8ef-182f-4d3a-9d79-a16e8bc3b10f","name":"attachments.create","teamId":"8a620833-31f4-4b3e-9181-3da75e112626","userId":null},"label":"worker","level":"info","message":"WebhookProcessor running attachments.create"}

[wangweitung]

 resource: the server responded with a status of 413 (Request Entity Too Large)

[tommoor]

Where does this appear? Please provide more context.

[wangweitung]

In firefox browser after pressing F12

[wangweitung]

[wangweitung]

it works well after downgrade to 0.72.2 and import .zip small than 100MB.

[wangweitung]

[tommoor]

I will add some more debugging soon, it seems it's encountering a file after unzipping that should be JSON but isn't. Perhaps some sort of hidden system file? I'm not sure without adding more logs.

[wangweitung]

I just wonder whether you can export backup from any version and import into the latest version without any error？

[tommoor]

The entire import system was rebuilt in 0.73.0, so while there are extensive tests there's probably some new bugs left to find (this being one of them).

For what it's worth, this is not a good backup mechanism as it's very "lossy" – when self-hosting you'd be better off just snapshotting the disk or database.

[wangweitung]

Understood,thx!