You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
A test with a ZIP file with highly compressed large data, which when extracted exceed the PDS solutions workspace size, make a PDS job fail. The PDS will simply fail the job, because an exception happens with the message: No space left on device.
The PDS then cleans up the workspace for this job and starts the next job. This could cause problems for other jobs running on the same PDS as well, if someone tries this on purpose e.g. multiple times to create heavy load.
Important Insights
Files are uploaded and extracted
PDS fails the job if the workspace size is not sufficient for the extracted data size
ZIP archives are not extracted recursively, which means no recursive ZIP bombs are possible
Wanted
The ArchiveSupport must be able to check the uploaded sources ZIP file before or while extracting it and fail the job without risking to fail other jobs currently running on the PDS solution.
Discussed solutions
configurable time: Fail the job before extracting everything, if it takes longer than the configured time value to extract an entry.
configurable size: Fail the job before extracting everything, if the stream archive entry is to big
compression rate: Fail the job before extracting everything, if the compression rate is "unusually" high, like 5Kb would extract to like 10GB.
All these options should be configurable via a PDS parameter. This way administrators can adjust these values as needed. A reasonable default value must be set for each parameter.
The text was updated successfully, but these errors were encountered:
winzj
changed the title
PDS ZIP extraction should handle ZIP archives with highly compressed large data more careful
ArchiveSupport ZIP extraction should handle ZIP archives with highly compressed large data more careful
Mar 19, 2024
Situation
A test with a ZIP file with highly compressed large data, which when extracted exceed the PDS solutions workspace size, make a PDS job fail. The PDS will simply fail the job, because an exception happens with the message:
No space left on device
.The PDS then cleans up the workspace for this job and starts the next job. This could cause problems for other jobs running on the same PDS as well, if someone tries this on purpose e.g. multiple times to create heavy load.
Important Insights
Wanted
The
ArchiveSupport
must be able to check the uploaded sources ZIP file before or while extracting it and fail the job without risking to fail other jobs currently running on the PDS solution.Discussed solutions
configurable time
: Fail the job before extracting everything, if it takes longer than the configured time value to extract an entry.configurable size
: Fail the job before extracting everything, if the stream archive entry is to bigcompression rate
: Fail the job before extracting everything, if the compression rate is "unusually" high, like 5Kb would extract to like 10GB.All these options should be configurable via a PDS parameter. This way administrators can adjust these values as needed. A reasonable default value must be set for each parameter.
The text was updated successfully, but these errors were encountered: