The first Free up space after a big first snapshot takes long on Unity games #92

Closed
opened 2026-10-24 17:14:00 -05:00 by ethan-hann · 0 comments
Owner

A first snapshot of 7 Days to Die (21.5 GB, 18089 files, Windows) took 4 minutes, and the routine Free up space that starts right after it (more than 5000 loose objects, D13.17) took much longer. Captures write loose objects without compression (D50); the routine repack then reads every one back, compresses it with zlib's default level and runs a delta search on it unless D16's -delta list names its type. That list covers archives, media and common game containers (pak, bsa, ba2, vpk, pck and so on) but no Unity formats, and 7 Days to Die is mostly Unity data: by size, .bundle 13.97 GB (285 files), .wav 1.89 GB, .raw 0.95 GB, .tts 0.72 GB, .mesh 0.54 GB, plus .assets/.resS in other Unity games.

Measure before changing anything, on a copy of the store (never the player's), with the time and the resulting store size for each: the current setup; Unity's already-compressed types (bundle, assets, resS, resource, unity3d and the like; check which are really compressed) added to the -delta list; and a lower compression level or no zlib for large objects in the routine repack. Judge the result on a mid-range PC as well as a fast one (the drive and core count matter), keep update rollback intact, and keep small saves and configs compressed. Record the numbers here and in the decisions (D16/D50), then ship the setting that wins.

A first snapshot of 7 Days to Die (21.5 GB, 18089 files, Windows) took 4 minutes, and the routine Free up space that starts right after it (more than 5000 loose objects, D13.17) took much longer. Captures write loose objects without compression (D50); the routine repack then reads every one back, compresses it with zlib's default level and runs a delta search on it unless D16's `-delta` list names its type. That list covers archives, media and common game containers (pak, bsa, ba2, vpk, pck and so on) but no Unity formats, and 7 Days to Die is mostly Unity data: by size, `.bundle` 13.97 GB (285 files), `.wav` 1.89 GB, `.raw` 0.95 GB, `.tts` 0.72 GB, `.mesh` 0.54 GB, plus `.assets`/`.resS` in other Unity games. Measure before changing anything, on a copy of the store (never the player's), with the time and the resulting store size for each: the current setup; Unity's already-compressed types (`bundle`, `assets`, `resS`, `resource`, `unity3d` and the like; check which are really compressed) added to the `-delta` list; and a lower compression level or no zlib for large objects in the routine repack. Judge the result on a mid-range PC as well as a fast one (the drive and core count matter), keep update rollback intact, and keep small saves and configs compressed. Record the numbers here and in the decisions (D16/D50), then ship the setting that wins.
ethan-hann added this to the 1.0 milestone 2026-10-24 17:14:00 -05:00
Sign in to join this conversation.
No milestone
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set

Reference
ethan-hann/SavePoint#92
No description provided.