Steam updates and extreme disk usage.
OK so this has been bugging me for some time. Why is the disk usage for updates on Steam so high? Sustained 30-50 MB/s (Megabytes per second) for a duration of several minutes (at least 4 minutes) for (using the latest update as an example) a 270.9 MB update (image below). Doing some quick math assuming an average on the low end of 30 MB/s for even 3 minutes equates to 5.4 GB of "Disk Usage" when installing an update that is reported to be 270.9 MB. That is almost 20 times the size of the update that was downloaded. I've seen some impressive compression ratios before but I'm pretty sure 20:1 is way outside the realm of possibility. I see 2 possible explanations for this discrepancy.
1. The information displayed by Steam is wrong. Based on the amount of time taken to download the update and the time to actually install it I find this to be the least likely. 2. The method used by Steam to update the files (for example Content.ggpk) is horribly inefficient (almost as if it is unpacking and then repacking the Content.ggpk for each file that is being updated instead of unpacking it once, updating all the files, then repacking it. Based on the long Preallocation time, short download time, and extremely long install time this seems the likely culprit. Last edited by AgentX2009 on May 3, 2018, 3:39:19 AM Last bumped on May 4, 2018, 10:42:52 AM
|
|
Ask steam? it's their platform and their method of patching, GGG only provide the with the patch.
Ancestral Bond. It's a thing that does stuff. -Vipermagi
He who controls the pants controls the galaxy. - Rick & Morty S3E1 |
|
I did and their responses were about as useful/helpful as a nail in the foot.
" " Last edited by AgentX2009 on May 3, 2018, 10:12:33 AM
|
|
The problem is how steam works, when you update a game the steam client creates a backup of the core game files on a temporary folder till it's done patching. Steam does this for any random game update regardless of the real patch size, which can be annoying if you are low on disk space and steam keep asking for like 50 gb to just download a random 1 mb patch for a some random game for example.
Last edited by SaintLucifer on May 3, 2018, 5:43:10 PM
|
|
But it doesn't do this for every game. Just a few. This is the one I notice most often because of the large number of small patches. I've had a less than 10 MB patch for POE take over 10 minutes. 2-3 minutes of preallocation. A few seconds to actually download it. Then several more minutes to actually apply the patch. Then there are other games like PUBG, Far Cry 5, or Streets of Rogue that have larger updates (100's of MB to a GB or two) that take the same amount of time or less. In all of these examples the disk activity is usually no more that twice the amount of data downloaded whereas POE can have 20 times the amount of disk activity compared to the size of the download. While writing this a patch went out for DayZ. 10 MB patch. Took a grand total of 20 seconds to preallocate, download, and install the patch. If that had been for POE it would take at least 5 minutes. Probably closer to 10. POE is not the only game that has these issues with very long install times. It is as I said the one I tend to notice because of frequent updates. Also just to test things I just uninstalled POE and reinstalled it. For the 9.5 GB install it took 3 minutes and 15 seconds to preallocate the disk space and a total of 9 minutes and 58 seconds to complete the entire install. That said I would love it if someone can explain to me why it takes the same amount of time to install the entire 9.5 GB game as it does to apply a 270 MB patch for the game. Or a 10 MB one for that matter. Also this issue is unique to the Steam version as I've been on Discord with my brother when a patch came out and he isn't using the Steam version. His patch took a matter of seconds to apply (however long the actual download took) while mine was still preallocating.
Also the only reason I'm making such an issue of this is that while it's patching my CPU is running full tilt and my system slows down quite a bit not to mention the excessive work load being placed on the HDD during each update. A 270 MB update shouldn't max out my CPU and HDD for 10 minutes straight. Last edited by AgentX2009 on May 4, 2018, 10:26:45 AM
|
|
Just another example PUBG had a 30 MB update that took seconds to apply. I literally clicked the button and it was done. No 3 minutes of preallocating. No 10 minutes spent installing a minuscule patch. It seems less an issue with how patches are handled on Steam and more so how PoE's patches are handled on Steam.
Last edited by AgentX2009 on May 4, 2018, 10:43:09 AM
|
|