Sunday 26 January 2020

Split compression

Maybe my searches are wrong or it really just as easy as splitting the pre-compressed file and reassembling after; but I was wondering how to go about compressing into multiple parts. I'm using lzutf8 but can easily switch to zlib/pako/whatever.I've tested a few scenarios and the server-side compression/decompression is better performance and less complexity then other options (i.e. file storage with metadata pointer). The rub is that I want to specify the compressed chunk size and not arbitrarily split the data before compression. Should I just be splitting it up after I receive the compressed data or do any libraries actually support this?

Submitted January 26, 2020 at 09:49AM by TheLimpingNinja

No comments:

Post a Comment