On 08/10/2018 16.10, Joachim Wagner wrote:
* Some of our packages are too fat. kicad-packages takes longer to compress than the entire remaining distro at zstd-19 with 16x-parallelism.
This data will therefore dominate the stats you created. Other packages may behave differently.
If the goal is to minimise network traffic, the sizes should be weighted by popularity (number of downloads).
One could also question whether picking a single compression method for all packages is the way forward. A simple suggestion would be to select the compression method for each package independently. Even better will be to allow an arbitrary number of subsection in a package that can each pick its own decompressor (more subsection than decompressors can make sense as one may want to use different compression settings). Each subsection can contain multiple files, scripts and/or metadata. For an example of a file format that can mix different compression methods see PDF.
Yes, this is a possibility, but the correct procedure would be the compressing program choosing the correct algorithm automatically (with configured criteria like speed/size), and not us in advance. Does that type of software exist? -- Cheers / Saludos, Carlos E. R. (from 42.3 x86_64 "Malachite" at Telcontar)