The Colchis project to load JSON compactly but accessibly into memory in #RustLang now uses compression when loading texts. This reduces peak memory usage until that text is finally unpacked in the end. Since this is done once tree structure information is already processed and transformed into succinct data, this decreases peak memory usage while loading JSON; it seems to be close to the size of the original document now (and then shrinks a bit again).
Website | https://nsrosenqvist.com |
GitHub | https://github.com/nsrosenqvist/ |
Pixelfed | https://pixelfed.social/i/web/profile/353086084774472543 |