RewindStore keeps full original text in memory. For large JSON arrays (which are the main Rewind users), the originals can be several KB each. Storing them LZ4-compressed in memory could reduce footprint by 60-80% with <1ms decompress overhead.
Python has the lz4 package which is widely available and very fast.
RewindStore keeps full original text in memory. For large JSON arrays (which are the main Rewind users), the originals can be several KB each. Storing them LZ4-compressed in memory could reduce footprint by 60-80% with <1ms decompress overhead.
Python has the lz4 package which is widely available and very fast.