Performance

This toolkit is used to process huge files. As such even a millisecond per operation can add up to minutes and hours. For example, a microsecond over 1 billion operations will add ~16.5 minutes. A millisecond over 1 billion operations will add ~11.5 days. That's why the performance considerations played the major role in design and implementation of stream-csv-as-json.

The list of best practices for users of the toolkit and its companion stream-json can be found in stream-json's Performance document. Pay special attention to options named similarly — they are there for the same performance tweaking in both toolkits.