Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Use compressed numpy format by default in compressed mode (next major release) #73

Open
mverleg opened this issue Apr 1, 2020 · 1 comment
Labels

Comments

@mverleg
Copy link
Owner

mverleg commented Apr 1, 2020

Numpy arrays are stored as text arrays by default. This is readable but takes a lot of space.

When the file is compressed, it perhaps makes more sense to use the new compact format introduced in #9.

Since this is a backwards-incompatible change, it will have to wait until the next major version (4.0.0).

For now the compressed format can be used like this (compression is optional):

json = dumps(data, compression=True, properties={'ndarray_compact': True})

There's also a warning announcing this change, which you can silence by explicitly disabling the new format:

json = dumps(data, properties={'ndarray_compact': False})
@mverleg
Copy link
Owner Author

mverleg commented Apr 1, 2020

It might be important to support F-order arrays before this becomes default

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

1 participant