Skip to content

Releases: JiscDACT/mario

v0.41

23 Apr 13:30

Choose a tag to compare

  • Exposed 'compress using gzip' option for saving CSV files
  • Made notes pages for Excel pivot outputs optional

v0.40

17 Apr 12:45

Choose a tag to compare

  • Enable HyperFile extractors to save to CSV (using chunking/streaming) and return the total number of rows without conversion to a dataframe first, which is helpful with larger hyper files.

v0.39

17 Apr 11:00

Choose a tag to compare

  • Added a PartitioningExtractor that helps with larger datasets where we want to slice the query on the client side before streaming output.
  • Added a formatting helper for generated SQL that includes the parameters
  • Added support for Airflow hooks in StreamingDataExtractor

v0.39

17 Apr 11:05

Choose a tag to compare

  • Added a PartitioningExtractor that helps with larger datasets where we want to slice the query on the client side before streaming output.
  • Added a formatting helper for generated SQL that includes the parameters
  • Added support for Airflow hooks in StreamingDataExtractor

v0.38

10 Apr 14:53

Choose a tag to compare

  • Fixed an error when renaming hyper tables.

v0.37

10 Apr 14:27

Choose a tag to compare

Adds a Hyper Utils module containing lots of different utility functions to help when working directly with large hyper files, for example where converting to dataframes using Pantab is too expensive.

v0.36

21 Mar 11:17

Choose a tag to compare

Adds a dataset splitting utility for partitioning datasets by a dimension

v0.35

10 Dec 13:32

Choose a tag to compare

  • Modified the default behaviour of HyperFile to allowNulls=True to be consistent with other implementations of DataExtractor

0.34

24 Sep 09:44

Choose a tag to compare

  • Fixed issue with imports in hyperfile extractor
  • Fixed issue with validation warning log message being prefixed with 'Validation Error'

0.33

24 Sep 07:56

Choose a tag to compare

Enable anomaly detection to be called per-item