Skip to content

Release 0.2.2#127

Merged
mbsabath merged 11 commits intomainfrom
dev
Mar 14, 2025
Merged

Release 0.2.2#127
mbsabath merged 11 commits intomainfrom
dev

Conversation

@mbsabath
Copy link
Collaborator

Release 0.2.2
Includes

  • Memory Fixes in TatmDataset
  • Support for Dataset Train and Validation Splits
  • Ray logging fixes
  • Updates to Poetry 2.0

mbsabath and others added 8 commits January 14, 2025 10:03
* create index based validation splits

* make split reset explicit

* move set_split to parent object

* ensure train set cant query beyond the bounds of the train set

* lint

* move all split logic to TatmDataset

* move all split handling logic to TatmDataset

* update create_split docstring

* format
* Update to use Poetry 2.0

* Move build-system to top
* Add jsonl support

* Type hint

* Separate annotation loading into private function
* lazily open memmaps

* close array before pickling TokenArray structures

* lint code
* use ray logging config in cli tokenizer

* make log level variable in ray logging config

* find free dashboard port
* add validation split vignette

* respond to tims comments
@mbsabath mbsabath requested a review from timothyngo March 13, 2025 18:32
@mbsabath mbsabath self-assigned this Mar 13, 2025
@github-actions
Copy link

🏷️ [bumpr] Next version:v0.2.2 Changes:v0.2.1...KempnerInstitute:dev

build-backend = "poetry.core.masonry.api"


[project]
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Somehow the version number didn't get bumped.

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

yup, the workflow tries to push a change and gets (reasonably) blocked by our branch protections, updating the release workflow now like we discussed

@github-actions
Copy link

🏷️ [bumpr] Next version:v0.2.2 Changes:v0.2.1...KempnerInstitute:dev

@github-actions
Copy link

🏷️ [bumpr] Next version:v0.2.2 Changes:v0.2.1...KempnerInstitute:dev

@mbsabath mbsabath merged commit 6d16c60 into main Mar 14, 2025
2 checks passed
@github-actions
Copy link

🚀 [bumpr] Bumped! New version:v0.2.2 Changes:v0.2.1...v0.2.2

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants