Small changes split out while working on splitting the IRIs #11

dali99 · 2025-03-03T00:52:31Z

Things Done

Some nix development environment things
Make some code more readable
Drop some unused columns from the lazy frame before realization
- In the hopes that they get optimized away and the column (with structs) we care about gets initialized directly somehow
- No idea if it actually works, but if it does it should reduce some memory consumption?

…tion

…ds used to build the struct before realizing it

lib/representation/src/multitype.rs

dali99 force-pushed the dan/small_fixes branch 4 times, most recently from ef429a6 to 52fc9a6 Compare March 3, 2025 02:07

dali99 force-pushed the dan/small_fixes branch from 52fc9a6 to 211a612 Compare March 10, 2025 11:13

dali99 mentioned this pull request Mar 12, 2025

IRI-split #12

Draft

dali99 added 11 commits March 12, 2025 05:08

nix: add rust-analyzer, more python libraries

d09e716

representation: improve column_to_term_vec for language literals

c3b1a5b

representation/polars_to_rdf: Move language column extraction to func…

8aa01a9

…tion

representation/multitype: generalize column extraction function

29e492f

representation: clean up implementations in RDFType

45e3e09

representation/multitype/extract_column_from_multitype: drop the fiel…

e6f32b3

…ds used to build the struct before realizing it

nix: add tests to flake

e0ddb4e

nix: build python wheel with the py_maplib source code

6125f68

bump cargo-lock

9fd58d6

nix: run pytests with a purer environment

edda5b0

representation: Parameterize column extraction from multitype

e7f25ad

dali99 force-pushed the dan/small_fixes branch from 6c72de3 to e7f25ad Compare March 12, 2025 04:36

dali99 commented Mar 12, 2025

View reviewed changes

lib/representation/src/multitype.rs Show resolved Hide resolved

magbak merged commit 5a0cd09 into main Mar 12, 2025
5 checks passed