fix: error: no such module 'Tokenizers'

[christophsturm]

No description provided.

[lucasnewman]

@christophsturm Do you have a test case where this isn't working? This doesn't seem right to me -- it should just work when pulling in the dependency as a package.

[christophsturm]

@lucasnewman my pr contains a test project so if you comment out the fix that should fail.

you can just change the dependency of the test project to
.package(
url: "https://github.com/Blaizzy/mlx-audio-swift.git",
revision: "2fd41458059e2d80403436167d5263f585d120d4"
),
to see the error.

[lucasnewman]

Ok, thanks. It took me a while to hunt this down -- it looks like there was a change in mlx-swift-lm in ml-explore/mlx-swift-lm#118 which triggers this. We're pinned to major version 2 so it shouldn't immediately impact anything unless you've modified the package locally.

[christophsturm]

right so my fix improves the situation when using this library together with other versions.

[lucasnewman]

Resolved in #158