-
Notifications
You must be signed in to change notification settings - Fork 16
Keep getting tokeniser issue on macos #122
Description
Tried installing on macos using opencode LLM for debugging install errors - went through all the suggestions and still kept getting this errror...
uv tool install agent-brain-cli==9.4.1 Resolved 164 packages in 34ms × Failed to download and buildtokenizers==0.20.3├─▶ Failed to parse:/Users/elay14/.cache/uv/sdists-v9/pypi/tokenizers/0.20.3/9SoMy7yoeCiZhQJRoTPkH/src/pyproject.toml╰─▶ TOML parse error at line 1, column 1 | 1 | [project] | ^^^^^^^^^pyproject.tomlis using the[project]table, but the requiredproject.versionfield is neither set nor present in theproject.dynamic` list
help: tokenizers (v0.20.3) was included because agent-brain-cli (v9.4.1) depends on agent-brain-rag (v9.4.1) which depends on
cohere (v5.20.7) which depends on `tokenizers``
Tried installing tokeniser....
`❯ uv pip install tokenizers --no-binary tokenizers
Resolved 23 packages in 68ms
Built tokenizers==0.22.2
Prepared 5 packages in 44.40s
Installed 23 packages in 25ms
- annotated-doc==0.0.4
- anyio==4.13.0
- certifi==2026.2.25
- click==8.3.1
- filelock==3.25.2
- fsspec==2026.2.0
- h11==0.16.0
- hf-xet==1.4.2
- httpcore==1.0.9
- httpx==0.28.1
- huggingface-hub==1.7.2
- idna==3.11
- markdown-it-py==4.0.0
- mdurl==0.1.2
- packaging==26.0
- pygments==2.19.2
- pyyaml==6.0.3
- rich==14.3.3
- shellingham==1.5.4
- tokenizers==0.22.2
- tqdm==4.67.3
- typer==0.24.1
- typing-extensions==4.15.0
~/projects/2026 took 44s [Tue Mar 24 2026 5:30p.m. (GMT+0000)]
❯ uv tool install agent-brain-cli
Resolved 164 packages in 34ms
× Failed to download and buildtokenizers==0.20.3
├─▶ Failed to parse:/Users/elay14/.cache/uv/sdists-v9/pypi/tokenizers/0.20.3/9SoMy7yoeCiZhQJRoTPkH/src/pyproject.toml
╰─▶ TOML parse error at line 1, column 1
|
1 | [project]
| ^^^^^^^^^
pyproject.tomlis using the[project]table, but the requiredproject.versionfield is neither set nor present in the
project.dynamiclist
help: tokenizers (v0.20.3) was included because agent-brain-cli (v9.4.1) depends on agent-brain-rag (v9.4.1) which depends on
cohere (v5.20.7) which depends on `tokenizers``
then cohere....
uv pip install cohere==5.20.7
Resolved 33 packages in 562ms
Prepared 1 package in 1.33s
Installed 9 packages in 15ms
- annotated-types==0.7.0
- charset-normalizer==3.4.6
- fastavro==1.12.1
- pydantic==2.12.5
- pydantic-core==2.41.5
- requests==2.32.5
- types-requests==2.32.4.20260324
- typing-inspection==0.4.2
- urllib3==2.6.3
~/projects/2026 took 1s [Tue Mar 24 2026 5:36p.m. (GMT+0000)]
❯ uv tool install agent-brain-cli==9.4.1
Resolved 164 packages in 34ms
× Failed to download and buildtokenizers==0.20.3
├─▶ Failed to parse:/Users/elay14/.cache/uv/sdists-v9/pypi/tokenizers/0.20.3/9SoMy7yoeCiZhQJRoTPkH/src/pyproject.toml
╰─▶ TOML parse error at line 1, column 1
|
1 | [project]
| ^^^^^^^^^
pyproject.tomlis using the[project]table, but the requiredproject.versionfield is neither set nor present in the
project.dynamiclist
help: tokenizers (v0.20.3) was included because agent-brain-cli (v9.4.1) depends on agent-brain-rag (v9.4.1) which depends on
cohere (v5.20.7) which depends on tokenizers