Skip to content

Keep getting tokeniser issue on macos #122

@layeddie

Description

@layeddie

Tried installing on macos using opencode LLM for debugging install errors - went through all the suggestions and still kept getting this errror...

uv tool install agent-brain-cli==9.4.1 Resolved 164 packages in 34ms × Failed to download and buildtokenizers==0.20.3├─▶ Failed to parse:/Users/elay14/.cache/uv/sdists-v9/pypi/tokenizers/0.20.3/9SoMy7yoeCiZhQJRoTPkH/src/pyproject.toml╰─▶ TOML parse error at line 1, column 1 | 1 | [project] | ^^^^^^^^^pyproject.tomlis using the[project]table, but the requiredproject.versionfield is neither set nor present in theproject.dynamic` list

help: tokenizers (v0.20.3) was included because agent-brain-cli (v9.4.1) depends on agent-brain-rag (v9.4.1) which depends on
cohere (v5.20.7) which depends on `tokenizers``

Tried installing tokeniser....

`❯ uv pip install tokenizers --no-binary tokenizers
Resolved 23 packages in 68ms
Built tokenizers==0.22.2
Prepared 5 packages in 44.40s
Installed 23 packages in 25ms

  • annotated-doc==0.0.4
  • anyio==4.13.0
  • certifi==2026.2.25
  • click==8.3.1
  • filelock==3.25.2
  • fsspec==2026.2.0
  • h11==0.16.0
  • hf-xet==1.4.2
  • httpcore==1.0.9
  • httpx==0.28.1
  • huggingface-hub==1.7.2
  • idna==3.11
  • markdown-it-py==4.0.0
  • mdurl==0.1.2
  • packaging==26.0
  • pygments==2.19.2
  • pyyaml==6.0.3
  • rich==14.3.3
  • shellingham==1.5.4
  • tokenizers==0.22.2
  • tqdm==4.67.3
  • typer==0.24.1
  • typing-extensions==4.15.0
    ~/projects/2026 took 44s [Tue Mar 24 2026 5:30p.m. (GMT+0000)]
    ❯ uv tool install agent-brain-cli
    Resolved 164 packages in 34ms
    × Failed to download and build tokenizers==0.20.3
    ├─▶ Failed to parse: /Users/elay14/.cache/uv/sdists-v9/pypi/tokenizers/0.20.3/9SoMy7yoeCiZhQJRoTPkH/src/pyproject.toml
    ╰─▶ TOML parse error at line 1, column 1
    |
    1 | [project]
    | ^^^^^^^^^
    pyproject.toml is using the [project] table, but the required project.version field is neither set nor present in the
    project.dynamic list

help: tokenizers (v0.20.3) was included because agent-brain-cli (v9.4.1) depends on agent-brain-rag (v9.4.1) which depends on
cohere (v5.20.7) which depends on `tokenizers``

then cohere....

uv pip install cohere==5.20.7
Resolved 33 packages in 562ms
Prepared 1 package in 1.33s
Installed 9 packages in 15ms

  • annotated-types==0.7.0
  • charset-normalizer==3.4.6
  • fastavro==1.12.1
  • pydantic==2.12.5
  • pydantic-core==2.41.5
  • requests==2.32.5
  • types-requests==2.32.4.20260324
  • typing-inspection==0.4.2
  • urllib3==2.6.3
    ~/projects/2026 took 1s [Tue Mar 24 2026 5:36p.m. (GMT+0000)]
    ❯ uv tool install agent-brain-cli==9.4.1
    Resolved 164 packages in 34ms
    × Failed to download and build tokenizers==0.20.3
    ├─▶ Failed to parse: /Users/elay14/.cache/uv/sdists-v9/pypi/tokenizers/0.20.3/9SoMy7yoeCiZhQJRoTPkH/src/pyproject.toml
    ╰─▶ TOML parse error at line 1, column 1
    |
    1 | [project]
    | ^^^^^^^^^
    pyproject.toml is using the [project] table, but the required project.version field is neither set nor present in the
    project.dynamic list

help: tokenizers (v0.20.3) was included because agent-brain-cli (v9.4.1) depends on agent-brain-rag (v9.4.1) which depends on
cohere (v5.20.7) which depends on tokenizers

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions