Skip to content

User Issue: Server 500 error when /POST to localhost #5

@twelsh37

Description

@twelsh37

System:
Intel i9-14900KF
RAM 192GB
GPU RTX 4090 24GB
Windows 11 v 23H2

Ollama
ollama version is 0.5.4

My Issue
I have followed your guide and have updated my .env in both the root of the project and in server/
I accessed ISO Speed Bench and loaded simple_math.yaml.
This used the following models:

models:
  - "llama3.2:1b"
  - "llama3.2:latest"
  - "qwen2.5-coder:14b"
  - "falcon3:10b"
  - "phi4:latest"

Which corresponds with my Ollama Models

E:\data\Projects\benchy>ollama list
NAME                       ID              SIZE      MODIFIED
all-minilm:latest          1b226e2802db    45 MB     6 hours ago
falcon3:10b                1653ff122acd    6.3 GB    7 hours ago
qwen2.5-coder:14b          3028237cc8c5    9.0 GB    14 hours ago
qwq:32b                    46407beda5c0    19 GB     14 hours ago
deepseek-coder:33b         acec7c0b0fd9    18 GB     19 hours ago
qwen2.5:32b                9f13ba1299af    19 GB     19 hours ago
gemma2:27b                 53261bc9c192    15 GB     20 hours ago
llama3.2:latest            a80c4f17acd5    2.0 GB    20 hours ago
llama3.2-vision:latest     085a1fdae525    7.9 GB    20 hours ago
llama3.2:1b                baf6a787fdff    1.3 GB    20 hours ago
mistral:latest             f974a74358d6    4.1 GB    20 hours ago
phi4:latest                ac896e5b8b34    9.1 GB    20 hours ago
nomic-embed-text:latest    0a109f422b47    274 MB    21 hours ago

The tests all run and then at the end it gets a 500 error.
I know the server is running as I see the following output in it;

 Running test 26/30...
  Running test 27/30...
  Running test 28/30...
  Running test 29/30...
  Running test 30/30...
Generating report for Simple Math in Python
127.0.0.1 - - [12/Jan/2025 11:05:53] "POST /iso-speed-bench HTTP/1.1" 500 -

I'm new to flask, but everything looks fine.
Any pointers as to where I am going wrong?

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions