-
Notifications
You must be signed in to change notification settings - Fork 108
Open
Description
System:
Intel i9-14900KF
RAM 192GB
GPU RTX 4090 24GB
Windows 11 v 23H2
Ollama
ollama version is 0.5.4
My Issue
I have followed your guide and have updated my .env in both the root of the project and in server/
I accessed ISO Speed Bench and loaded simple_math.yaml.
This used the following models:
models:
- "llama3.2:1b"
- "llama3.2:latest"
- "qwen2.5-coder:14b"
- "falcon3:10b"
- "phi4:latest"
Which corresponds with my Ollama Models
E:\data\Projects\benchy>ollama list
NAME ID SIZE MODIFIED
all-minilm:latest 1b226e2802db 45 MB 6 hours ago
falcon3:10b 1653ff122acd 6.3 GB 7 hours ago
qwen2.5-coder:14b 3028237cc8c5 9.0 GB 14 hours ago
qwq:32b 46407beda5c0 19 GB 14 hours ago
deepseek-coder:33b acec7c0b0fd9 18 GB 19 hours ago
qwen2.5:32b 9f13ba1299af 19 GB 19 hours ago
gemma2:27b 53261bc9c192 15 GB 20 hours ago
llama3.2:latest a80c4f17acd5 2.0 GB 20 hours ago
llama3.2-vision:latest 085a1fdae525 7.9 GB 20 hours ago
llama3.2:1b baf6a787fdff 1.3 GB 20 hours ago
mistral:latest f974a74358d6 4.1 GB 20 hours ago
phi4:latest ac896e5b8b34 9.1 GB 20 hours ago
nomic-embed-text:latest 0a109f422b47 274 MB 21 hours ago
The tests all run and then at the end it gets a 500 error.
I know the server is running as I see the following output in it;
Running test 26/30...
Running test 27/30...
Running test 28/30...
Running test 29/30...
Running test 30/30...
Generating report for Simple Math in Python
127.0.0.1 - - [12/Jan/2025 11:05:53] "POST /iso-speed-bench HTTP/1.1" 500 -
I'm new to flask, but everything looks fine.
Any pointers as to where I am going wrong?
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
No labels