This repository was archived by the owner on Jul 4, 2025. It is now read-only.
This repository was archived by the owner on Jul 4, 2025. It is now read-only.
bug: [CUDA problem] #2214
Description
Cortex version
v1.0.14
Describe the issue and expected behaviour
After installing version 1.0.14 and then downloading llama.cpp, the models are not loading to the GPU. When I install version 1.0.12, everything works as it should. Ubuntu 24.04 LTS, RTX 2070.
Steps to Reproduce
No response
Screenshots / Logs
No response
What is your OS?
- Windows
- Mac Silicon
- Mac Intel
- Linux / Ubuntu
What engine are you running?
- cortex.llamacpp (default)
- cortex.tensorrt-llm (Nvidia GPUs)
- cortex.onnx (NPUs, DirectML)
Hardware Specs eg OS version, GPU
No response