Search results

Include in Readme how to Pass Custom Arguments to <code>llama_cpp.server</code> in Docker

documentationImprovements or additions to documentationImprovements or additions to documentation

questionFurther information is requestedFurther information is requested

Status: Open.

#1029 In abetlen/llama-cpp-python;

· jaredquekjz opened on Dec 19, 2023

CUDA/Windows instructions do not work; there is no setup.py

bugSomething isn't workingSomething isn't working

documentationImprovements or additions to documentationImprovements or additions to documentation

Status: Open.

#965 In abetlen/llama-cpp-python;

· andymartin opened on Dec 2, 2023

[BUG] Server cant handle two streaming connections in same time

bugSomething isn't workingSomething isn't working

documentationImprovements or additions to documentationImprovements or additions to documentation

Status: Open.

#897 In abetlen/llama-cpp-python;

· ArtyomZemlyak opened on Nov 10, 2023

Raise Error "no CUDA-capable device is detected" when running a <code>CUBLAS</code> compiled version of llama-cpp-python

bugSomething isn't workingSomething isn't working

documentationImprovements or additions to documentationImprovements or additions to documentation

Status: Open.

#880 In abetlen/llama-cpp-python;

· bonuschild opened on Nov 6, 2023

Unable to install llama-cpp-python Package in Python - Wheel Building Process gets Stuck

bugSomething isn't workingSomething isn't working

build

documentationImprovements or additions to documentationImprovements or additions to documentation

Status: Open.

#853 In abetlen/llama-cpp-python;

· Illanser opened on Oct 30, 2023

(mach-o file, but is an incompatible architecture (have 'x86_64', need 'arm64')) on M2

bugSomething isn't workingSomething isn't working

build

documentationImprovements or additions to documentationImprovements or additions to documentation

Status: Open.

#847 In abetlen/llama-cpp-python;

· alessandropaticchio opened on Oct 27, 2023

One chat prompt/template should be customizable from runtime - the prompt I need atm

documentationImprovements or additions to documentationImprovements or additions to documentation

Status: Open.

#816 In abetlen/llama-cpp-python;

· pervrosen opened on Oct 12, 2023

Documentation of server command line parameters.

documentationImprovements or additions to documentationImprovements or additions to documentation

Status: Open.

#635 In abetlen/llama-cpp-python;

· arthurwolf opened on Aug 24, 2023

Document plug-n-play docker setup

documentationImprovements or additions to documentationImprovements or additions to documentation

enhancementNew feature or requestNew feature or request

Status: Open.

#495 In abetlen/llama-cpp-python;

· abetlen opened on Jul 18, 2023

Roadmap for v0.2

documentationImprovements or additions to documentationImprovements or additions to documentation

enhancementNew feature or requestNew feature or request

Status: Open.

#487 In abetlen/llama-cpp-python;

· abetlen opened on Jul 18, 2023

CUBLAS and CLBLAST builds on Windows

documentationImprovements or additions to documentationImprovements or additions to documentation

duplicateThis issue or pull request already existsThis issue or pull request already exists

windowsA Windoze-specific issueA Windoze-specific issue

Status: Open.

#463 In abetlen/llama-cpp-python;

· goodglitch opened on Jul 9, 2023

Log llama.cpp commit hash when installing using --verbose

documentationImprovements or additions to documentationImprovements or additions to documentation

enhancementNew feature or requestNew feature or request

llama.cppProblem with llama.cpp shared libProblem with llama.cpp shared lib

Status: Open.

#256 In abetlen/llama-cpp-python;

· gjmulder opened on May 21, 2023