Skip to content
This repository has been archived by the owner on Jun 22, 2024. It is now read-only.

Commit

Permalink
Add codellama 7b instruct
Browse files Browse the repository at this point in the history
  • Loading branch information
mudler committed Aug 30, 2023
1 parent 4623849 commit f059fa4
Showing 1 changed file with 32 additions and 0 deletions.
32 changes: 32 additions & 0 deletions codellama-7b-instruct.yaml
Original file line number Diff line number Diff line change
@@ -0,0 +1,32 @@
name: "codellama-7b-instruct-gguf"

description: |
https://huggingface.co/codellama/CodeLlama-7b-instruct-hf
license: "https://ai.meta.com/llama/license/"
urls:
- https://ai.meta.com/llama/
- https://huggingface.co/codellama/CodeLlama-7b-instruct-hf
- https://huggingface.co/TheBloke/CodeLlama-7B-Instruct-GGUF
config_file: |
parameters:
top_k: 80
temperature: 0.2
top_p: 0.7
context_size: 4096
template:
chat_message: llama2-chat-message
files:
- filename: "codellama-7b-instruct.Q4_K_M.gguf"
sha256: "bfccae840daea6b17ecd337a67f0471e19446db3c3f6e4975ece2c47c2a3fc92"
uri: "https://huggingface.co/TheBloke/CodeLlama-7B-Instruct-GGUF/resolve/main/codellama-7b-instruct.Q4_K_M.gguf"

prompt_templates:
- name: "llama2-chat-message"
content: |
{{if eq .RoleName "assistant"}}{{.Content}}{{else}}
[INST]
{{if eq .RoleName "system"}}<<SYS>>{{.Content}}<</SYS>>{{else if and (.SystemPrompt) (eq .MessageIndex 0)}}<<SYS>>{{.SystemPrompt}}<</SYS>>{{end}}
{{if .Content}}{{.Content}}{{end}}
[/INST]
{{end}}

0 comments on commit f059fa4

Please sign in to comment.