Add wizardcoder example

countzero · countzero · commit 1498c00f91df · 2023-09-20T16:28:07.000+02:00
diff --git a/examples/server_wizardcoder_15b_v1.0.ps1 b/examples/server_wizardcoder_15b_v1.0.ps1
@@ -0,0 +1,8 @@
+Start-Process "http://127.0.0.1:8080"
+
+# CUDA offloading is not yet supported: https://github.com/ggerganov/llama.cpp/pull/3187#issuecomment-1721531644
+../vendor/llama.cpp/build/bin/Release/server `
+    --model "../vendor/llama.cpp/models/WizardCoder-15B-V1.0/model-quantized-q4_k_M.gguf" `
+    --ctx-size 2048 `
+    --threads 6 `
+    --n-gpu-layers 0
diff --git a/prompts/chat_with_llama_2.txt b/prompts/chat_with_llama_2.txt
@@ -0,0 +1,3 @@
+System: You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. If a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.
+Assistant: How can I help you?
+User:
diff --git a/vendor/llama.cpp b/vendor/llama.cpp
@@ -1 +1 @@
-Subproject commit e6616cf0db2b63189fc34d0076f654af9adecdf8
+Subproject commit a40f2b656fab364ce0aff98dbefe9bd9c3721cc9

Original file line number	Diff line number	Diff line change
`@@ -0,0 +1,3 @@`
	`1`	+System: You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. If a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.
	`2`	`+Assistant: How can I help you?`
	`3`	`+User:`