From 91f4fac23cac394592d5c093e57f81c0457d2223 Mon Sep 17 00:00:00 2001 From: freedakgmail Date: Tue, 23 Jun 2026 09:15:59 +0800 Subject: [PATCH] =?UTF-8?q?docs:=20=E6=B7=BB=E5=8A=A0=E6=9C=AC=E5=9C=B0LLM?= =?UTF-8?q?=E5=90=AF=E5=8A=A8=E5=91=BD=E4=BB=A4=E6=96=87=E6=A1=A3?= MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit --- LocalLLM.md | 11 +++++++++++ 1 file changed, 11 insertions(+) create mode 100644 LocalLLM.md diff --git a/LocalLLM.md b/LocalLLM.md new file mode 100644 index 0000000..92c2592 --- /dev/null +++ b/LocalLLM.md @@ -0,0 +1,11 @@ +# Ctrl+C 停掉当前服务,用 -lv 3 启动(显示更详细日志) + +```bash +~/llama.cpp/build/bin/llama-server \ + -m ~/models/qwen2.5-7b-instruct-q4_k_m-00001-of-00002.gguf \ + --host 0.0.0.0 \ + --port 18888 \ + -ngl 35 \ + --metrics \ + -lv 3 +``` \ No newline at end of file