diff --git a/LocalLLM.md b/LocalLLM.md new file mode 100644 index 0000000..92c2592 --- /dev/null +++ b/LocalLLM.md @@ -0,0 +1,11 @@ +# Ctrl+C 停掉当前服务,用 -lv 3 启动(显示更详细日志) + +```bash +~/llama.cpp/build/bin/llama-server \ + -m ~/models/qwen2.5-7b-instruct-q4_k_m-00001-of-00002.gguf \ + --host 0.0.0.0 \ + --port 18888 \ + -ngl 35 \ + --metrics \ + -lv 3 +``` \ No newline at end of file