mirror of
https://github.com/lordmathis/llamactl.git
synced 2025-11-06 00:54:23 +00:00
Minor docs improvements
This commit is contained in:
@@ -85,7 +85,7 @@ llama-server --model /path/to/model.gguf --port 8081
|
||||
mlx_lm.server --model mlx-community/Mistral-7B-Instruct-v0.3-4bit --port 8081
|
||||
|
||||
# vLLM
|
||||
python -m vllm.entrypoints.openai.api_server --model microsoft/DialoGPT-medium --port 8081
|
||||
vllm serve microsoft/DialoGPT-medium --port 8081
|
||||
```
|
||||
|
||||
## API and Network Issues
|
||||
|
||||
Reference in New Issue
Block a user