Mathis/llamactl
1
0
Fork 0
mirror of https://github.com/lordmathis/llamactl.git synced 2025-11-05 16:44:22 +00:00
Code Issues Packages Projects Releases Wiki Activity

Clarify port and api key assignments

Browse Source
This commit is contained in:
Matúš Námešný
2025-10-26 15:32:40 +01:00
parent a5e9e01ff4
commit 7509722dfa
3 changed files with 8 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
README.md
View File

@@ -138,7 +138,7 @@ go build -o llamactl ./cmd/server
1. Open http://localhost:8080 1. Open http://localhost:8080
2. Click "Create Instance" 2. Click "Create Instance"
3. Choose backend type (llama.cpp, MLX, or vLLM) 3. Choose backend type (llama.cpp, MLX, or vLLM)
4. Configure your model and options 4. Configure your model and options (ports and API keys are auto-assigned)
5. Start the instance and use it with any OpenAI-compatible client 5. Start the instance and use it with any OpenAI-compatible client
## Configuration ## Configuration

4
docs/managing-instances.md
View File

@@ -59,6 +59,10 @@ Each instance is displayed as a card showing:
- **llama.cpp**: Threads, context size, GPU layers, port, etc. - **llama.cpp**: Threads, context size, GPU layers, port, etc.
- **MLX**: Temperature, top-p, adapter path, Python environment, etc. - **MLX**: Temperature, top-p, adapter path, Python environment, etc.
- **vLLM**: Tensor parallel size, GPU memory utilization, quantization, etc. - **vLLM**: Tensor parallel size, GPU memory utilization, quantization, etc.
!!! tip "Auto-Assignment"
Llamactl automatically assigns ports from the configured port range (default: 8000-9000) and generates API keys if authentication is enabled. You typically don't need to manually specify these values.
8. Click **"Create"** to save the instance 8. Click **"Create"** to save the instance
**Via API** **Via API**

3
docs/quick-start.md
View File

@@ -33,6 +33,9 @@ You should see the Llamactl web interface.
- **Model**: Model path or huggingface repo - **Model**: Model path or huggingface repo
- **Additional Options**: Backend-specific parameters - **Additional Options**: Backend-specific parameters
!!! tip "Auto-Assignment"
Llamactl automatically assigns ports from the configured port range (default: 8000-9000) and generates API keys if authentication is enabled. You typically don't need to manually specify these values.
3. Click "Create Instance" 3. Click "Create Instance"
## Start Your Instance ## Start Your Instance