diff --git a/stable b/stable index d609fec..73c11a9 120000 --- a/stable +++ b/stable @@ -1 +1 @@ -v0.13.1 \ No newline at end of file +v0.13.2 \ No newline at end of file diff --git a/v0.13.2/404.html b/v0.13.2/404.html new file mode 100644 index 0000000..fdc64eb --- /dev/null +++ b/v0.13.2/404.html @@ -0,0 +1,634 @@ + + + +
+ + + + + + + + + + + + + + + + + + +llamactl is a control server for managing Llama Server instances.
+List all API keys
+Returns a list of all API keys for the system user (excludes key hash and
+plain-text key)
Input parameters
+| Parameter | +In | +Type | +Default | +Nullable | +Description | +
|---|---|---|---|---|---|
ApiKeyAuth |
+ header | +string | +N/A | +No | ++ |
+ Response 200 OK +
+ ++ Response 500 Internal Server Error +
+ +Create a new API key
+Creates a new API key with the specified permissions and returns the plain-
+text key (only shown once)
Input parameters
+| Parameter | +In | +Type | +Default | +Nullable | +Description | +
|---|---|---|---|---|---|
key |
+ body | +None | ++ | No | +API key configuration | +
+ Response 201 Created +
+ ++ Response 400 Bad Request +
+ ++ Response 500 Internal Server Error +
+ +Delete an API key
+Deletes an API key by ID
+Input parameters
+| Parameter | +In | +Type | +Default | +Nullable | +Description | +
|---|---|---|---|---|---|
ApiKeyAuth |
+ header | +string | +N/A | +No | ++ |
id |
+ path | +None | ++ | No | +Key ID | +
+ Response 204 No Content +
+ ++ Response 400 Bad Request +
+ ++ Response 404 Not Found +
+ ++ Response 500 Internal Server Error +
+ +Get details of a specific API key
+Returns details for a specific API key by ID (excludes key hash and plain-
+text key)
Input parameters
+| Parameter | +In | +Type | +Default | +Nullable | +Description | +
|---|---|---|---|---|---|
ApiKeyAuth |
+ header | +string | +N/A | +No | ++ |
id |
+ path | +None | ++ | No | +Key ID | +
+ Response 200 OK +
+ ++ Response 400 Bad Request +
+ ++ Response 404 Not Found +
+ ++ Response 500 Internal Server Error +
+ +Get API key permissions
+Returns the instance-level permissions for a specific API key (includes
+instance names)
Input parameters
+| Parameter | +In | +Type | +Default | +Nullable | +Description | +
|---|---|---|---|---|---|
ApiKeyAuth |
+ header | +string | +N/A | +No | ++ |
id |
+ path | +None | ++ | No | +Key ID | +
+ Response 200 OK +
+ ++ Response 400 Bad Request +
+ ++ Response 404 Not Found +
+ ++ Response 500 Internal Server Error +
+ +List available devices for llama server
+Returns a list of available devices for the llama server
+Input parameters
+| Parameter | +In | +Type | +Default | +Nullable | +Description | +
|---|---|---|---|---|---|
ApiKeyAuth |
+ header | +string | +N/A | +No | ++ |
+ Response 200 OK +
+ ++ Response 500 Internal Server Error +
+ +Get help for llama server
+Returns the help text for the llama server command
+Input parameters
+| Parameter | +In | +Type | +Default | +Nullable | +Description | +
|---|---|---|---|---|---|
ApiKeyAuth |
+ header | +string | +N/A | +No | ++ |
+ Response 200 OK +
+ ++ Response 500 Internal Server Error +
+ +Parse llama-server command
+Parses a llama-server command string into instance options
+Input parameters
+| Parameter | +In | +Type | +Default | +Nullable | +Description | +
|---|---|---|---|---|---|
ApiKeyAuth |
+ header | +string | +N/A | +No | ++ |
request |
+ body | +None | ++ | No | +Command to parse | +
+ Response 200 OK +
+ ++ Response 400 Bad Request +
+ ++ Response 500 Internal Server Error +
+ +Get version of llama server
+Returns the version of the llama server command
+Input parameters
+| Parameter | +In | +Type | +Default | +Nullable | +Description | +
|---|---|---|---|---|---|
ApiKeyAuth |
+ header | +string | +N/A | +No | ++ |
+ Response 200 OK +
+ ++ Response 500 Internal Server Error +
+ +Parse mlx_lm.server command
+Parses MLX-LM server command string into instance options
+Input parameters
+| Parameter | +In | +Type | +Default | +Nullable | +Description | +
|---|---|---|---|---|---|
ApiKeyAuth |
+ header | +string | +N/A | +No | ++ |
request |
+ body | +None | ++ | No | +Command to parse | +
+ Response 200 OK +
+ ++ Response 400 Bad Request +
+ +Parse vllm serve command
+Parses a vLLM serve command string into instance options
+Input parameters
+| Parameter | +In | +Type | +Default | +Nullable | +Description | +
|---|---|---|---|---|---|
ApiKeyAuth |
+ header | +string | +N/A | +No | ++ |
request |
+ body | +None | ++ | No | +Command to parse | +
+ Response 200 OK +
+ ++ Response 400 Bad Request +
+ +Get server configuration
+Returns the current server configuration (sanitized)
+Input parameters
+| Parameter | +In | +Type | +Default | +Nullable | +Description | +
|---|---|---|---|---|---|
ApiKeyAuth |
+ header | +string | +N/A | +No | ++ |
+ Response 200 OK +
+ ++ Response 500 Internal Server Error +
+ +Get llamactl version
+Returns the version of the llamactl command
+Input parameters
+| Parameter | +In | +Type | +Default | +Nullable | +Description | +
|---|---|---|---|---|---|
ApiKeyAuth |
+ header | +string | +N/A | +No | ++ |
+ Response 200 OK +
+ ++ Response 500 Internal Server Error +
+ +List all instances
+Returns a list of all instances managed by the server
+Input parameters
+| Parameter | +In | +Type | +Default | +Nullable | +Description | +
|---|---|---|---|---|---|
ApiKeyAuth |
+ header | +string | +N/A | +No | ++ |
+ Response 200 OK +
+ ++ Response 500 Internal Server Error +
+ +Delete an instance
+Stops and removes a specific instance by name
+Input parameters
+| Parameter | +In | +Type | +Default | +Nullable | +Description | +
|---|---|---|---|---|---|
ApiKeyAuth |
+ header | +string | +N/A | +No | ++ |
name |
+ path | +None | ++ | No | +Instance Name | +
+ Response 204 No Content +
+ ++ Response 400 Bad Request +
+ ++ Response 500 Internal Server Error +
+ +Get details of a specific instance
+Returns the details of a specific instance by name
+Input parameters
+| Parameter | +In | +Type | +Default | +Nullable | +Description | +
|---|---|---|---|---|---|
ApiKeyAuth |
+ header | +string | +N/A | +No | ++ |
name |
+ path | +None | ++ | No | +Instance Name | +
+ Response 200 OK +
+ ++ Response 400 Bad Request +
+ ++ Response 500 Internal Server Error +
+ +Create and start a new instance
+Creates a new instance with the provided configuration options
+Input parameters
+| Parameter | +In | +Type | +Default | +Nullable | +Description | +
|---|---|---|---|---|---|
ApiKeyAuth |
+ header | +string | +N/A | +No | ++ |
name |
+ path | +None | ++ | No | +Instance Name | +
options |
+ body | +None | ++ | No | +Instance configuration options | +
+ Response 201 Created +
+ ++ Response 400 Bad Request +
+ ++ Response 500 Internal Server Error +
+ +Update an instance's configuration
+Updates the configuration of a specific instance by name
+Input parameters
+| Parameter | +In | +Type | +Default | +Nullable | +Description | +
|---|---|---|---|---|---|
ApiKeyAuth |
+ header | +string | +N/A | +No | ++ |
name |
+ path | +None | ++ | No | +Instance Name | +
options |
+ body | +None | ++ | No | +Instance configuration options | +
+ Response 200 OK +
+ ++ Response 400 Bad Request +
+ ++ Response 500 Internal Server Error +
+ +Get logs from a specific instance
+Returns the logs from a specific instance by name with optional line limit
+Input parameters
+| Parameter | +In | +Type | +Default | +Nullable | +Description | +
|---|---|---|---|---|---|
ApiKeyAuth |
+ header | +string | +N/A | +No | ++ |
lines |
+ query | +None | ++ | No | +Number of lines to retrieve (default: all lines) | +
name |
+ path | +None | ++ | No | +Instance Name | +
+ Response 200 OK +
+ ++ Response 400 Bad Request +
+ ++ Response 500 Internal Server Error +
+ +Proxy requests to a specific instance, does not autostart instance if stopped
+Forwards HTTP requests to the llama-server instance running on a specific
+port
Input parameters
+| Parameter | +In | +Type | +Default | +Nullable | +Description | +
|---|---|---|---|---|---|
ApiKeyAuth |
+ header | +string | +N/A | +No | ++ |
name |
+ path | +None | ++ | No | +Instance Name | +
+ Response 200 OK +
+ ++ Response 400 Bad Request +
+ ++ Response 500 Internal Server Error +
+ ++ Response 503 Service Unavailable +
+ +Proxy requests to a specific instance, does not autostart instance if stopped
+Forwards HTTP requests to the llama-server instance running on a specific
+port
Input parameters
+| Parameter | +In | +Type | +Default | +Nullable | +Description | +
|---|---|---|---|---|---|
ApiKeyAuth |
+ header | +string | +N/A | +No | ++ |
name |
+ path | +None | ++ | No | +Instance Name | +
+ Response 200 OK +
+ ++ Response 400 Bad Request +
+ ++ Response 500 Internal Server Error +
+ ++ Response 503 Service Unavailable +
+ +Restart a running instance
+Restarts a specific instance by name
+Input parameters
+| Parameter | +In | +Type | +Default | +Nullable | +Description | +
|---|---|---|---|---|---|
ApiKeyAuth |
+ header | +string | +N/A | +No | ++ |
name |
+ path | +None | ++ | No | +Instance Name | +
+ Response 200 OK +
+ ++ Response 400 Bad Request +
+ ++ Response 500 Internal Server Error +
+ +Start a stopped instance
+Starts a specific instance by name
+Input parameters
+| Parameter | +In | +Type | +Default | +Nullable | +Description | +
|---|---|---|---|---|---|
ApiKeyAuth |
+ header | +string | +N/A | +No | ++ |
name |
+ path | +None | ++ | No | +Instance Name | +
+ Response 200 OK +
+ ++ Response 400 Bad Request +
+ ++ Response 500 Internal Server Error +
+ +Stop a running instance
+Stops a specific instance by name
+Input parameters
+| Parameter | +In | +Type | +Default | +Nullable | +Description | +
|---|---|---|---|---|---|
ApiKeyAuth |
+ header | +string | +N/A | +No | ++ |
name |
+ path | +None | ++ | No | +Instance Name | +
+ Response 200 OK +
+ ++ Response 400 Bad Request +
+ ++ Response 500 Internal Server Error +
+ +List all configured nodes
+Returns a map of all nodes configured in the server (node name -> node
+config)
Input parameters
+| Parameter | +In | +Type | +Default | +Nullable | +Description | +
|---|---|---|---|---|---|
ApiKeyAuth |
+ header | +string | +N/A | +No | ++ |
+ Response 200 OK +
+ ++ Response 500 Internal Server Error +
+ +Get details of a specific node
+Returns the details of a specific node by name
+Input parameters
+| Parameter | +In | +Type | +Default | +Nullable | +Description | +
|---|---|---|---|---|---|
ApiKeyAuth |
+ header | +string | +N/A | +No | ++ |
name |
+ path | +None | ++ | No | +Node Name | +
+ Response 200 OK +
+ ++ Response 400 Bad Request +
+ ++ Response 404 Not Found +
+ ++ Response 500 Internal Server Error +
+ +Proxy requests to llama.cpp UI for the instance
+Proxies requests to the llama.cpp UI for the specified instance
+Input parameters
+| Parameter | +In | +Type | +Default | +Nullable | +Description | +
|---|---|---|---|---|---|
ApiKeyAuth |
+ header | +string | +N/A | +No | ++ |
name |
+ query | +None | ++ | No | +Instance Name | +
+ Response 200 OK +
+ ++ Response 400 Bad Request +
+ ++ Response 500 Internal Server Error +
+ +Proxy requests to llama.cpp server instance
+Proxies requests to the specified llama.cpp server instance, starting it on-
+demand if configured
Input parameters
+| Parameter | +In | +Type | +Default | +Nullable | +Description | +
|---|---|---|---|---|---|
ApiKeyAuth |
+ header | +string | +N/A | +No | ++ |
name |
+ path | +None | ++ | No | +Instance Name | +
+ Response 200 OK +
+ ++ Response 400 Bad Request +
+ ++ Response 500 Internal Server Error +
+ +Proxy requests to llama.cpp server instance
+Proxies requests to the specified llama.cpp server instance, starting it on-
+demand if configured
Input parameters
+| Parameter | +In | +Type | +Default | +Nullable | +Description | +
|---|---|---|---|---|---|
ApiKeyAuth |
+ header | +string | +N/A | +No | ++ |
name |
+ path | +None | ++ | No | +Instance Name | +
+ Response 200 OK +
+ ++ Response 400 Bad Request +
+ ++ Response 500 Internal Server Error +
+ +Proxy requests to llama.cpp server instance
+Proxies requests to the specified llama.cpp server instance, starting it on-
+demand if configured
Input parameters
+| Parameter | +In | +Type | +Default | +Nullable | +Description | +
|---|---|---|---|---|---|
ApiKeyAuth |
+ header | +string | +N/A | +No | ++ |
name |
+ path | +None | ++ | No | +Instance Name | +
+ Response 200 OK +
+ ++ Response 400 Bad Request +
+ ++ Response 500 Internal Server Error +
+ +Proxy requests to llama.cpp server instance
+Proxies requests to the specified llama.cpp server instance, starting it on-
+demand if configured
Input parameters
+| Parameter | +In | +Type | +Default | +Nullable | +Description | +
|---|---|---|---|---|---|
ApiKeyAuth |
+ header | +string | +N/A | +No | ++ |
name |
+ path | +None | ++ | No | +Instance Name | +
+ Response 200 OK +
+ ++ Response 400 Bad Request +
+ ++ Response 500 Internal Server Error +
+ +Proxy requests to llama.cpp server instance
+Proxies requests to the specified llama.cpp server instance, starting it on-
+demand if configured
Input parameters
+| Parameter | +In | +Type | +Default | +Nullable | +Description | +
|---|---|---|---|---|---|
ApiKeyAuth |
+ header | +string | +N/A | +No | ++ |
name |
+ path | +None | ++ | No | +Instance Name | +
+ Response 200 OK +
+ ++ Response 400 Bad Request +
+ ++ Response 500 Internal Server Error +
+ +Proxy requests to llama.cpp server instance
+Proxies requests to the specified llama.cpp server instance, starting it on-
+demand if configured
Input parameters
+| Parameter | +In | +Type | +Default | +Nullable | +Description | +
|---|---|---|---|---|---|
ApiKeyAuth |
+ header | +string | +N/A | +No | ++ |
name |
+ path | +None | ++ | No | +Instance Name | +
+ Response 200 OK +
+ ++ Response 400 Bad Request +
+ ++ Response 500 Internal Server Error +
+ +Proxy requests to llama.cpp server instance
+Proxies requests to the specified llama.cpp server instance, starting it on-
+demand if configured
Input parameters
+| Parameter | +In | +Type | +Default | +Nullable | +Description | +
|---|---|---|---|---|---|
ApiKeyAuth |
+ header | +string | +N/A | +No | ++ |
name |
+ path | +None | ++ | No | +Instance Name | +
+ Response 200 OK +
+ ++ Response 400 Bad Request +
+ ++ Response 500 Internal Server Error +
+ +Proxy requests to llama.cpp server instance
+Proxies requests to the specified llama.cpp server instance, starting it on-
+demand if configured
Input parameters
+| Parameter | +In | +Type | +Default | +Nullable | +Description | +
|---|---|---|---|---|---|
ApiKeyAuth |
+ header | +string | +N/A | +No | ++ |
name |
+ path | +None | ++ | No | +Instance Name | +
+ Response 200 OK +
+ ++ Response 400 Bad Request +
+ ++ Response 500 Internal Server Error +
+ +Proxy requests to llama.cpp server instance
+Proxies requests to the specified llama.cpp server instance, starting it on-
+demand if configured
Input parameters
+| Parameter | +In | +Type | +Default | +Nullable | +Description | +
|---|---|---|---|---|---|
ApiKeyAuth |
+ header | +string | +N/A | +No | ++ |
name |
+ path | +None | ++ | No | +Instance Name | +
+ Response 200 OK +
+ ++ Response 400 Bad Request +
+ ++ Response 500 Internal Server Error +
+ +Proxy requests to llama.cpp server instance
+Proxies requests to the specified llama.cpp server instance, starting it on-
+demand if configured
Input parameters
+| Parameter | +In | +Type | +Default | +Nullable | +Description | +
|---|---|---|---|---|---|
ApiKeyAuth |
+ header | +string | +N/A | +No | ++ |
name |
+ path | +None | ++ | No | +Instance Name | +
+ Response 200 OK +
+ ++ Response 400 Bad Request +
+ ++ Response 500 Internal Server Error +
+ +Proxy requests to llama.cpp server instance
+Proxies requests to the specified llama.cpp server instance, starting it on-
+demand if configured
Input parameters
+| Parameter | +In | +Type | +Default | +Nullable | +Description | +
|---|---|---|---|---|---|
ApiKeyAuth |
+ header | +string | +N/A | +No | ++ |
name |
+ path | +None | ++ | No | +Instance Name | +
+ Response 200 OK +
+ ++ Response 400 Bad Request +
+ ++ Response 500 Internal Server Error +
+ +OpenAI-compatible proxy endpoint
+Handles all POST requests to /v1/*, routing to the appropriate instance
+based on the request body. Requires API key authentication via the
+Authorization header.
Input parameters
+| Parameter | +In | +Type | +Default | +Nullable | +Description | +
|---|---|---|---|---|---|
ApiKeyAuth |
+ header | +string | +N/A | +No | ++ |
+ Response 200 OK +
+ ++ Response 400 Bad Request +
+ ++ Response 500 Internal Server Error +
+ +List instances in OpenAI-compatible format
+Returns a list of instances in a format compatible with OpenAI API
+Input parameters
+| Parameter | +In | +Type | +Default | +Nullable | +Description | +
|---|---|---|---|---|---|
ApiKeyAuth |
+ header | +string | +N/A | +No | ++ |
+ Response 200 OK +
+ ++ Response 500 Internal Server Error +
+ +