mirror of
https://github.com/lordmathis/llamactl.git
synced 2025-11-06 00:54:23 +00:00
Add create instance screenshot and update managing instances documentation
This commit is contained in:
@@ -2,13 +2,13 @@
|
||||
|
||||
Welcome to the Llamactl documentation! **Management server and proxy for multiple llama.cpp instances with OpenAI-compatible API routing.**
|
||||
|
||||

|
||||

|
||||
|
||||
## What is Llamactl?
|
||||
|
||||
Llamactl is designed to simplify the deployment and management of llama-server instances. It provides a modern solution for running multiple large language models with centralized management.
|
||||
|
||||
## Why llamactl?
|
||||
## Features
|
||||
|
||||
🚀 **Multiple Model Serving**: Run different models simultaneously (7B for speed, 70B for quality)
|
||||
🔗 **OpenAI API Compatible**: Drop-in replacement - route requests by model name
|
||||
@@ -19,19 +19,6 @@ Llamactl is designed to simplify the deployment and management of llama-server i
|
||||
💡 **On-Demand Instance Start**: Automatically launch instances upon receiving OpenAI-compatible API requests
|
||||
💾 **State Persistence**: Ensure instances remain intact across server restarts
|
||||
|
||||
**Choose llamactl if**: You need authentication, health monitoring, auto-restart, and centralized management of multiple llama-server instances
|
||||
**Choose Ollama if**: You want the simplest setup with strong community ecosystem and third-party integrations
|
||||
**Choose LM Studio if**: You prefer a polished desktop GUI experience with easy model management
|
||||
|
||||
## Key Features
|
||||
|
||||
- 🚀 **Easy Setup**: Quick installation and configuration
|
||||
- 🌐 **Web Interface**: Intuitive web UI for model management
|
||||
- 🔧 **REST API**: Full API access for automation
|
||||
- 📊 **Monitoring**: Real-time health and status monitoring
|
||||
- 🔒 **Security**: Authentication and access control
|
||||
- 📱 **Responsive**: Works on desktop and mobile devices
|
||||
|
||||
## Quick Links
|
||||
|
||||
- [Installation Guide](getting-started/installation.md) - Get Llamactl up and running
|
||||
|
||||
Reference in New Issue
Block a user