Mathis/llamactl
1
0
Fork 0
mirror of https://github.com/lordmathis/llamactl.git synced 2025-11-06 09:04:27 +00:00
Code Issues Packages Projects Releases Wiki Activity
24 Commits 2 Branches 19 Tags
7c2192a48d6d400b58a612c33a9b5cdd2fde8508
Go to file
Clone
Open with VS Code Open with VSCodium Open with Intellij IDEA
Download ZIP Download TAR.GZ Download BUNDLE

README.md

llamactl

Description
Unified management and routing for llama.cpp, MLX and vLLM models with web dashboard.
llama-cppllamacppllama-serverllmllm-inferencellm-routerlocalllamalocalllmmlxmlx-lmopenai-apiself-hostedvllm
Readme MIT 2.9 MiB
Languages
Go 59%
TypeScript 39.5%
CSS 0.9%
JavaScript 0.5%