Mathis/llamactl
1
0
Fork 0
mirror of https://github.com/lordmathis/llamactl.git synced 2025-11-06 00:54:23 +00:00
Code Issues Packages Projects Releases Wiki Activity

Add LastRequestTime method and LRU eviction logic for instance management

Browse Source
This commit is contained in:
Matúš Námešný
2025-08-30 23:59:37 +02:00
parent 4581d67165
commit c1fa0faf4b
3 changed files with 35 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

1
pkg/manager/manager.go
View File

@@ -23,6 +23,7 @@ type InstanceManager interface {
StartInstance(name string) (*instance.Process, error)
IsMaxRunningInstancesReached() bool
StopInstance(name string) (*instance.Process, error)
EvictLRUInstance() error
RestartInstance(name string) (*instance.Process, error)
GetInstanceLogs(name string) (string, error)
Shutdown()