|
|
894f3c3213
|
Refactor StartInstance method to improve max running instances check
|
2025-08-31 00:14:29 +02:00 |
|
|
|
c1fa0faf4b
|
Add LastRequestTime method and LRU eviction logic for instance management
|
2025-08-30 23:59:37 +02:00 |
|
|
|
4581d67165
|
Enhance instance management: improve on-demand start handling and add LRU eviction logic
|
2025-08-30 23:13:08 +02:00 |
|
|
|
58cb36bd18
|
Refactor instance management: replace CanStartInstance with IsMaxRunningInstancesReached method
|
2025-08-30 23:12:58 +02:00 |
|
|
|
68253be3e8
|
Add CanStartInstance method to check instance start conditions
|
2025-08-30 22:47:15 +02:00 |
|
|
|
a9f1c1a619
|
Add LRU eviction configuration for instances
|
2025-08-30 22:26:02 +02:00 |
|
|
|
74495f8163
|
Refactor Shutdown method to improve instance stopping logic and avoid deadlocks
|
2025-08-30 22:04:43 +02:00 |
|
|
|
9d548e6dda
|
Remove wrong MaxRunningInstancesError type
|
2025-08-28 20:42:56 +02:00 |
|
|
|
41d8c41188
|
Introduce MaxRunningInstancesError type and handle it in StartInstance handler
|
2025-08-28 20:07:03 +02:00 |
|
|
|
e319731239
|
Remove unnecessary read locks from GetStatus and IsRunning methods
|
2025-08-28 19:19:28 +02:00 |
|
|
|
b698c1d0ea
|
Remove locks from SetStatus
|
2025-08-28 19:08:20 +02:00 |
|
|
|
227ca7927a
|
Refactor SetStatus method to capture onStatusChange callback reference before unlocking mutex
|
2025-08-28 18:59:26 +02:00 |
|
|
|
0b058237fe
|
Enforce maximum running instances limit in StartInstance method
|
2025-08-27 21:18:38 +02:00 |
|
|
|
ae37055331
|
Add onStatusChange callback to instance management for status updates
|
2025-08-27 20:54:26 +02:00 |
|
|
|
b41ebdc604
|
Set instance status to Failed when restart conditions are not met
|
2025-08-27 19:47:36 +02:00 |
|
|
|
1443746add
|
Refactor instance status management: replace Running boolean with InstanceStatus enum and update related methods
|
2025-08-27 19:44:38 +02:00 |
|
|
|
615c2ac54e
|
Add MaxRunningInstances to InstancesConfig and implement IsRunning method
|
2025-08-27 18:42:34 +02:00 |
|
|
|
1939b45312
|
Refactor WaitForHealthy method to use direct health check URL and simplify health check logic
|
2025-08-20 15:58:08 +02:00 |
|
|
|
ddb54763f6
|
Add OnDemandStartTimeout configuration and update OpenAIProxy to use it
|
2025-08-20 14:25:43 +02:00 |
|
|
|
287a5e0817
|
Implement WaitForHealthy method and enhance OpenAIProxy to support on-demand instance start
|
2025-08-20 14:19:12 +02:00 |
|
|
|
7b4adfa0cd
|
Add DefaultOnDemandStart configuration and update instance options
|
2025-08-20 13:50:43 +02:00 |
|
|
|
492c3ff270
|
Remove redundant timeout tests and improve test coverage for instance timeout validation
|
2025-08-20 13:25:56 +02:00 |
|
|
|
00a3cba717
|
Enhance shutdown handling in InstanceManager with proper synchronization and max instances check
|
2025-08-19 22:34:48 +02:00 |
|
|
|
eb1d4ab55f
|
Enhance timeout functionality tests to validate configuration and logic without starting instances
|
2025-08-19 20:52:59 +02:00 |
|
|
|
a9e3801eae
|
Refactor logging in checkAllTimeouts
|
2025-08-19 19:25:15 +02:00 |
|
|
|
78eda77e44
|
Enhance timeout handling in InstanceManager with goroutine recovery and shutdown support
|
2025-08-17 22:49:28 +02:00 |
|
|
|
d70bb634cd
|
Implement instance tests for timeout
|
2025-08-17 21:50:16 +02:00 |
|
|
|
41eaebc927
|
Add TimeoutCheckInterval to instance configuration in tests
|
2025-08-17 21:42:52 +02:00 |
|
|
|
c45fa13206
|
Initialize last request time on instance start and update timeout handling logic
|
2025-08-17 21:15:28 +02:00 |
|
|
|
5e3a28398d
|
Implement periodic timeout checking for instances
|
2025-08-17 21:10:48 +02:00 |
|
|
|
c734bcae4a
|
Move UpdateLastRequestTime method to timeout.go and add ShouldTimeout method for idle timeout handling
|
2025-08-17 20:37:20 +02:00 |
|
|
|
e4e7a82294
|
Implement last request time tracking for instance management
|
2025-08-17 19:44:57 +02:00 |
|
|
|
ccffbca6b2
|
Add timeout check interval and update instance configuration
|
2025-08-17 19:26:21 +02:00 |
|
|
|
902be409d5
|
Add IdleTimeout option to CreateInstanceOptions and update JSON handling
|
2025-08-17 19:06:09 +02:00 |
|
|
|
afef3d0180
|
Update import path for API documentation to use apidocs
|
2025-08-07 19:48:28 +02:00 |
|
|
|
a87652937f
|
Move swagger documentation to apidoc
|
2025-08-07 19:48:03 +02:00 |
|
|
|
e2b64620b5
|
Expose version endpoint
|
2025-08-07 19:10:06 +02:00 |
|
|
|
8154b8d0ab
|
Fix temp in tests
|
2025-08-06 18:49:36 +02:00 |
|
|
|
6203b64045
|
Fix missing or wrong llama server options
|
2025-08-06 18:31:17 +02:00 |
|
|
|
85b3638efb
|
Update ValidateInstanceName to return the validated name and modify tests accordingly
|
2025-08-04 20:46:15 +02:00 |
|
|
|
934d1c5aaa
|
Refactor instance management by moving operations to a new file
|
2025-08-04 20:38:57 +02:00 |
|
|
|
2abe9c282e
|
Rename config and instance struct to avoid awkward naming
|
2025-08-04 19:30:50 +02:00 |
|
|
|
6a7a9a2d09
|
Split large package into subpackages
|
2025-08-04 19:23:56 +02:00 |
|
|
|
7426008ef9
|
Use instance directly in DeleteInstance
|
2025-08-02 23:35:03 +02:00 |
|
|
|
3cbd23a6e2
|
Implement persistence tests
|
2025-08-02 22:52:50 +02:00 |
|
|
|
bed172bf73
|
Implement instance loading and auto-start functionality on manager initialization
|
2025-08-02 21:39:19 +02:00 |
|
|
|
d449255bc9
|
Persist instance state after starting and stopping instances
|
2025-08-02 21:23:31 +02:00 |
|
|
|
de89d0673a
|
Implement instance persistence with JSON file storage and deletion
|
2025-08-02 21:09:16 +02:00 |
|
|
|
dd6ffa548c
|
Refactor configuration structure to replace DataConfig with instance-specific directories and auto-creation options
|
2025-08-02 19:10:40 +02:00 |
|
|
|
7935f19cc1
|
Add data directory configuration with auto-creation option
|
2025-08-02 15:33:33 +02:00 |
|
