1ae28a0b09
Unexport member struct methods
2025-10-20 22:22:09 +02:00
c537bc48b8
Refactor API path handling in remoteManager to use a constant for base path
2025-10-20 22:00:06 +02:00
ffb4b49c94
Split manager into multiple structs
2025-10-20 21:55:50 +02:00
9da2433a7c
Refactor instance and manager tests to use BackendOptions structure
2025-10-19 18:07:14 +02:00
55f671c354
Refactor backend options handling and validation
2025-10-19 17:41:08 +02:00
2a7010d0e1
Flatten backends package structure
2025-10-19 15:50:42 +02:00
3f834004a8
Rename NewInstance to New
2025-10-18 00:34:18 +02:00
113b51eda2
Refactor instance node handling to use a map
2025-10-18 00:33:16 +02:00
a1ffdb02a4
Merge main into refactor/instance-split
...
Resolved conflicts in:
- pkg/instance/instance.go: Combined remote detection logic from main with refactored structure
- pkg/manager/manager_test.go: Updated manager initialization to include localNodeName parameter
- pkg/manager/remote_ops.go: Removed stripNodesFromOptions function that was deleted in main
- pkg/manager/remote_ops_test.go: Removed file that was deleted in main
🤖 Generated with [Claude Code](https://claude.ai/code )
Co-Authored-By: Claude <noreply@anthropic.com >
2025-10-17 00:10:09 +02:00
9f3c01384b
Remove stripNodesFromOptions function
2025-10-16 21:29:27 +02:00
c5097e59be
Fix local instance detection
2025-10-16 21:26:04 +02:00
4b30791be2
Refactor instance options structure and related code
2025-10-16 20:53:24 +02:00
5afc22924f
Refactor Status struct
2025-10-16 20:15:22 +02:00
e0ec00d141
Remove rendundant instance prefix from status
2025-10-16 19:40:03 +02:00
80ca0cbd4f
Rename Process to Instance
2025-10-16 19:38:44 +02:00
9ee0a184b3
Re-validate instance name in DeleteInstance for improved security
2025-10-09 22:18:53 +02:00
5436c28a1f
Add instance name validation before deletion for security
2025-10-09 22:10:40 +02:00
e7a6a7003e
Skip remote instances in checkAllTimeouts and EvictLRUInstance methods
2025-10-09 21:13:38 +02:00
2b950ee649
Implement updateLocalInstanceFromRemote to preserve Nodes field when syncing remote instance data
2025-10-09 20:39:21 +02:00
8a16a195de
Fix getting remote instance logs
2025-10-09 20:22:32 +02:00
9684a8a09b
Enhance instance management to preserve local state for remote instances
2025-10-09 19:34:52 +02:00
e281708b20
Enhance auto-start logic to differentiate between remote and local instances
2025-10-09 18:56:23 +02:00
7f6725da96
Refactor NodeConfig handling to use a map
2025-10-08 19:24:24 +02:00
3418735204
Add stripNodesFromOptions function to prevent routing loops in remote requests
2025-10-07 20:27:31 +02:00
2f1cf5acdc
Refactor CreateRemoteInstance and UpdateRemoteInstance to directly use options parameter in API requests
2025-10-07 19:57:21 +02:00
01380e6641
Update instance manager tests to use empty NodeConfig slice
2025-10-07 19:18:13 +02:00
16b28bac05
Merge branch 'main' into feat/multi-host
2025-10-07 18:04:24 +02:00
d15976e7aa
Implement auto-stop for instances with auto-restart disabled and add corresponding tests
2025-10-04 21:17:55 +02:00
c30053e51c
Enhance instance loading to support remote instances and handle node configuration
2025-10-01 22:59:45 +02:00
347c58e15f
Enhance instance manager to persist remote instances and update tracking on modifications
2025-10-01 22:58:57 +02:00
0188f82306
Implement remote instance creation and deletion in instance manager
2025-10-01 22:05:18 +02:00
e0f176de10
Enhance instance manager to support remote instance management and update related tests
2025-10-01 20:25:06 +02:00
2759be65a5
Add remote instance management functionality and configuration support
2025-09-30 21:09:05 +02:00
ba0f877185
Fix tests
2025-09-24 21:35:44 +02:00
840a7bc650
Add Docker command handling for backend options and refactor command building
2025-09-24 21:34:54 +02:00
313666ea17
Fix missing vllm proxy setup
2025-09-22 20:51:00 +02:00
2a20817078
Remove redundant LlamaExecutable field from instance configuration in tests
2025-09-18 20:29:04 +02:00
cc5d8acd92
Refactor instance and manager tests to use BackendConfig for LlamaExecutable and MLXLMExecutable
2025-09-16 21:45:50 +02:00
154b754aff
Add MLX command parsing and routing support
2025-09-16 21:39:08 +02:00
468688cdbc
Pass backend options to instances
2025-09-16 21:37:48 +02:00
712d28ea42
Remove port marking logic from CreateInstance method
2025-09-02 21:56:25 +02:00
d9542ba117
Refactor instance management to support backend types and options
2025-09-01 21:59:18 +02:00
9579930a6a
Simplify LRU eviction tests
2025-08-31 11:46:16 +02:00
447f441fd0
Move LRU eviction to timeout.go
2025-08-31 11:42:32 +02:00
27012b6de6
Split manager tests into multiple test files
2025-08-31 11:39:44 +02:00
905e685107
Add LRU eviction tests for instance management
2025-08-31 11:30:57 +02:00
d6d4792a0c
Skip eviction for instances without a valid idle timeout
2025-08-31 00:59:26 +02:00
894f3c3213
Refactor StartInstance method to improve max running instances check
2025-08-31 00:14:29 +02:00
c1fa0faf4b
Add LastRequestTime method and LRU eviction logic for instance management
2025-08-30 23:59:37 +02:00
58cb36bd18
Refactor instance management: replace CanStartInstance with IsMaxRunningInstancesReached method
2025-08-30 23:12:58 +02:00
