174d1772d6
Implement remote proxy handling in instance
2025-10-24 23:16:45 +02:00
55f671c354
Refactor backend options handling and validation
2025-10-19 17:41:08 +02:00
851c73f058
Add tests for status change callback and options preservation
2025-10-18 13:19:01 +02:00
8ac4b370c9
Unexport struct methods
2025-10-18 11:25:26 +02:00
a7740000d2
Refactor instance creation to initialize logger, proxy, and process only for local instances
2025-10-18 10:39:04 +02:00
b13f8c471d
Split off process struct
2025-10-18 10:28:15 +02:00
3f834004a8
Rename NewInstance to New
2025-10-18 00:34:18 +02:00
113b51eda2
Refactor instance node handling to use a map
2025-10-18 00:33:16 +02:00
a1ffdb02a4
Merge main into refactor/instance-split
...
Resolved conflicts in:
- pkg/instance/instance.go: Combined remote detection logic from main with refactored structure
- pkg/manager/manager_test.go: Updated manager initialization to include localNodeName parameter
- pkg/manager/remote_ops.go: Removed stripNodesFromOptions function that was deleted in main
- pkg/manager/remote_ops_test.go: Removed file that was deleted in main
🤖 Generated with [Claude Code](https://claude.ai/code )
Co-Authored-By: Claude <noreply@anthropic.com >
2025-10-17 00:10:09 +02:00
696a2cb18b
Prevent node change on update
2025-10-16 22:35:29 +02:00
5c9a397746
Fix get local proxy
2025-10-16 22:11:29 +02:00
c5097e59be
Fix local instance detection
2025-10-16 21:26:04 +02:00
4b30791be2
Refactor instance options structure and related code
2025-10-16 20:53:24 +02:00
a96ed4d797
Fix status json tag static check
2025-10-16 20:22:12 +02:00
5afc22924f
Refactor Status struct
2025-10-16 20:15:22 +02:00
e0ec00d141
Remove rendundant instance prefix from status
2025-10-16 19:40:03 +02:00
80ca0cbd4f
Rename Process to Instance
2025-10-16 19:38:44 +02:00
964c6345ef
Refactor backend host/port retrieval and remove redundant code for health checks
2025-10-14 22:16:26 +02:00
92a76bc84b
Move proxy to separate struct
2025-10-14 22:01:09 +02:00
02909c5153
Remove redundant instance prefix from logger
2025-10-14 19:46:43 +02:00
ef3478e2a3
Move logging to separate struct
2025-10-14 19:32:15 +02:00
b965b77c18
Prevent remote instances from using local proxy in GetProxy method
2025-10-09 20:24:54 +02:00
8d9b0c0621
Initialize timeProvider and logger in UnmarshalJSON for Process
2025-10-09 18:56:12 +02:00
2759be65a5
Add remote instance management functionality and configuration support
2025-09-30 21:09:05 +02:00
Anuruth Lertpiya
5906d89f8d
Added support for serving behind a reverse proxy
...
- Added support for specifying response headers for each backend
- Allowing users to set `X-Accel-Buffering: no` to disable buffering for streaming responses in nginx
- Updated `configuration.md` to document the new configuration options
- Modified Vite config to build with `base: "./"`, making assets be accessed via relative paths
- Updated API_BASE to use `document.baseURI`, allowing API calls to be made relative to the base path
2025-09-29 12:43:10 +00:00
2cd9d374a7
Add Docker badge to UI
2025-09-25 23:04:24 +02:00
313666ea17
Fix missing vllm proxy setup
2025-09-22 20:51:00 +02:00
468688cdbc
Pass backend options to instances
2025-09-16 21:37:48 +02:00
d697f83b46
Update GetProxy method to use BackendTypeLlamaCpp constant for backend type
2025-09-02 21:56:38 +02:00
d9542ba117
Refactor instance management to support backend types and options
2025-09-01 21:59:18 +02:00
ae37055331
Add onStatusChange callback to instance management for status updates
2025-08-27 20:54:26 +02:00
1443746add
Refactor instance status management: replace Running boolean with InstanceStatus enum and update related methods
2025-08-27 19:44:38 +02:00
7b4adfa0cd
Add DefaultOnDemandStart configuration and update instance options
2025-08-20 13:50:43 +02:00
d70bb634cd
Implement instance tests for timeout
2025-08-17 21:50:16 +02:00
e4e7a82294
Implement last request time tracking for instance management
2025-08-17 19:44:57 +02:00
ccffbca6b2
Add timeout check interval and update instance configuration
2025-08-17 19:26:21 +02:00
902be409d5
Add IdleTimeout option to CreateInstanceOptions and update JSON handling
2025-08-17 19:06:09 +02:00
2abe9c282e
Rename config and instance struct to avoid awkward naming
2025-08-04 19:30:50 +02:00
6a7a9a2d09
Split large package into subpackages
2025-08-04 19:23:56 +02:00
