2759be65a5
Add remote instance management functionality and configuration support
2025-09-30 21:09:05 +02:00
Anuruth Lertpiya
5906d89f8d
Added support for serving behind a reverse proxy
...
- Added support for specifying response headers for each backend
- Allowing users to set `X-Accel-Buffering: no` to disable buffering for streaming responses in nginx
- Updated `configuration.md` to document the new configuration options
- Modified Vite config to build with `base: "./"`, making assets be accessed via relative paths
- Updated API_BASE to use `document.baseURI`, allowing API calls to be made relative to the base path
2025-09-29 12:43:10 +00:00
2cd9d374a7
Add Docker badge to UI
2025-09-25 23:04:24 +02:00
313666ea17
Fix missing vllm proxy setup
2025-09-22 20:51:00 +02:00
468688cdbc
Pass backend options to instances
2025-09-16 21:37:48 +02:00
d697f83b46
Update GetProxy method to use BackendTypeLlamaCpp constant for backend type
2025-09-02 21:56:38 +02:00
d9542ba117
Refactor instance management to support backend types and options
2025-09-01 21:59:18 +02:00
ae37055331
Add onStatusChange callback to instance management for status updates
2025-08-27 20:54:26 +02:00
1443746add
Refactor instance status management: replace Running boolean with InstanceStatus enum and update related methods
2025-08-27 19:44:38 +02:00
7b4adfa0cd
Add DefaultOnDemandStart configuration and update instance options
2025-08-20 13:50:43 +02:00
d70bb634cd
Implement instance tests for timeout
2025-08-17 21:50:16 +02:00
e4e7a82294
Implement last request time tracking for instance management
2025-08-17 19:44:57 +02:00
ccffbca6b2
Add timeout check interval and update instance configuration
2025-08-17 19:26:21 +02:00
902be409d5
Add IdleTimeout option to CreateInstanceOptions and update JSON handling
2025-08-17 19:06:09 +02:00
2abe9c282e
Rename config and instance struct to avoid awkward naming
2025-08-04 19:30:50 +02:00
6a7a9a2d09
Split large package into subpackages
2025-08-04 19:23:56 +02:00
