e281708b20
Enhance auto-start logic to differentiate between remote and local instances
2025-10-09 18:56:23 +02:00
8d9b0c0621
Initialize timeProvider and logger in UnmarshalJSON for Process
2025-10-09 18:56:12 +02:00
6c1a76691d
Improve cleanup of options in InstanceDialog to skip empty strings and arrays
2025-10-09 18:49:36 +02:00
5d958ed283
Fix backend_options cleanup to exclude empty arrays in InstanceDialog
2025-10-09 18:38:33 +02:00
56b95d1243
Refactor InstanceSettingsCard and API types to use NodesMap
2025-10-08 19:52:39 +02:00
688b815ca7
Add LocalNode configuration
2025-10-08 19:43:53 +02:00
7f6725da96
Refactor NodeConfig handling to use a map
2025-10-08 19:24:24 +02:00
3418735204
Add stripNodesFromOptions function to prevent routing loops in remote requests
2025-10-07 20:27:31 +02:00
2f1cf5acdc
Refactor CreateRemoteInstance and UpdateRemoteInstance to directly use options parameter in API requests
2025-10-07 19:57:21 +02:00
01380e6641
Update instance manager tests to use empty NodeConfig slice
2025-10-07 19:18:13 +02:00
6298b03636
Refactor RemoteOpenAIProxy to use cached proxies and restore request body handling
2025-10-07 18:57:08 +02:00
aae3f84d49
Implement caching for remote instance proxies and enhance proxy request handling
2025-10-07 18:44:23 +02:00
554796391b
Remove test config file
2025-10-07 18:05:30 +02:00
16b28bac05
Merge branch 'main' into feat/multi-host
2025-10-07 18:04:24 +02:00
1892dc8315
Merge pull request #57 from BobbyL2k/feat/llama-cpp-proxy
...
feat: Proxy llama.cpp API endpoints via `/llama-cpp/{name}/`
2025-10-06 20:23:44 +02:00
Anuruth Lertpiya
997bd1b063
Changed status code to StatusBadRequest (400) if requested invalid model name.
2025-10-05 14:53:20 +00:00
Anuruth Lertpiya
fa43f9e967
Added support for proxying llama.cpp native API endpoints via /llama-cpp/{name}/
2025-10-05 14:28:33 +00:00
db9eebeb8b
Merge pull request #56 from lordmathis/fix/body-already-read
...
Fix double read of json response when content-length header is missing
2025-10-04 22:28:22 +02:00
bd062f8ca0
Mock Response.clone for tests
2025-10-04 22:22:25 +02:00
8ebdb1a183
Fix double read of json response when content-length header is missing
2025-10-04 22:16:28 +02:00
7272212081
Merge pull request #55 from lordmathis/fix/auto-restart
...
fix: Set status to Stopped for instances with auto-restart disabled
2025-10-04 21:45:12 +02:00
035e184789
Merge branch 'main' into fix/auto-restart
2025-10-04 21:22:50 +02:00
d15976e7aa
Implement auto-stop for instances with auto-restart disabled and add corresponding tests
2025-10-04 21:17:55 +02:00
4fa75d9801
Merge pull request #52 from BobbyL2k/feat/config-cors-headers
...
feat: Added support for configuring access-control-request-headers for CORS
2025-10-04 20:45:27 +02:00
Anuruth Lertpiya
0e1bc8a352
Added support for configuring CORS headers
2025-10-04 09:13:40 +00:00
b728a7c6b2
Fix fetchNodes call to ensure proper handling of promise
2025-10-03 10:53:29 +02:00
a491f29483
Add node selection functionality to InstanceSettingsCard and define Node API
2025-10-02 23:18:33 +02:00
670f8ff81b
Split up handlers
2025-10-02 23:11:20 +02:00
da56456504
Add node management endpoints to handle listing and retrieving node details
2025-10-02 22:51:41 +02:00
c30053e51c
Enhance instance loading to support remote instances and handle node configuration
2025-10-01 22:59:45 +02:00
347c58e15f
Enhance instance manager to persist remote instances and update tracking on modifications
2025-10-01 22:58:57 +02:00
2ed67eb672
Add remote instance proxying functionality to handler
2025-10-01 22:17:19 +02:00
0188f82306
Implement remote instance creation and deletion in instance manager
2025-10-01 22:05:18 +02:00
e0f176de10
Enhance instance manager to support remote instance management and update related tests
2025-10-01 20:25:06 +02:00
2759be65a5
Add remote instance management functionality and configuration support
2025-09-30 21:09:05 +02:00
1e5e86d2c3
Merge pull request #50 from lordmathis/feat/docker-image
...
feat: Add Dockerfiles for running llamactl in docker
2025-09-29 21:26:23 +02:00
25d3d70707
Update README and installation guide to reflect Dockerfile paths and add source build instructions
2025-09-29 21:18:13 +02:00
e54cfd006d
Add Dockerfile for building from source
2025-09-29 21:17:40 +02:00
7d39e7ee86
Move docker stuff to a dedicated folder
2025-09-29 21:16:51 +02:00
222d913b4a
Merge pull request #49 from BobbyL2k/feat/reverse-proxy-support
...
Added support for serving behind a reverse proxy
2025-09-29 20:32:11 +02:00
Anuruth Lertpiya
03a7a5d139
Update configration.md with reverse proxy related information
2025-09-29 13:54:15 +00:00
Anuruth Lertpiya
e50660c379
Fixed broken webui tests
2025-09-29 13:38:24 +00:00
Anuruth Lertpiya
5906d89f8d
Added support for serving behind a reverse proxy
...
- Added support for specifying response headers for each backend
- Allowing users to set `X-Accel-Buffering: no` to disable buffering for streaming responses in nginx
- Updated `configuration.md` to document the new configuration options
- Modified Vite config to build with `base: "./"`, making assets be accessed via relative paths
- Updated API_BASE to use `document.baseURI`, allowing API calls to be made relative to the base path
2025-09-29 12:43:10 +00:00
cb2d95139f
Setup data dir in Docker and docker-compose
2025-09-28 22:17:38 +02:00
889a8707e7
Refactor Dockerfile and docker-compose to streamline environment variable configuration and remove redundant commands
2025-09-28 22:17:38 +02:00
070c91787d
Add environment variable for llamactl command in Dockerfile
2025-09-28 22:17:38 +02:00
169ee422ec
Update README and installation guide to clarify Docker support and CUDA configuration
2025-09-28 22:17:38 +02:00
bb0176b7f5
Update Dockerfile to use server-cuda image for improved performance
2025-09-28 22:17:38 +02:00
291ec7995f
Update Docker run commands to use cached directories and remove unnecessary environment variables
2025-09-28 22:17:38 +02:00
b940b38e46
Initial support for docker
2025-09-28 22:17:38 +02:00
