|
|
38790aa507
|
Support llama.cpp router mode for openai endpoints
|
2025-12-21 23:32:33 +01:00 |
|
|
|
faf026aa54
|
Remove model registry
|
2025-12-21 20:48:22 +01:00 |
|
|
|
fd9e651e09
|
Implement model management for llama.cpp instances
|
2025-12-18 19:14:20 +01:00 |
|
|
|
0a85409deb
|
Split large config file
|
2025-12-13 13:50:59 +01:00 |
|
|
|
c0cecdd377
|
Clean up logger
|
2025-12-13 13:18:30 +01:00 |
|
|
|
4d57b37a5d
|
Remove verbose _mb suffix
|
2025-12-13 13:06:22 +01:00 |
|
|
|
406a711682
|
Move LogRotationConfig to logger package
|
2025-12-13 12:48:50 +01:00 |
|
|
|
0b3d654945
|
Simplify logging config
|
2025-12-13 12:48:50 +01:00 |
|
|
|
e2a49402d6
|
Implement instance log rotation
|
2025-12-13 12:48:50 +01:00 |
|
|
|
0fee7abc7c
|
Simplify create key request format
|
2025-12-06 22:20:05 +01:00 |
|
|
|
02193bd309
|
Add instance ID to JSON output
|
2025-12-06 21:28:17 +01:00 |
|
|
|
0217f7cc4e
|
Fix instance creation to retrieve and set the auto-generated ID
|
2025-12-06 20:58:17 +01:00 |
|
|
|
fa311c46ac
|
Improve server shutdown process
|
2025-12-06 19:52:40 +01:00 |
|
|
|
99927160c2
|
Remove 'can_infer' field
|
2025-12-06 18:07:01 +01:00 |
|
|
|
c37c1b8161
|
Remove 'enabled' field from API key model and related database operations
|
2025-12-06 17:59:11 +01:00 |
|
|
|
2d0acc60f2
|
Fix double dash in generated keys
|
2025-12-04 23:25:51 +01:00 |
|
|
|
991ce3c678
|
Remove unnecessary canviewlogs permission
|
2025-12-04 22:18:29 +01:00 |
|
|
|
d9c666a245
|
Update deprication warnings
|
2025-12-04 21:23:22 +01:00 |
|
|
|
85cf712b03
|
Update api docs
|
2025-12-03 21:25:03 +01:00 |
|
|
|
5ccf493e04
|
Add permission checks to proxies
|
2025-12-03 21:14:44 +01:00 |
|
|
|
9eee42c673
|
Initial api key store implementation
|
2025-12-03 20:31:38 +01:00 |
|
|
|
3fd597638b
|
Fix migration
|
2025-12-02 20:38:52 +01:00 |
|
|
|
00114caa00
|
Add db config and move data dir config
|
2025-12-02 20:38:52 +01:00 |
|
|
|
7272aa26ec
|
Refactor database interface and migration functions
|
2025-12-02 20:38:52 +01:00 |
|
|
|
fec989fee2
|
Implement SQLite database persistence for instance management
|
2025-12-02 20:38:52 +01:00 |
|
|
|
4f8f4b96cd
|
Fix docker_enabled inconsistency
|
2025-11-14 23:41:16 +01:00 |
|
|
|
7544fbb1ce
|
Refactor JSON marshaling in Options to improve thread safety
|
2025-11-14 21:50:58 +01:00 |
|
|
|
4f4feacaa8
|
Remove manual config fields assignment
|
2025-11-14 20:38:36 +01:00 |
|
|
|
2c28971e15
|
Add JSON tags to configuration structs
|
2025-11-14 20:37:33 +01:00 |
|
|
|
e77ed0cdef
|
Deep copy config for sanitization
|
2025-11-14 20:25:40 +01:00 |
|
|
|
623e258a2a
|
Add API endpoint to retrieve sanitized server configuration
|
2025-11-14 18:57:03 +01:00 |
|
|
|
511889e56d
|
Implement per instance command override on backend
|
2025-11-14 18:38:31 +01:00 |
|
|
|
11bfe75a3c
|
Add support for extra args for command parser
|
2025-11-13 20:41:08 +01:00 |
|
|
|
ae5358ff65
|
Change FlashAttn field type to string in LlamaServerOptions
|
2025-11-12 23:49:34 +01:00 |
|
|
|
bff8e7d914
|
Refactor command line argument keys to use snake_case format in LlamaServerOptions
|
2025-11-12 23:46:15 +01:00 |
|
|
|
5ad076919e
|
Add extra args test to backend
|
2025-11-12 23:40:07 +01:00 |
|
|
|
8d92f9b371
|
Add ExtraArgs support for Llama, Mlx, and Vllm server options
|
2025-11-12 23:11:22 +01:00 |
|
|
|
560850f86d
|
Add shutdown state checks in HTTP handlers
|
2025-10-30 18:00:59 +01:00 |
|
|
|
77c0e22fd0
|
Use instance's ServeHTTP in handlers
|
2025-10-29 00:01:29 +01:00 |
|
|
|
d65c5ab717
|
Wait for inflight requests before stopping
|
2025-10-29 00:00:56 +01:00 |
|
|
|
2b94244c8a
|
Replace GetProxy with ServeHttp in instance
|
2025-10-29 00:00:02 +01:00 |
|
|
|
2e5644db53
|
Implement inflight request tracking
|
2025-10-28 23:59:02 +01:00 |
|
|
|
7ee22fee51
|
Implement shutting down status
|
2025-10-28 23:53:11 +01:00 |
|
|
|
f9eb424690
|
Fix concurrent map write issue in MarshalJSON by initializing BackendOptions
|
2025-10-27 20:36:42 +01:00 |
|
|
|
dfcc16083c
|
Update test configuration to use 'sh -c "sleep 999999"' command
|
2025-10-27 19:25:13 +01:00 |
|
|
|
6ec2919049
|
Fix instance start simulation in TestUpdateInstance
|
2025-10-27 19:14:54 +01:00 |
|
|
|
d6a6f377fc
|
Fix logger race condition
|
2025-10-27 19:06:06 +01:00 |
|
|
|
cd9a71d9fc
|
Update test configuration to use 'yes' command instead of 'sleep'
|
2025-10-27 18:54:20 +01:00 |
|
|
|
2c4cc5a69a
|
Fix manager tests
|
2025-10-27 18:47:17 +01:00 |
|
|
|
b1fc1d2dc8
|
Add InstancesDir to test configuration for instance management
|
2025-10-27 18:38:23 +01:00 |
|
