28 Commits

Author SHA1 Message Date
f9eb424690 Fix concurrent map write issue in MarshalJSON by initializing BackendOptions 2025-10-27 20:36:42 +01:00
ea6c76cc96 Update multi valued flags in backends 2025-10-25 19:02:46 +02:00
bd6436840e Implement common ParseCommand interface 2025-10-25 18:41:46 +02:00
b25ad48605 Refactor backend options marshaling/unmarshaling 2025-10-19 20:48:05 +02:00
d8e0da9cf8 Refactor backend options to implement common interface and streamline validation 2025-10-19 20:36:57 +02:00
f42f000539 Implement mlx and cllm tests and remove redundant code 2025-10-19 19:45:31 +02:00
55f671c354 Refactor backend options handling and validation 2025-10-19 17:41:08 +02:00
2a7010d0e1 Flatten backends package structure 2025-10-19 15:50:42 +02:00
bc9e0535c3 Refactor command building and argument handling 2025-09-25 22:05:46 +02:00
76ac93bedc Implement Docker command handling for Llama, MLX, and vLLM backends 2025-09-24 21:31:58 +02:00
184d6df1bc Fix vllm command parsing 2025-09-22 21:25:50 +02:00
c3ca5b95f7 Update BuildCommandArgs to use positional argument for model and adjust tests accordingly 2025-09-22 20:32:03 +02:00
7eb59aa7e0 Remove unused JSON unmarshal test and clean up command argument checks 2025-09-19 20:46:25 +02:00
64842e74b0 Refactor command parsing and building 2025-09-19 20:23:25 +02:00
34a949d22e Refactor command argument building and parsing 2025-09-19 19:59:46 +02:00
ec5485bd0e Refactor command argument building across backends 2025-09-19 19:46:54 +02:00
9eecb37aec Refactor MLX and VLLM server options parsing and args building 2025-09-19 19:39:36 +02:00
c7136d5206 Refactor command parsing logic across backends to utilize a unified CommandParserConfig structure 2025-09-19 18:36:23 +02:00
4df02a6519 Initial vLLM backend support 2025-09-19 18:05:12 +02:00
5121f0e302 Remove PythonPath references from MlxServerOptions and related configurations 2025-09-17 21:59:55 +02:00
988c4aca40 Add MLX backend config options 2025-09-16 21:14:19 +02:00
1b5934303b Enhance command parsing in ParseLlamaCommand and improve error handling in ParseCommandRequest 2025-09-15 22:12:56 +02:00
e7b06341c3 Enhance command parsing in ParseLlamaCommand 2025-09-15 21:29:46 +02:00
323056096c Implement llama-server command parsing and add UI components for command input 2025-09-15 21:04:14 +02:00
d9542ba117 Refactor instance management to support backend types and options 2025-09-01 21:59:18 +02:00
8154b8d0ab Fix temp in tests 2025-08-06 18:49:36 +02:00
6203b64045 Fix missing or wrong llama server options 2025-08-06 18:31:17 +02:00
6a7a9a2d09 Split large package into subpackages 2025-08-04 19:23:56 +02:00