Mathis/llamactl
1
0
Fork 0
mirror of https://github.com/lordmathis/llamactl.git synced 2025-12-23 09:34:23 +00:00
Code Issues Packages Projects Releases Wiki Activity

Change FlashAttn field type to string in LlamaServerOptions

Browse Source
This commit is contained in:
Matúš Námešný
2025-11-12 23:49:34 +01:00
parent bff8e7d914
commit ae5358ff65
3 changed files with 5 additions and 28 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
pkg/backends/llama.go
View File

@@ -41,7 +41,7 @@ type LlamaServerOptions struct {
BatchSize int `json:"batch_size,omitempty"`
UBatchSize int `json:"ubatch_size,omitempty"`
Keep int `json:"keep,omitempty"`
FlashAttn bool `json:"flash_attn,omitempty"`
FlashAttn string `json:"flash_attn,omitempty"`
NoPerf bool `json:"no_perf,omitempty"`
Escape bool `json:"escape,omitempty"`
NoEscape bool `json:"no_escape,omitempty"`