Skip to content

CUDA: mul_mat_q=true as default for llama_context_params#2912

Merged
JohannesGaessler merged 1 commit intoggml-org:masterfrom JohannesGaessler:cuda-mmq-default-2Aug 30, 2023
+1-1

Commits

Commits on Aug 30, 2023