ggml-cuda : perform cublas mat mul of quantized types as f16#3412

slaren merged 3 commits intomasterggml-org/llama.cpp:masterfrom

cublas-q-f16ggml-org/llama.cpp:cublas-q-f16Copy head branch name to clipboard