Run T5 ggml

[phanxuanphucnd]

Dear author,

How can i run t5 like gpt-2 or gpt-j?

Thank

[walking-octopus]

• GPT-2 and GPT-J usage is outlined in the README.
• T5 inference is being worked on in PR Add example for text-to-text transfer transformer (T5) inference #12.

[redthing1]

Since ggerganov said this is no longer a priority, I recommend CTranslate2 to do fast Python-free CPU inference of T5 family models.