Time Series Forecasting LLM Support

[spectral-sequence]

Chronos appears to be a great open source time series forecasting model.
Is it possible to integrate this model into llama.cpp?

https://github.com/amazon-science/chronos-forecasting

[ngxson]

This model uses T5 architecture so we firstly need to support T5, see this issue: #5763

Beside that, this model doesn't have a tokenizer (since time-series signal is converted directly into tokens), so convert script may fail. We can simply add a dummy tokenizer before converting to solve that problem. An example of the HF model (without tokenizer) can be found here: https://huggingface.co/amazon/chronos-t5-small/tree/main

[github-actions]

This issue was closed because it has been inactive for 14 days since being marked as stale.