separate PromQL's parse from its func/aggr calculation

[jiacai2050]

It seems Cortex is no difference with Thanos, just a long-term storage engine backend.

What I recently want is to separate PromQL's parse from its func/aggr calculation, push down to underlying storage, leverage storage's distributed computing with PromQL's rich expression. Is there any project working on this ?
Will Cortex support this?

[bboreham]

Are you asking how a single Prometheus query can be distributed across multiple processes to take advantage of multiple machines to execute on?

Cortex can split queries by time, typically by day, and execute those pieces in parallel. Since the storage is also split by day this gives decent distribution.

There has been some work to look at splitting queries in other ways: https://docs.google.com/document/d/1Phv74bMp7MjNhlmIoxDp2kSqykOzT4YmJvng4EeBk0M

[jiacai2050]

@bboreham My question is similar to Proposal I in the google doc you link.

In prometheus's remote query, there is a storage.SelectParams which contains a Func field, but isn't used.
I asked this in google group, and is implementing this feature in a tsdb designed within my company.

[bboreham]

Ok; shall we close this issue then?

[jiacai2050]

What's the progress of Proposal I? Maybe I can participate with this.

[gouthamve]

Hi, I am closing this issue as we have more concrete ways of how to do this:
#1796 and #1730

If you think there are more ways of achieving the same, please feel free to reopen this.