Skip to content

Retrieve model chunk size #907

Open
Open
@billschereriii

Description

@billschereriii

Is your feature request related to a problem? Please describe.
I don't believe there is a way for the client to retrieve the model chunk size. It can be set via AI.CONFIG, but I see no way to get the current setting back out.

Describe the solution you'd like
The cleanest approach would be to make a new command, say AI.RETRIEVECONFIG, that includes this information. It could also indicate whether the various backends have been loaded, for symmetry with AI.CONFIG

Describe alternatives you've considered
I'm not aware of any alternatives

Additional context
We're implementing model chunking support in SmartSim and are concerned that if one client sets a model chunk size, there is no way for a second to realize that the chunk size has been adjusted. While we're really only implementing AI.CONFIG to test chunking behavior, there could be a larger role for it someday.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions