Skip to content

Misc. bug: llama-server: running behind a reverse proxy is now broken #16338

@d-a-v

Description

@d-a-v

Name and Version

version: 6589 (3b337b0)
built with cc (Debian 12.2.0-14+deb12u1) 12.2.0 for x86_64-linux-gnu

Operating systems

Linux

Which llama.cpp modules do you know to be affected?

llama-server

Command line

llama-server --model models/model.gguf --port 1234 --host 0.0.0.0

Problem description & steps to reproduce

reference

Reverse proxy works no more with apache.
Maybe a beginning of an answer is there: https://svelte.dev/docs/kit/hooks#externalfetch

The apache2 config I was using and which is now broken is:

<location "/llm/">
    ProxyPreserveHost On
    ProxyPass http://server-hosting-llama-server:1234/
    ProxyPassReverse http://server-hosting-llama-server:1234/
    RequestHeader set X-Forwarded-Proto http
    RequestHeader set X-Forwarded-Prefix /llm/
</location>

First Bad Commit

#14839

Relevant log output

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions