Skip to content

Conversation

skeptrunedev
Copy link

What does this PR do?

This PR enlarges the allowed request payload to be 0.5GB expressed in bytes - 67110000.

I am submitting this PR to fix a production bug that we were facing with the service where large re-rank requests would fail due to a 413 from axum.

@OlivierDehaene OR @Narsil

@OlivierDehaene
Copy link
Contributor

What's the batch size you are running?

@gerritvd
Copy link

I was looking into making this configurable. What would be the preferred method of doing so? cmd line arg or env var?

@skeptrunedev
Copy link
Author

I was looking into making this configurable. What would be the preferred method of doing so? cmd line arg or env var?

Env var preferably

@skeptrunedev
Copy link
Author

What's the batch size you are running?

I don't recall exactly, but large enough to get this error I guess 😅

@OlivierDehaene
Copy link
Contributor

Closed in favour of #210

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants