Skip to content

Provide daily dumps of the pypi index #12242

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
bitplane opened this issue Sep 21, 2022 · 1 comment
Closed

Provide daily dumps of the pypi index #12242

bitplane opened this issue Sep 21, 2022 · 1 comment
Labels
feature request requires triaging maintainers need to do initial inspection of issue

Comments

@bitplane
Copy link

What's the problem this feature will solve?

pip search is broken in the default use-case because the XMLRPC service is down.

Providing a nightly dump would mean it'd be easy to fix - just download the list and search it locally. If it was just a file somewhere then you could redirect to a mirror that has it, I'm sure many organizations with lots of bandwidth would happily mirror it to keep pypi's search working. Plus it'd be a useful file in general.

Describe the solution you'd like
Dump the packages, versions, description and a list of downloads to a file. Dump it somewhere and let it the pip search problem fix itself.

Additional context
A useful alternative to pip search out of the box, pip-search, scrapes the website at the moment. The next time someone makes an abusive bot that hammers that endpoint, then I assume you'll have the search problem all over again.

@bitplane bitplane added feature request requires triaging maintainers need to do initial inspection of issue labels Sep 21, 2022
@di
Copy link
Member

di commented Sep 21, 2022

Duplicate of #8802.

@di di closed this as completed Sep 21, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
feature request requires triaging maintainers need to do initial inspection of issue
Projects
None yet
Development

No branches or pull requests

2 participants