Skip to content

MPI bug for MAC when writing lots of files #116

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
kuberry opened this issue Oct 4, 2019 · 0 comments
Closed

MPI bug for MAC when writing lots of files #116

kuberry opened this issue Oct 4, 2019 · 0 comments
Labels
bug Something isn't working minutiae Knowledge database workaround

Comments

@kuberry
Copy link
Collaborator

kuberry commented Oct 4, 2019

We won't be fixing this error. If a user has Open MPI from before early 2018 (any version, I believe), a file description leak will prevent an application from writing more than ulimit number of times.

Details at:
open-mpi/ompi#4336

ulimit is usually 256, so this won't be a problem for many of our applications, but if you write output files at every timestep, you can see how this could easily become a problem.

Two ways to address it:

  • reinstall Open MPI to a newer version, then reinstall NetCDF, etc...
    or
  • Set ulimit -n 1024 or some other large number than the number of files you intend to write with one call of an executable.
@kuberry kuberry added bug Something isn't working minutiae Knowledge database workaround labels Oct 4, 2019
@kuberry kuberry closed this as completed Oct 4, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working minutiae Knowledge database workaround
Projects
None yet
Development

No branches or pull requests

1 participant