Merge pull request #6356 from rhc54/topic/pmixup

Update to latest PRI master

Author: rhc54

opal/mca/pmix/pmix4x/pmix/HACKING

@@ -8,8 +8,8 @@ Copyright (c) 2004-2005 High Performance Computing Center Stuttgart,
                         University of Stuttgart.  All rights reserved.
 Copyright (c) 2004-2005 The Regents of the University of California.
                         All rights reserved.
-Copyright (c) 2008-2018 Cisco Systems, Inc.  All rights reserved
-Copyright (c) 2013-2017 Intel, Inc. All rights reserved.
+Copyright (c) 2008-2015 Cisco Systems, Inc.  All rights reserved.
+Copyright (c) 2013-2019 Intel, Inc.  All rights reserved.
 $COPYRIGHT$
 
 Additional copyrights may follow
@@ -38,13 +38,21 @@ By definition, debugging builds will perform [much] slower than
 optimized builds of PMIx.  You should *NOT* conduct timing tests
 or try to run production performance numbers with debugging builds.
 
+NOTE: this version of PMIx requires the Libevent package to build
+and operate. Any version of Libevent greater than or equal to
+2.0.21 is acceptable. It optionally supports the HWLOC package
+for providing topology information to both the host environment
+(by collecting local inventory for rollup) and local client
+processes. Any version of HWLOC greater than 1.10 is supported,
+although versions in the 2.x series are recommended.
+
 If you wish to build an optimized version of PMIx from a
 developer's checkout, you have three main options:
 
 1. Use the "--with-platform=optimized" switch to configure.  This is
    the preferred (and probably easiest) method.  For example:
 
-     shell$ git clone git@github.com:pmix/master.git pmix
+     shell$ git clone https://github.com/pmix/pmix.git pmix
      shell$ cd pmix
      shell$ ./autogen.pl
      shell$ mkdir build
@@ -57,7 +65,7 @@ developer's checkout, you have three main options:
    directory than the source tree -- one where the .git subdirectory
    is not present.  For example:
 
-     shell$ git clone git@github.com:pmix/master.git pmix
+     shell$ git clone https://github.com/pmix/pmix.git pmix
      shell$ cd pmix
      shell$ ./autogen.pl
      shell$ mkdir build
@@ -80,6 +88,15 @@ developer's checkout, you have three main options:
      shell$ make all install
 
 
+Note that in all cases you must point configure at the libevent
+installation using the --with-libevent=<dir> option if it is in
+a non-standard location. Similarly, non-standard locations for
+the HWLOC package must be specified using the --with-hwloc=<dir>
+option. In both cases, PMIx will automatically detect these
+packages in standard locations and build-in support for them
+unless otherwise specified using the respective configure option.
+
+
 Use of GNU Autoconf, Automake, and Libtool (and m4)
 ===================================================
 
@@ -96,7 +113,7 @@ required depend on if you are using the master or a release branch (and
 which release branch you are using).  The specific versions can be
 found at:
 
-    https://pmix.github.io/pmix/faq/building
+    https://pmix.org/code/getting-the-reference-implementation/
 
 You can check what versions of the autotools you have installed with
 the following:
@@ -205,17 +222,17 @@ NOTE: On MacOS/X, the default "libtool" program is different than the
    m4, Autoconf and Automake build and install very quickly; Libtool will
    take a minute or two.
 
-5. You can now run PMIx’s top-level "autogen.pl" script.  This script
+5. You can now run PMIx’s top-level "autogen.sh" script.  This script
    will invoke the GNU Autoconf, Automake, and Libtool commands in the
    proper order and setup to run PMIx's top-level "configure" script.
 
-   5a. You generally need to run autogen.pl only when the top-level
+   5a. You generally need to run autogen.sh only when the top-level
        file "configure.ac" changes, or any files in the config/ or
        <project>/config/ directories change (these directories are
        where a lot of "include" files for PMI’xs configure script
        live).
 
-   5b. You do *NOT* need to re-run autogen.pl if you modify a
+   5b. You do *NOT* need to re-run autogen.sh if you modify a
        Makefile.am.
 
 Use of Flex

opal/mca/pmix/pmix4x/pmix/INSTALL

@@ -8,8 +8,8 @@ Copyright (c) 2004-2005 High Performance Computing Center Stuttgart,
                         University of Stuttgart.  All rights reserved.
 Copyright (c) 2004-2005 The Regents of the University of California.
                         All rights reserved.
-Copyright (c) 2008-2018 Cisco Systems, Inc.  All rights reserved
-Copyright (c) 2013-2017 Intel, Inc. All rights reserved.
+Copyright (c) 2008-2015 Cisco Systems, Inc.  All rights reserved.
+Copyright (c) 2013-2019 Intel, Inc.  All rights reserved.
 $COPYRIGHT$
 
 Additional copyrights may follow
@@ -22,9 +22,9 @@ For More Information
 
 This file is a *very* short overview of building and installing
 the PMIx library.  Much more information is available in the
-FAQ section on the PMIx web site:
+How-To section on the PMIx web site:
 
-    http://pmix.github.io/pmix/faq
+    https://pmix.org/support/how-to/
 
 
 Developer Builds
@@ -37,7 +37,7 @@ build PMIx.  You must then run:
 shell$ ./autogen.pl
 
 You will need very recent versions of GNU Autoconf, Automake, and
-Libtool.  If autogen.pl fails, read the HACKING file.  If anything
+Libtool.  If autogen.sh fails, read the HACKING file.  If anything
 else fails, read the HACKING file.  Finally, we suggest reading the
 HACKING file.
 
@@ -56,6 +56,24 @@ shell$ ./configure --prefix=/where/to/install
 [...lots of output...]
 shell$ make all install
 
+NOTE: this version of PMIx requires the Libevent package to build
+and operate. Any version of Libevent greater than or equal to
+2.0.21 is acceptable.
+
+NOTE: this version of PMIx optionally supports the HWLOC package
+for providing topology information to both the host environment
+(by collecting local inventory for rollup) and local client
+processes. Any version of HWLOC greater than 1.10 is supported,
+although versions in the 2.x series are recommended.
+
+Note that you must point configure at the libevent installation
+using the --with-libevent=<dir> option if it is in a non-standard
+location. Similarly, non-standard locations for the HWLOC package
+must be specified using the --with-hwloc=<dir> option. In both
+cases, PMIx will automatically detect these packages in standard
+locations and build-in support for them unless otherwise specified
+using the respective configure option.
+
 If you need special access to install, then you can execute "make
 all" as a user with write permissions in the build tree, and a
 separate "make install" as a user with write permissions to the

opal/mca/pmix/pmix4x/pmix/LICENSE

@@ -26,7 +26,7 @@ Copyright (c) 2006-2010 Sun Microsystems, Inc.  All rights reserved.
 Copyright (c) 2006-2010 The University of Houston. All rights reserved.
 Copyright (c) 2006-2009 Myricom, Inc.  All rights reserved.
 Copyright (c) 2007-2008 UT-Battelle, LLC. All rights reserved.
-Copyright (c) 2007-2010 IBM Corporation.  All rights reserved.
+Copyright (c) 2007-2019 IBM Corporation.  All rights reserved.
 Copyright (c) 1998-2005 Forschungszentrum Juelich, Juelich Supercomputing
                         Centre, Federal Republic of Germany
 Copyright (c) 2005-2008 ZIH, TU Dresden, Federal Republic of Germany
@@ -36,7 +36,7 @@ Copyright (c) 2008-2009 Institut National de Recherche en
                         Informatique.  All rights reserved.
 Copyright (c) 2007      Lawrence Livermore National Security, LLC.
                         All rights reserved.
-Copyright (c) 2007-2009 Mellanox Technologies.  All rights reserved.
+Copyright (c) 2007-2019 Mellanox Technologies.  All rights reserved.
 Copyright (c) 2006-2010 QLogic Corporation.  All rights reserved.
 Copyright (c) 2008-2010 Oak Ridge National Labs.  All rights reserved.
 Copyright (c) 2006-2010 Oracle and/or its affiliates.  All rights reserved.
@@ -45,7 +45,7 @@ Copyright (c) 2010      ARM ltd.  All rights reserved.
 Copyright (c) 2010-2011 Alex Brick <[email protected]>.  All rights reserved.
 Copyright (c) 2012      The University of Wisconsin-La Crosse. All rights
                         reserved.
-Copyright (c) 2013-2014 Intel, Inc. All rights reserved.
+Copyright (c) 2013-2019 Intel, Inc. All rights reserved.
 Copyright (c) 2011-2014 NVIDIA Corporation.  All rights reserved.
 
 $COPYRIGHT$

opal/mca/pmix/pmix4x/pmix/NEWS

@@ -1,4 +1,4 @@
-Copyright (c) 2015-2018 Intel, Inc. All rights reserved.
+Copyright (c) 2015-2019 Intel, Inc.  All rights reserved.
 Copyright (c) 2017      IBM Corporation.  All rights reserved.
 $COPYRIGHT$
 
@@ -17,13 +17,64 @@ the README file, PMIx typically maintains two separate version
 series simultaneously - the current release and one that is locked
 to only bug fixes.  Since these series are semi-independent of each
 other, a single NEWS-worthy item might apply to different series. For
-example, a bug might be fixed in the master, and then moved to the
-current release as well as the "stable" bug fix release branch.
-
+example, a bug might be fixed in the master, and then moved to
+multiple release branches.
 
 Master (not on release branches yet)
 ------------------------------------
 
+3.1.2 -- 24 Jan 2019
+----------------------
+ - Fix a bug in macro identifying system events
+ - Restore some non-standard macros to the pmix_extend.h
+   header - these are considered "deprecated" and will be
+   removed from public-facing headers in future releases
+
+
+3.1.1 -- 18 Jan 2019
+----------------------
+- Fix a bug in registration of default event handlers
+  that somehow slipped thru testing
+
+
+3.1.0 -- 17 Jan 2019
+----------------------
+**** THIS RELEASE MARKS THE STARTING POINT FOR FULL COMPLIANCE
+**** WITH THE PMIX v3 STANDARD. ALL API BEHAVIORS AND ATTRIBUTE
+**** DEFINITIONS MEET THE v3 STANDARD SPECIFICATIONS.
+ - Add a new, faster dstore GDS component 'ds21'
+ - Performance optimizations for the dstore GDS components.
+ - Plug miscellaneous memory leaks
+ - Silence an unnecessary warning message when checking connection
+   to a non-supporting server
+ - Ensure lost-connection events get delivered to default event
+   handlers
+ - Correctly handle cache refresh for queries
+ - Protect against race conditions between host and internal library
+   when dealing with async requests
+ - Cleanup tool operations and add support for connections to
+   remote servers. Initial support for debugger direct/indirect
+   launch verified with PRRTE. Cleanup setting of tmpdir options.
+   Drop rendezvous files when acting as a launcher
+ - Automatically store the server URI for easy access by client
+ - Provide MCA parameter to control TCP connect retry/timeout
+ - Update event notification system to properly evict oldest events
+   when more space is needed
+ - Fix a number of error paths
+ - Update IOF cache code to properly drop oldest message. Provide
+   MCA parameter for setting cache size.
+ - Handle setsockopt(SO_RCVTIMEO) not being supported
+ - Ensure that epilogs get run even when connections unexpectedly
+   terminate. Properly split epilog strings to process multiple
+   paths
+ - Pass the tool's command line to the server so it can be returned
+   in queries
+ - Add support for C11 atomics
+ - Support collection and forwarding of fabric-specific envars
+ - Improve handling of hwloc configure option
+ - Fix PMIx_server_generate_regex to preserve node ordering
+ - Fix a bug when registering default event handlers
+
 
 3.0.2 -- 18 Sept 2018
 ----------------------
@@ -93,6 +144,46 @@ Master (not on release branches yet)
 - Fix several memory and file descriptor leaks
 
 
+2.2.2 -- 24 Jan 2019
+----------------------
+ - Fix a bug in macro identifying system events
+
+
+2.2.1 -- 18 Jan 2019
+----------------------
+ - Fix a bug in registration of default event handlers
+   that somehow slipped thru testing
+
+
+2.2.0 -- 17 Jan 2019
+----------------------
+**** THIS RELEASE MARKS THE STARTING POINT FOR FULL COMPLIANCE
+**** WITH THE PMIX v2.2 STANDARD. ALL API BEHAVIORS AND ATTRIBUTE
+**** DEFINITIONS MEET THE v2.2 STANDARD SPECIFICATIONS.
+ - Add a new, faster dstore GDS component 'ds21'
+ - Performance optimizations for the dstore GDS components.
+ - Plug miscellaneous memory leaks
+ - Silence an unnecessary warning message when checking connection
+   to a non-supporting server
+ - Ensure lost-connection events get delivered to default event
+   handlers
+ - Correctly handle cache refresh for queries
+ - Protect against race conditions between host and internal library
+   when dealing with async requests
+ - Cleanup tool operations and add support for connections to
+   remote servers.
+ - Automatically store the server URI for easy access by client
+ - Provide MCA parameter to control TCP connect retry/timeout
+ - Update event notification system to properly evict oldest events
+   when more space is needed
+ - Fix a number of error paths
+ - Handle setsockopt(SO_RCVTIMEO) not being supported
+ - Pass the tool's command line to the server so it can be returned
+   in queries
+ - Add support for C11 atomics
+ - Fix a bug when registering default event handlers
+
+
 2.1.4 -- 18 Sep 2018
 ----------------------
 - Updated configury to silence warnings on older compilers
@@ -127,7 +218,7 @@ Master (not on release branches yet)
 - Fix several memory and file descriptor leaks
 
 
-2.1.1 -- 5 Mar 2018
+2.1.1 -- 23 Feb 2018
 ----------------------
 - Fix direct modex when receiving new nspace
 - Resolve direct modex of job-level info
@@ -154,7 +245,7 @@ Master (not on release branches yet)
   sets of numbers
 
 
-2.0.3 -- TBD
+2.0.3 -- 1 Feb 2018
 ----------------------
 - Fix event notification so all sides of multi-library get notified
   of other library's existence

opal/mca/pmix/pmix4x/pmix/VERSION

@@ -23,14 +23,14 @@ release=0
 # The only requirement is that it must be entirely printable ASCII
 # characters and have no white space.
 
-greek=a1
+greek=
 
 # If repo_rev is empty, then the repository version number will be
 # obtained during "make dist" via the "git describe --tags --always"
 # command, or with the date (if "git describe" fails) in the form of
 # "date<date>".
 
-repo_rev=gitb5863c9c
+repo_rev=gita1212af2
 
 # If tarball_version is not empty, it is used as the version string in
 # the tarball filename, regardless of all other versions listed in
@@ -44,7 +44,7 @@ tarball_version=
 
 # The date when this release was created
 
-date="Jan 10, 2019"
+date="Feb 04, 2019"
 
 # The shared library version of each of PMIx's public libraries.
 # These versions are maintained in accordance with the "Library

opal/mca/pmix/pmix4x/pmix/config/pmix.m4

@@ -645,6 +645,11 @@ AC_DEFUN([PMIX_SETUP_CORE],[
 
     pmix_show_title "Library and Function tests"
 
+    # Darwin doesn't need -lutil, as it's something other than this -lutil.
+    PMIX_SEARCH_LIBS_CORE([openpty], [util])
+
+    PMIX_SEARCH_LIBS_CORE([gethostbyname], [nsl])
+
     PMIX_SEARCH_LIBS_CORE([socket], [socket])
 
     # IRIX and CentOS have dirname in -lgen, usually in libc
@@ -653,6 +658,9 @@ AC_DEFUN([PMIX_SETUP_CORE],[
     # Darwin doesn't need -lm, as it's a symlink to libSystem.dylib
     PMIX_SEARCH_LIBS_CORE([ceil], [m])
 
+    # -lrt might be needed for clock_gettime
+    PMIX_SEARCH_LIBS_CORE([clock_gettime], [rt])
+
     AC_CHECK_FUNCS([asprintf snprintf vasprintf vsnprintf strsignal socketpair strncpy_s usleep statfs statvfs getpeereid getpeerucred strnlen posix_fallocate tcgetpgrp])
 
     # On some hosts, htonl is a define, so the AC_CHECK_FUNC will get