Update to PMIx 3.1.2

Update the OPAL glue configure code to correctly link the opal/pmix3
component to the hwloc used by OMPI instead of defaulting to the
system-level hwloc. Required a corresponding update to the PMIx hwloc
configure code so we treat hwloc the same way we handle libevent in
embedded scenarios. Roll to PMIx v3.1.2 for plugging of memory leaks and
addition of faster PMIx_Get response

Signed-off-by: Ralph Castain <[email protected]>

Author: rhc54

.gitignore

@@ -365,6 +365,8 @@ opal/mca/hwloc/base/static-components.h.new.struct
 
 opal/mca/installdirs/config/install_dirs.h
 
+!opal/mca/pmix/pmix*/pmix/AUTHORS
+!opal/mca/pmix/pmix*/pmix/contrib/perf_tools/Makefile
 opal/mca/pmix/pmix*/pmix/include/pmix/autogen/config.h
 opal/mca/pmix/pmix*/pmix/include/pmix/autogen/config.h.in
 opal/mca/pmix/pmix*/pmix/src/include/private/autogen/config.h.in

opal/mca/pmix/pmix3x/configure.m4

@@ -13,7 +13,7 @@
 # Copyright (c) 2011-2013 Los Alamos National Security, LLC.
 #                         All rights reserved.
 # Copyright (c) 2010-2017 Cisco Systems, Inc.  All rights reserved.
-# Copyright (c) 2013-2018 Intel, Inc. All rights reserved.
+# Copyright (c) 2013-2019 Intel, Inc.  All rights reserved.
 # Copyright (c) 2015-2016 Research Organization for Information Science
 #                         and Technology (RIST). All rights reserved.
 # $COPYRIGHT$
@@ -53,14 +53,14 @@ AC_DEFUN([MCA_opal_pmix_pmix3x_CONFIG],[
         opal_pmix_pmix3x_timing_flag=--disable-pmix-timing
     fi
 
-    opal_pmix_pmix3x_args="$opal_pmix_pmix3x_timing_flag --without-tests-examples --disable-pmix-binaries --disable-pmix-backward-compatibility --disable-visibility --enable-embedded-libevent --with-libevent-header=\\\"opal/mca/event/$opal_event_base_include\\\""
+    opal_pmix_pmix3x_args="$opal_pmix_pmix3x_timing_flag --without-tests-examples --disable-pmix-binaries --disable-pmix-backward-compatibility --disable-visibility --enable-embedded-libevent --with-libevent-header=\\\"opal/mca/event/$opal_event_base_include\\\" --enable-embedded-hwloc --with-hwloc-header=\\\"$opal_hwloc_base_include\\\""
     AS_IF([test "$enable_debug" = "yes"],
           [opal_pmix_pmix3x_args="--enable-debug $opal_pmix_pmix3x_args"
            CFLAGS="$OPAL_CFLAGS_BEFORE_PICKY $OPAL_VISIBILITY_CFLAGS -g"],
           [opal_pmix_pmix3x_args="--disable-debug $opal_pmix_pmix3x_args"
            CFLAGS="$OPAL_CFLAGS_BEFORE_PICKY $OPAL_VISIBILITY_CFLAGS"])
     AC_MSG_CHECKING([if want to install standalone libpmix])
-    AS_IF([test "$enable_install_libpmix" == "yes"],
+    AS_IF([test "$enable_install_libpmix" = "yes"],
           [AC_MSG_RESULT([yes])],
           [AC_MSG_RESULT([no])
            opal_pmix_pmix3x_args="--with-pmix-symbol-rename=OPAL_MCA_PMIX3X_ --enable-embedded-mode $opal_pmix_pmix3x_args"])

opal/mca/pmix/pmix3x/pmix/INSTALL

@@ -9,7 +9,7 @@ Copyright (c) 2004-2005 High Performance Computing Center Stuttgart,
 Copyright (c) 2004-2005 The Regents of the University of California.
                         All rights reserved.
 Copyright (c) 2008-2015 Cisco Systems, Inc.  All rights reserved.
-Copyright (c) 2013-2017 Intel, Inc. All rights reserved.
+Copyright (c) 2013-2019 Intel, Inc.  All rights reserved.
 $COPYRIGHT$
 
 Additional copyrights may follow
@@ -22,9 +22,9 @@ For More Information
 
 This file is a *very* short overview of building and installing
 the PMIx library.  Much more information is available in the
-FAQ section on the PMIx web site:
+How-To section on the PMIx web site:
 
-    http://pmix.github.io/pmix/faq
+    https://pmix.org/support/how-to/
 
 
 Developer Builds
@@ -56,6 +56,24 @@ shell$ ./configure --prefix=/where/to/install
 [...lots of output...]
 shell$ make all install
 
+NOTE: this version of PMIx requires the Libevent package to build
+and operate. Any version of Libevent greater than or equal to
+2.0.21 is acceptable.
+
+NOTE: this version of PMIx optionally supports the HWLOC package
+for providing topology information to both the host environment
+(by collecting local inventory for rollup) and local client
+processes. Any version of HWLOC greater than 1.10 is supported,
+although versions in the 2.x series are recommended.
+
+Note that you must point configure at the libevent installation
+using the --with-libevent=<dir> option if it is in a non-standard
+location. Similarly, non-standard locations for the HWLOC package
+must be specified using the --with-hwloc=<dir> option. In both
+cases, PMIx will automatically detect these packages in standard
+locations and build-in support for them unless otherwise specified
+using the respective configure option.
+
 If you need special access to install, then you can execute "make
 all" as a user with write permissions in the build tree, and a
 separate "make install" as a user with write permissions to the

opal/mca/pmix/pmix3x/pmix/LICENSE

@@ -26,7 +26,7 @@ Copyright (c) 2006-2010 Sun Microsystems, Inc.  All rights reserved.
 Copyright (c) 2006-2010 The University of Houston. All rights reserved.
 Copyright (c) 2006-2009 Myricom, Inc.  All rights reserved.
 Copyright (c) 2007-2008 UT-Battelle, LLC. All rights reserved.
-Copyright (c) 2007-2018 IBM Corporation.  All rights reserved.
+Copyright (c) 2007-2019 IBM Corporation.  All rights reserved.
 Copyright (c) 1998-2005 Forschungszentrum Juelich, Juelich Supercomputing
                         Centre, Federal Republic of Germany
 Copyright (c) 2005-2008 ZIH, TU Dresden, Federal Republic of Germany
@@ -36,7 +36,7 @@ Copyright (c) 2008-2009 Institut National de Recherche en
                         Informatique.  All rights reserved.
 Copyright (c) 2007      Lawrence Livermore National Security, LLC.
                         All rights reserved.
-Copyright (c) 2007-2018 Mellanox Technologies.  All rights reserved.
+Copyright (c) 2007-2019 Mellanox Technologies.  All rights reserved.
 Copyright (c) 2006-2010 QLogic Corporation.  All rights reserved.
 Copyright (c) 2008-2010 Oak Ridge National Labs.  All rights reserved.
 Copyright (c) 2006-2010 Oracle and/or its affiliates.  All rights reserved.
@@ -45,7 +45,7 @@ Copyright (c) 2010      ARM ltd.  All rights reserved.
 Copyright (c) 2010-2011 Alex Brick <[email protected]>.  All rights reserved.
 Copyright (c) 2012      The University of Wisconsin-La Crosse. All rights
                         reserved.
-Copyright (c) 2013-2018 Intel, Inc. All rights reserved.
+Copyright (c) 2013-2019 Intel, Inc. All rights reserved.
 Copyright (c) 2011-2014 NVIDIA Corporation.  All rights reserved.
 
 $COPYRIGHT$

opal/mca/pmix/pmix3x/pmix/Makefile.am

@@ -37,10 +37,6 @@ dist_pmixdata_DATA =
 if ! PMIX_EMBEDDED_MODE
 dist_pmixdata_DATA += contrib/pmix-valgrind.supp
 
-if PMIX_HAVE_PANDOC
-SUBDIRS += man
-endif
-
 endif
 
 if PMIX_TESTS_EXAMPLES

opal/mca/pmix/pmix3x/pmix/NEWS

@@ -1,4 +1,4 @@
-Copyright (c) 2015-2018 Intel, Inc. All rights reserved.
+Copyright (c) 2015-2019 Intel, Inc.  All rights reserved.
 Copyright (c) 2017      IBM Corporation.  All rights reserved.
 $COPYRIGHT$
 
@@ -17,8 +17,61 @@ the README file, PMIx typically maintains two separate version
 series simultaneously - the current release and one that is locked
 to only bug fixes.  Since these series are semi-independent of each
 other, a single NEWS-worthy item might apply to different series. For
-example, a bug might be fixed in the master, and then moved to the
-current release as well as the "stable" bug fix release branch.
+example, a bug might be fixed in the master, and then moved to
+multiple release branches.
+
+
+3.1.2 -- 24 Jan 2019
+----------------------
+ - Fix a bug in macro identifying system events
+ - Restore some non-standard macros to the pmix_extend.h
+   header - these are considered "deprecated" and will be
+   removed from public-facing headers in future releases
+
+
+3.1.1 -- 18 Jan 2019
+----------------------
+- Fix a bug in registration of default event handlers
+  that somehow slipped thru testing
+
+
+3.1.0 -- 17 Jan 2019
+----------------------
+**** THIS RELEASE MARKS THE STARTING POINT FOR FULL COMPLIANCE
+**** WITH THE PMIX v3 STANDARD. ALL API BEHAVIORS AND ATTRIBUTE
+**** DEFINITIONS MEET THE v3 STANDARD SPECIFICATIONS.
+ - Add a new, faster dstore GDS component 'ds21'
+ - Performance optimizations for the dstore GDS components.
+ - Plug miscellaneous memory leaks
+ - Silence an unnecessary warning message when checking connection
+   to a non-supporting server
+ - Ensure lost-connection events get delivered to default event
+   handlers
+ - Correctly handle cache refresh for queries
+ - Protect against race conditions between host and internal library
+   when dealing with async requests
+ - Cleanup tool operations and add support for connections to
+   remote servers. Initial support for debugger direct/indirect
+   launch verified with PRRTE. Cleanup setting of tmpdir options.
+   Drop rendezvous files when acting as a launcher
+ - Automatically store the server URI for easy access by client
+ - Provide MCA parameter to control TCP connect retry/timeout
+ - Update event notification system to properly evict oldest events
+   when more space is needed
+ - Fix a number of error paths
+ - Update IOF cache code to properly drop oldest message. Provide
+   MCA parameter for setting cache size.
+ - Handle setsockopt(SO_RCVTIMEO) not being supported
+ - Ensure that epilogs get run even when connections unexpectedly
+   terminate. Properly split epilog strings to process multiple
+   paths
+ - Pass the tool's command line to the server so it can be returned
+   in queries
+ - Add support for C11 atomics
+ - Support collection and forwarding of fabric-specific envars
+ - Improve handling of hwloc configure option
+ - Fix PMIx_server_generate_regex to preserve node ordering
+ - Fix a bug when registering default event handlers
 
 
 3.0.2 -- 18 Sept 2018
@@ -89,6 +142,46 @@ current release as well as the "stable" bug fix release branch.
 - Fix several memory and file descriptor leaks
 
 
+2.2.2 -- 24 Jan 2019
+----------------------
+ - Fix a bug in macro identifying system events
+
+
+2.2.1 -- 18 Jan 2019
+----------------------
+ - Fix a bug in registration of default event handlers
+   that somehow slipped thru testing
+
+
+2.2.0 -- 17 Jan 2019
+----------------------
+**** THIS RELEASE MARKS THE STARTING POINT FOR FULL COMPLIANCE
+**** WITH THE PMIX v2.2 STANDARD. ALL API BEHAVIORS AND ATTRIBUTE
+**** DEFINITIONS MEET THE v2.2 STANDARD SPECIFICATIONS.
+ - Add a new, faster dstore GDS component 'ds21'
+ - Performance optimizations for the dstore GDS components.
+ - Plug miscellaneous memory leaks
+ - Silence an unnecessary warning message when checking connection
+   to a non-supporting server
+ - Ensure lost-connection events get delivered to default event
+   handlers
+ - Correctly handle cache refresh for queries
+ - Protect against race conditions between host and internal library
+   when dealing with async requests
+ - Cleanup tool operations and add support for connections to
+   remote servers.
+ - Automatically store the server URI for easy access by client
+ - Provide MCA parameter to control TCP connect retry/timeout
+ - Update event notification system to properly evict oldest events
+   when more space is needed
+ - Fix a number of error paths
+ - Handle setsockopt(SO_RCVTIMEO) not being supported
+ - Pass the tool's command line to the server so it can be returned
+   in queries
+ - Add support for C11 atomics
+ - Fix a bug when registering default event handlers
+
+
 2.1.4 -- 18 Sep 2018
 ----------------------
 - Updated configury to silence warnings on older compilers

opal/mca/pmix/pmix3x/pmix/README

@@ -43,6 +43,11 @@ [email protected]!).  You can subscribe to the list here:
 
      https://groups.google.com/d/forum/pmix
 
+Finally, just to round out all the possible ways to communicate with the
+PMIx community, you are invited to join the community's Slack channel:
+
+    pmix-workspace.slack.com
+
 Thanks for your time.
 
 ===========================================================================
@@ -192,21 +197,22 @@ PMIx's version numbers are the union of several different values:
 major, minor, release, and an optional quantifier.
 
   * Major: The major number is the first integer in the version string
-    (e.g., v1.2.3). Changes in the major number typically indicate a
-    significant change in the code base and/or end-user
-    functionality. The major number is always included in the version
-    number.
+    (e.g., v1.2.3) and indicates the corresponding version of the PMIx
+    Standard. In other words, a PMIx library release starting with "v2"
+    indicates that the implementation conforms to version 2 of the PMIx
+    Standard.
 
   * Minor: The minor number is the second integer in the version
     string (e.g., v1.2.3). Changes in the minor number typically
     indicate a incremental change in the code base and/or end-user
-    functionality. The minor number is always included in the version
-    number:
+    functionality, but not the supported version of the Standard.
+    The minor number is always included in the version number.
 
   * Release: The release number is the third integer in the version
     string (e.g., v1.2.3). Changes in the release number typically
     indicate a bug fix in the code base and/or end-user
-    functionality.
+    functionality. The release number is always included in the
+    version number.
 
   * Quantifier: PMIx version numbers sometimes have an arbitrary
     string affixed to the end of the version number. Common strings
@@ -293,16 +299,15 @@ Application Binary Interface (ABI) Compatibility
 ------------------------------------------------
 
 PMIx provides forward ABI compatibility in all versions of a given
-feature release series and its corresponding
-super stable series.  For example, on a single platform, an pmix
+feature release series.  For example, on a single platform, an pmix
 application linked against PMIx v1.3.2 shared libraries can be
 updated to point to the shared libraries in any successive v1.3.x or
 v1.4 release and still work properly (e.g., via the LD_LIBRARY_PATH
 environment variable or other operating system mechanism).
 
-PMIx reserves the right to break ABI compatibility at new feature
+PMIx reserves the right to break ABI compatibility at new major
 release series.  For example, the same pmix application from above
-(linked against PMIx v1.3.2 shared libraries) will *not* work with
+(linked against PMIx v1.3.2 shared libraries) may *not* work with
 PMIx v1.5 shared libraries.
 
 ===========================================================================

opal/mca/pmix/pmix3x/pmix/VERSION

@@ -14,7 +14,7 @@
 # <major>.<minor>.<release>.
 
 major=3
-minor=0
+minor=1
 release=2
 
 # greek is used for alpha or beta release tags.  If it is non-empty,
@@ -30,7 +30,7 @@ greek=
 # command, or with the date (if "git describe" fails) in the form of
 # "date<date>".
 
-repo_rev=gite574b10d
+repo_rev=git0f7075f7
 
 # If tarball_version is not empty, it is used as the version string in
 # the tarball filename, regardless of all other versions listed in
@@ -44,7 +44,7 @@ tarball_version=
 
 # The date when this release was created
 
-date="Sep 18, 2018"
+date="Jan 24, 2019"
 
 # The shared library version of each of PMIx's public libraries.
 # These versions are maintained in accordance with the "Library
@@ -75,6 +75,13 @@ date="Sep 18, 2018"
 # Version numbers are described in the Libtool current:revision:age
 # format.
 
-libpmix_so_version=4:2:2
+libpmix_so_version=4:22:2
 libpmi_so_version=1:0:0
 libpmi2_so_version=1:0:0
+
+# "Common" components install standalone libraries that are run-time
+# # linked by one or more components.  So they need to be versioned as
+# # well.  Yuck; this somewhat breaks the
+# # components-don't-affect-the-build-system abstraction.
+#
+libmca_common_dstore_so_version=1:0:0