Update on "[reland] Update tls logic to work better with guarded call (#73925)"

This PR relands #73925 which we
reverted due to a large breakage in functorch.

As a part of the reland, this PR adds a change we agreed upon in
https://docs.google.com/document/d/1i7Y9VZp9PxtgVcrQh6nGQXkXkPc1uMep0dM-OMOGJ9o/edit
The change is moving the PythonTLSSnapshot key after
DynamicLayerFrontMode.

Test Plan:
- I tested this with an updated version of functorch and all the tests
pass so I think we are out of the woods.

[ghstack-poisoned]

Author: zou3519

.circleci/docker/common/install_rocm.sh

@@ -6,8 +6,8 @@ install_magma() {
     # "install" hipMAGMA into /opt/rocm/magma by copying after build
     git clone https://bitbucket.org/icl/magma.git
     pushd magma
-    # fix for magma_queue memory leak issue
-    git checkout c62d700d880c7283b33fb1d615d62fc9c7f7ca21
+    # Fixes memory leaks of magma found while executing linalg UTs
+    git checkout 5959b8783e45f1809812ed96ae762f38ee701972
     cp make.inc-examples/make.inc.hip-gcc-mkl make.inc
     echo 'LIBDIR += -L$(MKLROOT)/lib' >> make.inc
     echo 'LIB += -Wl,--enable-new-dtags -Wl,--rpath,/opt/rocm/lib -Wl,--rpath,$(MKLROOT)/lib -Wl,--rpath,/opt/rocm/magma/lib' >> make.inc

.circleci/scripts/binary_linux_test.sh

@@ -67,7 +67,8 @@ mv /final_pkgs/debug-*.zip /tmp/debug_final_pkgs || echo "no debug packages to m
 # TODO there is duplicated and inconsistent test-python-env setup across this
 #   file, builder/smoke_test.sh, and builder/run_tests.sh, and also in the
 #   conda build scripts themselves. These should really be consolidated
-pkg="/final_pkgs/\$(ls /final_pkgs)"
+# Pick only one package of multiple available (which happens as result of workflow re-runs)
+pkg="/final_pkgs/\$(ls -1 /final_pkgs|sort|tail -1)"
 if [[ "$PACKAGE_TYPE" == conda ]]; then
   (
     # For some reason conda likes to re-activate the conda environment when attempting this install

.github/actions/setup-win/action.yml

@@ -1,6 +1,6 @@
 name: Setup Windows
 
-description: Set up Docker workspace on linux
+description: Set up for windows jobs
 
 inputs:
   github-secret:
@@ -56,7 +56,7 @@ runs:
         .circleci/scripts/windows_cuda_install.sh
         .circleci/scripts/windows_cudnn_install.sh
 
-    - uses: actions/setup-python@v2
-      name: Setup Python3
+    - name: Setup Python3
+      uses: actions/setup-python@v2
       with:
         python-version: "3.x"